tribuchet: building on jamie [0.00s] Machine state will be reset. To keep it, pass --keep-machine-state [0.00s] start all VLans [0.01s] (finished: start all VLans, in 0.00 seconds) [0.01s] Test will time out and terminate in 1200.0 seconds [0.01s] run the VM test script [0.01s] machine: waiting for unit k3s.service [0.01s] machine: waiting for the VM to finish booting [0.01s] machine: starting vm [0.35s] machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.FEz15qGClc', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 43c06cc1-24c9-4739-9ed5-7a9b6a101f7b machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-11-12T13:14:30Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-11-12T13:14:30Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-11-12T13:14:30Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-11-12T13:14:30Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-11-12T13:14:30Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-11-12T13:14:30Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-11-12T13:14:30Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-11-12T13:14:30Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-11-12T13:14:30Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-11-12T13:14:30Z INFO virtiofsd] Client connected, servicing requests machine # [2026-11-12T13:14:30Z INFO virtiofsd] Client connected, servicing requests machine # [2026-11-12T13:14:30Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.60 (nixbld@localhost) (gcc (GCC) 16.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC @1793362001 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9daqi1a4xzhapk8xd94wx0w9ha2ad2s4-nixos-system-machine-test/init regInfo=/nix/.ro-store/8pwg7fyb50xmc4wmwks81bshbr23lpbk-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 499110957 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000764] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000790] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000793] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000832] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002692] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002704] Using GB pages for direct mapping machine # [ 0.002860] RAMDISK: [mem 0x7e436000-0x7ffcffff] machine # [ 0.002867] ACPI: Early table checksum verification disabled machine # [ 0.002870] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002874] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002878] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002885] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002887] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002889] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002890] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002892] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002893] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002894] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002895] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002896] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002897] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002897] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002898] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002898] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003123] No NUMA configuration found machine # [ 0.003124] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003127] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005650] Zone ranges: machine # [ 0.005651] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005653] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005654] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005655] Device empty machine # [ 0.005656] Movable zone start for each node machine # [ 0.005656] Early memory node ranges machine # [ 0.005657] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005658] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005658] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005659] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005679] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005937] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.076811] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.077266] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.077280] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.077315] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.077318] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.077320] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.077321] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.077322] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.077323] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.077325] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.077327] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.077332] TSC deadline timer available machine # [ 0.077336] CPU topo: Max. logical packages: 1 machine # [ 0.077337] CPU topo: Max. logical dies: 1 machine # [ 0.077337] CPU topo: Max. dies per package: 1 machine # [ 0.077340] CPU topo: Max. threads per core: 1 machine # [ 0.077341] CPU topo: Num. cores per package: 4 machine # [ 0.077342] CPU topo: Num. threads per package: 4 machine # [ 0.077342] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.077365] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.077381] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.077384] kvm-guest: setup PV sched yield machine # [ 0.077394] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.077395] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.077396] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.077398] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.077399] Booting paravirtualized kernel on KVM machine # [ 0.077403] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.082097] setup_percpu: NR_CPUS:512 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.084309] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.084359] kvm-guest: PV spinlocks enabled machine # [ 0.084361] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.084364] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9daqi1a4xzhapk8xd94wx0w9ha2ad2s4-nixos-system-machine-test/init regInfo=/nix/.ro-store/8pwg7fyb50xmc4wmwks81bshbr23lpbk-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.084459] Unknown kernel command line parameters "regInfo=/nix/.ro-store/8pwg7fyb50xmc4wmwks81bshbr23lpbk-closure-info/registration", will be passed to user space. machine # [ 0.084472] random: crng init done machine # [ 0.084473] printk: log buffer data + meta data: 1048576 + 3670016 = 4718592 bytes machine # [ 0.088767] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.091169] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.091242] software IO TLB: area num 4. machine # [ 0.165748] Fallback order for Node 0: 0 machine # [ 0.165757] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.165759] Policy zone: Normal machine # [ 0.168275] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.175389] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.184491] allocated 8388608 bytes of page_ext machine # [ 0.194609] ftrace: allocating 49004 entries in 192 pages machine # [ 0.194611] ftrace: allocated 192 pages with 2 groups machine # [ 0.195785] Dynamic Preempt: lazy machine # [ 0.195965] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.195966] rcu: RCU event tracing is enabled. machine # [ 0.195966] rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=4. machine # [ 0.195968] Trampoline variant of Tasks RCU enabled. machine # [ 0.195968] Rude variant of Tasks RCU enabled. machine # [ 0.195968] Tracing variant of Tasks RCU enabled. machine # [ 0.195970] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.195971] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.195992] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.195993] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.195994] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.200299] NR_IRQS: 33024, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.200619] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.200628] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.200741] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.204287] Console: colour VGA+ 80x25 machine # [ 0.204291] printk: legacy console [tty0] enabled machine # [ 0.235850] printk: legacy console [ttyS0] enabled machine # [ 0.345912] ACPI: Core revision 20250807 machine # [ 0.346859] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.348562] APIC: Switch to symmetric I/O mode setup machine # [ 0.349674] x2apic enabled machine # [ 0.350439] APIC: Switched APIC routing to: physical x2apic machine # [ 0.351386] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.352697] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.354257] kvm-guest: setup PV IPIs machine # [ 0.355853] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.356906] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.361364] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.363448] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.364486] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.365362] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.366364] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.368361] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.369362] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.371361] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.372331] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.373361] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.374369] Spectre V2 : Enabling IBPB for BPF machine # [ 0.375362] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.376361] active return thunk: srso_alias_return_thunk machine # [ 0.378047] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.379361] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.380361] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.381361] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.382361] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.383361] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.384361] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.386362] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.387361] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.388361] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.389361] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.390361] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.391361] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.421211] Freeing SMP alternatives memory: 48K machine # [ 0.421976] pid_max: default: 32768 minimum: 301 machine # [ 0.422462] LSM: initializing lsm=lockdown,capability,landlock,yama,bpf,ima machine # [ 0.423470] landlock: Up and running. machine # [ 0.424826] Yama: becoming mindful. machine # [ 0.425576] LSM support for eBPF active machine # [ 0.426523] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.427443] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.430599] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.432014] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.432372] ... version: 2 machine # [ 0.433165] ... bit width: 48 machine # [ 0.433363] ... generic counters: 6 machine # [ 0.434094] ... generic bitmap: 000000000000003f machine # [ 0.434363] ... fixed-purpose counters: 0 machine # [ 0.435109] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.435363] ... value mask: 0000ffffffffffff machine # [ 0.436309] ... max period: 00007fffffffffff machine # [ 0.437124] ... global_ctrl mask: 000000000000003f machine # [ 0.437468] signal: max sigframe size: 3376 machine # [ 0.438304] rcu: Hierarchical SRCU implementation. machine # [ 0.439017] rcu: Max phase no-delay instances is 400. machine # [ 0.439556] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.445228] smp: Bringing up secondary CPUs ... machine # [ 0.446403] smpboot: x86: Booting SMP configuration: machine # [ 0.447239] .... node #0, CPUs: #1 #2 #3 machine # [ 0.450516] smp: Brought up 1 node, 4 CPUs machine # [ 0.452109] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.452706] Memory: 3952492K/4193752K available (18198K kernel code, 5432K rwdata, 13720K rodata, 6720K init, 3992K bss, 226208K reserved, 0K cma-reserved) machine # [ 0.455364] devtmpfs: initialized machine # [ 0.456445] x86/mm: Memory block size: 128MB machine # [ 0.459426] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.460438] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.461466] pinctrl core: initialized pinctrl subsystem machine # [ 0.462720] PM: RTC time: 13:14:30, date: 2026-11-12 machine # [ 0.466234] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.467962] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.468397] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.469929] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.470375] audit: initializing netlink subsys (disabled) machine # [ 0.471399] audit: type=2000 audit(1794489271.332:1): state=initialized audit_enabled=0 res=1 machine # [ 0.471592] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.473365] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.474363] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.475363] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.476363] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.477391] cpuidle: using governor menu machine # [ 0.479593] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.480613] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.481375] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.482377] PCI: Using configuration type 1 for base access machine # [ 0.483561] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.486574] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.489374] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.491369] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.494368] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.501473] ACPI: Added _OSI(Module Device) machine # [ 0.502243] ACPI: Added _OSI(Processor Device) machine # [ 0.502939] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.506082] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.509228] ACPI: Interpreter enabled machine # [ 0.511485] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.513371] ACPI: Using IOAPIC for interrupt routing machine # [ 0.515610] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.519370] PCI: Using E820 reservations for host bridge windows machine # [ 0.521867] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.535237] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.537421] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.541602] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.544685] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.548376] PCI host bridge to bus 0000:00 machine # [ 0.550375] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.552367] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.554367] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.557367] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.559367] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.562367] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.564376] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.566673] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.569917] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.583454] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.584376] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.585352] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.586720] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.589328] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.594405] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.595370] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.596386] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.597371] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.598940] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.605147] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.606111] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.606386] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.608944] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.612404] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.613288] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.614137] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.616940] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.620403] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.621326] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.622190] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.623369] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.624942] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.628376] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.629386] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.630950] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.633409] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.634386] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.637577] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.640426] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.653239] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.655113] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.660420] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.663435] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.668549] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.682418] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.684385] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.687424] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.691734] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.701410] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.703385] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.706424] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.710768] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.715422] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.717999] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.722448] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.723801] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.727419] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.728614] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.731398] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.732596] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.733650] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.735648] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.739392] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.740305] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.741477] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.744392] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.748465] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.749472] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.751468] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.752463] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.753461] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.754463] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.755462] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.756488] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.757397] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.758381] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.759376] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.761380] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.762376] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.763379] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.764376] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.765377] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.767717] iommu: Default domain type: Translated machine # [ 0.768366] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.770699] ACPI: bus type USB registered machine # [ 0.771421] usbcore: registered new interface driver usbfs machine # [ 0.772384] usbcore: registered new interface driver hub machine # [ 0.773316] usbcore: registered new device driver usb machine # [ 0.775271] NetLabel: Initializing machine # [ 0.775848] NetLabel: domain hash size = 128 machine # [ 0.776363] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.777353] NetLabel: unlabeled traffic allowed by default machine # [ 0.778120] PCI: Using ACPI for IRQ routing machine # [ 0.822391] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.823360] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.823360] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.825368] vgaarb: loaded machine # [ 0.826146] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.827364] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.832479] clocksource: Switched to clocksource kvm-clock machine # [ 0.835854] VFS: Disk quotas dquot_6.6.0 machine # [ 0.836570] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.838100] pnp: PnP ACPI init machine # [ 0.838894] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.839847] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.841432] pnp: PnP ACPI: found 5 devices machine # [ 0.851127] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.852814] clocksource: Switched to clocksource acpi_pm machine # [ 0.853868] NET: Registered PF_INET protocol family machine # [ 0.855362] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.873016] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.874785] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.876188] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.877609] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.878926] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.880250] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.881722] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.883075] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.884410] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.885401] NET: Registered PF_XDP protocol family machine # [ 0.886300] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.887351] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.888411] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.889552] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.890700] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.891860] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.893776] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.895900] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.897973] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.900034] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.901829] PCI: CLS 0 bytes, default 64 machine # [ 0.902785] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.903225] Trying to unpack rootfs image as initramfs... machine # [ 0.903879] software IO TLB: mapped [mem 0x000000007a436000-0x000000007e436000] (64MB) machine # [ 0.904003] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.927724] Initialise system trusted keyrings machine # [ 0.928805] Key type blacklist registered machine # [ 0.930011] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 0.931447] integrity: Platform Keyring initialized machine # [ 0.932354] integrity: Machine keyring initialized machine # [ 0.942666] Key type asymmetric registered machine # [ 0.943431] Asymmetric key parser 'x509' registered machine # [ 0.944358] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 0.945991] io scheduler mq-deadline registered machine # [ 0.946854] io scheduler kyber registered machine # [ 0.950298] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 0.951630] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 0.954219] Linux agpgart interface v0.103 machine # [ 0.955019] ACPI: bus type drm_connector registered machine # [ 0.958268] usbcore: registered new interface driver usbserial_generic machine # [ 0.959392] usbserial: USB Serial support registered for generic machine # [ 0.960430] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 0.960430] Please enable it if your BIOS has the CPPC option. machine # [ 0.962770] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 0.964203] drop_monitor: Initializing network drop monitor service machine # [ 0.965457] NET: Registered PF_INET6 protocol family machine # [ 0.967283] Segment Routing with IPv6 machine # [ 0.968017] In-situ OAM (IOAM) with IPv6 machine # [ 0.970100] IPI shorthand broadcast: enabled machine # [ 0.974462] sched_clock: Marking stable (822014971, 151732216)->(993364623, -19617436) machine # [ 0.976297] registered taskstats version 1 machine # [ 0.977375] Loading compiled-in X.509 certificates machine # [ 0.987421] Demotion targets for Node 0: null machine # [ 0.988582] Key type .fscrypt registered machine # [ 0.989329] Key type fscrypt-provisioning registered machine # [ 0.990310] ima: No TPM chip found, activating TPM-bypass! machine # [ 0.991279] ima: Allocated hash algorithm: sha1 machine # [ 0.992124] ima: No architecture policies found machine # [ 0.993159] PM: Magic number: 2:479:230 machine # [ 0.994833] RAS: Correctable Errors collector initialized. machine # [ 0.999437] clk: Disabling unused clocks machine # [ 1.000181] PM: genpd: Disabling unused power domains machine # [ 1.179589] Freeing initrd memory: 28264K machine # [ 1.183458] Freeing unused decrypted memory: 2028K machine # [ 1.188023] Freeing unused kernel image (initmem) memory: 6720K machine # [ 1.189140] Write protecting the kernel read-only data: 32768k machine # [ 1.190750] Freeing unused kernel image (text/rodata gap) memory: 232K machine # [ 1.192354] Freeing unused kernel image (rodata/data gap) memory: 616K machine # [ 1.243458] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.244629] Run /init as init process machine # [ 1.257489] autofs4: module verification failed: signature and/or required key missing - tainting kernel machine # [ 1.260806] systemd[1]: Inserted module 'autofs4' machine # [ 1.286812] fuse: init (API version 7.45) machine # [ 1.295476] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.297816] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.312380] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.314540] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.319211] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.320770] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.328216] virtiofs virtio6: discovered new tag: shared machine # [ 1.329702] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.332967] virtiofs virtio7: discovered new tag: xchg machine # [ 1.334374] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.364023] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.699710] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.706917] systemd[1]: Detected virtualization kvm. machine # [ 1.709115] systemd[1]: Detected architecture x86-64. machine # [ 1.711287] systemd[1]: Running in initrd. machine # [ 1.713911] systemd[1]: Initializing machine ID from random generator. machine # [ 1.716883] systemd[1]: Hostname set to . machine # [ 1.813133] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.858391] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.867272] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.868515] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.870022] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.871170] systemd[1]: Reached target Path Units. machine # [ 1.872087] systemd[1]: Reached target Slice Units. machine # [ 1.872988] systemd[1]: Reached target Swaps. machine # [ 1.873787] systemd[1]: Reached target Timer Units. machine # [ 1.874770] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.875984] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.877158] systemd[1]: Listening on Journal Sockets. machine # [ 1.878161] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.879287] systemd[1]: Listening on udev Varlink Socket. machine # [ 1.880294] systemd[1]: Reached target Socket Units. machine # [ 1.882308] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 1.884624] systemd[1]: Starting Load Kernel Module configfs... machine # [ 1.887697] systemd[1]: Starting Journal Service... machine # [ 1.894998] systemd[1]: Starting Load Kernel Modules... machine # [ 1.898899] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 1.901438] systemd[1]: Starting Coldplug All udev Devices... machine # [ 1.903489] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 1.908950] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 1.913084] systemd[1]: Finished Load Kernel Module configfs. machine # [ 1.916834] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 1.924948] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 1.933818] systemd-journald[88]: Collecting audit messages is disabled. machine # [ 1.950750] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 1.953004] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 1.953179] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 1.954420] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 1.957659] systemd[1]: Finished Load Kernel Modules. machine # [ 1.959501] systemd[1]: Starting Apply Kernel Variables... machine # [ 1.968596] systemd[1]: Finished Apply Kernel Variables. machine # [ 1.971211] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 1.972491] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 1.973679] systemd[1]: Reached target Local File Systems. machine # [ 1.975641] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 1.984064] systemd[1]: Started Journal Service. machine # [ 1.832347] systemd-modules-load[89]: Using 4 probe threads machine # [ 1.834472] systemd-modules-load[89]: Inserted module 'virtio_balloon' machine # [ 1.836217] systemd-modules-load[89]: Inserted module 'virtio_gpu' machine # [ 1.837325] systemd-modules-load[89]: Inserted module 'dm_mod' machine # [ 1.838372] systemd[1]: Starting Create System Files and Directories... machine # [ 1.847207] systemd[1]: Finished Create System Files and Directories. machine # [ 1.848499] systemd-udevd[101]: Using default interface naming scheme 'v261'. machine # [ 1.858522] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.862916] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.863875] systemd[1]: Reached target System Initialization. machine # [ 1.864780] systemd[1]: Reached target Basic System. machine # [ 2.107317] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.108144] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 machine # [ 2.109481] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.115773] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.119116] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.120513] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.121596] usb usb1: Product: EHCI Host Controller machine # [ 2.122340] usb usb1: Manufacturer: Linux 6.18.60 ehci_hcd machine # [ 2.123147] usb usb1: SerialNumber: 0000:00:1d.7 machine # [ 2.133104] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.138045] hub 1-0:1.0: USB hub found machine # [ 2.138768] hub 1-0:1.0: 6 ports detected machine # [ 2.140406] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.141241] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 machine # [ 2.142342] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.143180] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.144222] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.145886] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.147338] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.147381] usb usb2: Product: UHCI Host Controller machine # [ 2.149260] usb usb2: Manufacturer: Linux 6.18.60 uhci_hcd machine # [ 2.150829] usb usb2: SerialNumber: 0000:00:1d.0 machine # [ 2.152262] hub 2-0:1.0: USB hub found machine # [ 2.152898] hub 2-0:1.0: 2 ports detected machine # [ 2.155403] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.156317] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.158007] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.160071] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.162102] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.163797] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.165284] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.165813] SCSI subsystem initialized machine # [ 2.166354] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.168037] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.169392] usb usb3: Product: UHCI Host Controller machine # [ 2.170226] usb usb3: Manufacturer: Linux 6.18.60 uhci_hcd machine # [ 2.171221] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.172545] hub 3-0:1.0: USB hub found machine # [ 2.174367] hub 3-0:1.0: 2 ports detected machine # [ 2.177887] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.178757] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.180120] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.181075] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.182169] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.183461] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.184592] usb usb4: Product: UHCI Host Controller machine # [ 2.185386] usb usb4: Manufacturer: Linux 6.18.60 uhci_hcd machine # [ 2.186237] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.187848] hub 4-0:1.0: USB hub found machine # [ 2.188493] hub 4-0:1.0: 2 ports detected machine # [ 2.043115] (udev-worker)[119]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.048754] (udev-worker)[113]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.050968] (udev-worker)[113]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.052495] systemd[1]: Starting Virtual Console Setup... machine # [ 2.228318] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.228706] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.078806] systemd-vconsole-[ 2.231016] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # setup[142]: Configuration of first virtual console was [ 2.232202] ahci 0000:00:1f.2: flags: 64bit ncq only machine # skipped, ignoring remaining ones. machine # [ 2.082420] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.083759] systemd[1]: Reached target Initrd Root Device. machine # [ 2.084841] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.085956] systemd[1]: Finished Virtual Console Setup. machine # [ 2.238928] scsi host0: ahci machine # [ 2.240184] scsi host1: ahci machine # [ 2.241018] scsi host2: ahci machine # [ 2.242117] scsi host3: ahci machine # [ 2.243562] scsi host4: ahci machine # [ 2.244704] scsi host5: ahci machine # [ 2.245517] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.247068] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.248293] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.249466] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.249473] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.252058] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.109279] systemd-fsck[170]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.123591] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.376918] usb 1-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.508477] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.511546] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.514285] usb 1-1: Product: QEMU USB Tablet machine # [ 2.515943] usb 1-1: Manufacturer: QEMU machine # [ 2.517448] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.554384] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.576420] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.578711] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.581044] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.583512] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.585845] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.588202] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.590363] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.592435] ata3.00: applying bridge limits machine # [ 2.594336] ata3.00: configured for UDMA/100 machine # [ 2.596896] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.630317] usbcore: registered new interface driver usbhid machine # [ 2.632464] usbhid: USB HID core driver machine # [ 2.642701] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.646930] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.693265] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.723081] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.753927] systemd[1]: Mounting /sysroot... machine # [ 3.047269] EXT4-fs (vda): mounted filesystem 43c06cc1-24c9-4739-9ed5-7a9b6a101f7b r/w with ordered data mode. Quota mode: none. machine # [ 2.901601] systemd[1]: Mounted /sysroot. machine # [ 2.903540] systemd[1]: Reached target Initrd Root File System. machine # [ 2.905746] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 2.907886] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 2.909923] systemd[1]: Mounting /sysroot/run... machine # [ 2.911752] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 2.918932] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 2.925321] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 2.931071] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 2.933346] systemd-sysroot-fstab-check[191]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 2.936149] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 2.937594] systemd[1]: Mounted /sysroot/run. machine # [ 2.938924] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 2.940609] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 2.942414] systemd[1]: Reload requested from client PID 191 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 2.945446] systemd[1]: Reloading... machine # [ 2.988564] systemd[1]: Reloading finished in 49 ms. machine # [ 3.010080] systemd-sysroot-fstab-check[191]: Requesting initrd-fs.target/start/replace... machine # [ 3.012877] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.014671] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.017222] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.019224] systemd-sysroot-fstab-check[191]: Requesting swap.target/start/replace... machine # [ 3.021707] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.023926] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.026138] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.028636] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.036760] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.038984] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.754990] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.806489] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.808406] systemd[1]: Reached target Initrd File Systems. machine # [ 3.810276] systemd[1]: Starting Find NixOS closure... machine # [ 3.812343] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.840182] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.843079] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.854645] systemd[1]: Finished Find NixOS closure. machine # [ 3.856469] systemd[1]: Reached target Initrd Default Target. machine # [ 3.858667] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.898751] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.900929] systemd[1]: Stopped target Basic System. machine # [ 3.903359] systemd[1]: Stopped target Initrd Root Device. machine # [ 3.905385] systemd[1]: Stopped target Path Units. machine # [ 3.907221] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 3.909839] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 3.913362] systemd[1]: Stopped target Slice Units. machine # [ 3.915298] systemd[1]: Stopped target Socket Units. machine # [ 3.917875] systemd[1]: Stopped target System Initialization. machine # [ 3.920385] systemd[1]: Stopped target Swaps. machine # [ 3.922175] systemd[1]: Stopped target Timer Units. machine # [ 3.924104] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 3.926304] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 3.928474] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 3.931210] systemd[1]: Stopped Find NixOS closure. machine # [ 3.933101] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.935350] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 3.937430] systemd[1]: Stopped Apply Kernel Variables. machine # [ 3.938925] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 3.940893] systemd[1]: Stopped Load Kernel Modules. machine # [ 3.942400] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 3.944508] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 3.946603] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 3.948603] systemd[1]: Stopped Create System Files and Directories. machine # [ 3.950439] systemd[1]: Stopped target Local File Systems. machine # [ 3.952234] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 3.954140] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 3.956153] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 3.957089] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 3.958256] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 3.959338] systemd[1]: Stopped Virtual Console Setup. machine # [ 3.960095] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 3.961130] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 3.962171] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.963220] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.964112] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 3.965092] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 3.966179] systemd[1]: systemd-udevd-varlink.socket: Deactivated successfully. machine # [ 3.967307] systemd[1]: Closed udev Varlink Socket. machine # [ 3.968077] systemd[1]: Starting Cleanup udev Database... machine # [ 3.968909] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 3.970058] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 3.970989] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 3.972191] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 3.973241] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 3.974283] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 3.975231] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 3.976372] systemd[1]: Finished Cleanup udev Database. machine # [ 3.977184] systemd[1]: Reached target Switch Root. machine # [ 3.977935] systemd[1]: Starting NixOS Activation... machine # [ 4.127928] initrd-nixos-activation-start[237]: booting system configuration /nix/store/9daqi1a4xzhapk8xd94wx0w9ha2ad2s4-nixos-system-machine-test machine # [ 4.185125] initrd-nixos-activation-start[237]: running activation script... machine # [ 4.516306] initrd-nixos-activation-start[260]: setting up /etc... machine # [ 4.679699] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.682444] systemd[1]: Finished NixOS Activation. machine # [ 4.684272] systemd[1]: Starting Switch Root... machine # [ 4.706294] systemd[1]: Switching root. machine # [ 4.922338] systemd-journald[88]: Received SIGTERM from PID 1 (systemd). machine # [ 5.016087] NET: Registered PF_VSOCK protocol family machine # [ 5.396909] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.406830] systemd[1]: Detected virtualization kvm. machine # [ 5.408694] systemd[1]: Detected architecture x86-64. machine # [ 5.410682] systemd[1]: Detected first boot. machine # [ 5.414893] systemd[1]: Initializing machine ID from random generator. machine # [ 5.983020] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 6.077200] systemd[1]: Applying preset policy. machine # [ 6.286401] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.533971] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.535508] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.537613] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.540048] systemd[1]: Created slice Slice /system/getty. machine # [ 6.541586] systemd[1]: Created slice User and Session Slice. machine # [ 6.542583] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.543960] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.545204] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.546001] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.546860] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.547688] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.548536] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.549381] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.550421] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.551444] systemd[1]: Reached target Path Units. machine # [ 6.552282] systemd[1]: Reached target Remote File Systems. machine # [ 6.553154] systemd[1]: Reached target Slice Units. machine # [ 6.553955] systemd[1]: Reached target Swaps. machine # [ 6.555888] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.558545] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.560416] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.562360] systemd[1]: Listening on Factory Reset Management. machine # [ 6.563322] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.566268] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.567646] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.569740] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.571064] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.572355] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.573805] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.578177] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.579350] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.582295] systemd[1]: Mounting Huge Pages File System... machine # [ 6.584638] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.587137] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.589731] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.607569] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.610165] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.611107] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.612855] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.614666] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.618064] systemd[1]: Mounting FUSE Control File System... machine # [ 6.619039] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.636137] systemd[1]: Starting Journal Service... machine # [ 6.639072] systemd[1]: Starting Load Kernel Modules... machine # [ 6.643346] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.646513] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.647592] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.651226] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.655516] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.656754] systemd[1]: Mounted Huge Pages File System. machine # [ 6.658209] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.659326] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.660375] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.661821] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.663015] systemd[1]: Mounted FUSE Control File System. machine # [ 6.666091] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.688069] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.689615] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.692346] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.694180] EXT4-fs (vda): re-mounted 43c06cc1-24c9-4739-9ed5-7a9b6a101f7b. machine # [ 6.695350] systemd-journald[333]: Collecting audit messages is enabled. machine # [ 6.701368] loop: module loaded machine # [ 6.710777] systemd[1]: Finished Load Kernel Modules. machine # [ 6.712478] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.562466] systemd[1]: Queued start job for default target Multi-User System. machine # [ 6.714322] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.564114] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.716311] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.565701] systemd-modules-load[334]: Using 2 probe threads machine # [ 6.567854] systemd-modules-load[334]: Inserted module 'loop' machine # [ 6.569179] systemd-oomd[335]: 6.720942] systemd[1]: Starting Load/Save OS Random Seed... machine # ;38:5:185mNo swap; memory pressure usage will be degraded machine # [ 6.723983] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.724817] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.726440] systemd[1]: Started Journal Service. machine # [ 6.576596] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.577764] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.583665] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.585666] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.588092] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.755607] systemd-journald[333]: Received client request to flush runtime journal. machine # [ 6.663236] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.664510] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.666581] systemd[1]: Reached target First Boot Complete. machine # [ 6.667404] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.668259] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.669187] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.670179] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.672838] systemd-udevd[363]: Using default interface naming scheme 'v261'. machine # [ 6.681366] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.706571] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.775735] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.787870] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.797898] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.803879] (udev-worker)[389]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.809278] (udev-worker)[368]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.811361] (udev-worker)[368]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.832936] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.834210] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.835840] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.838253] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.840036] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.841423] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.996388] input: Power Button as /devices/platform/LNXPWRBN:00/input/input3 machine # [ 7.014687] ACPI: button: Power Button [PWRF] machine # [ 7.031022] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 7.031229] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 7.048347] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 7.048609] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 7.048690] rtc_cmos PNP0B00:00: setting system clock to 2026-11-12T13:14:37 UTC (1794489277) machine # [ 7.048799] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 7.050949] Console: switching to colour dummy device 80x25 machine # [ 7.052580] systemd-journald[333]: Time jumped backwards, rotating. machine # [ 7.053282] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 7.056584] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 7.060079] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 7.060086] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 7.061061] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 7.061776] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 7.063941] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 7.069883] mousedev: PS/2 mouse device common for all mice machine # [ 7.095630] Console: switching to colour frame buffer device 160x50 machine # [ 7.097995] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 7.116430] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 7.118861] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 7.000769] systemd[1]: Starting Virtual Console Setup... machine # [ 7.184819] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 7.190365] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 7.199552] ppdev: user-space parallel port driver machine # [ 7.048346] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 7.050477] systemd[1]: Stopped Virtual Console Setup. machine # [ 7.051577] systemd[1]: Starting Virtual Console Setup... machine # [ 7.213574] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 7.216383] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 7.229690] kvm_amd: TSC scaling supported machine # [ 7.230349] kvm_amd: Nested Virtualization enabled machine # [ 7.230894] kvm_amd: Nested Paging enabled machine # [ 7.231378] kvm_amd: LBR virtualization supported machine # [ 7.232034] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 7.232582] kvm_amd: Virtual GIF supported machine # [ 7.233188] kvm_amd: Virtual NMI enabled machine # [ 7.303531] EDAC MC: Ver: 3.0.0 machine # [ 7.215320] systemd-vconsole-setup[407]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 7.219713] systemd[1]: Finished Virtual Console Setup. machine # [ 7.387412] systemd[1]: Mounting /run/wrappers... machine # [ 7.426619] systemd[1]: Mounted /run/wrappers. machine # [ 7.428578] systemd[1]: Reached target Local File Systems. machine # [ 7.430697] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.433090] systemd[1]: Starting register-nix-paths.service... machine # [ 7.435297] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.437381] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.440461] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.442808] systemd[1]: Starting Create System Files and Directories... machine # [ 7.530442] systemd[1]: Finished Create System Files and Directories. machine # [ 7.536601] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.538692] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.562805] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.571589] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.573961] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.579390] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.581959] systemd[1]: Starting Update is Completed... machine # [ 7.611389] systemd[1]: Finished Update is Completed. machine # [ 7.737954] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.739152] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.979758] systemd[1]: Finished register-nix-paths.service. machine # [ 7.981064] systemd[1]: Reached target System Initialization. machine # [ 7.982378] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.983717] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.984847] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.986153] systemd[1]: Reached target Timer Units. machine # [ 7.987205] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.993515] systemd[1]: Listening on niks3 server socket. machine # [ 7.994518] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.995391] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.996650] systemd[1]: Reached target Socket Units. machine # [ 7.997499] systemd[1]: Reached target Basic System. machine # [ 7.998255] systemd[1]: Started backdoor.service. machine # [ 8.001427] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 8.005136] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.014659] systemd[1]: Starting Post-Boot Actions... machine # [ 8.017388] systemd[1]: Started Reset console on configuration changes. machine # [ 8.022579] systemd[1]: Starting resolvconf update... machine # [ 8.029351] systemd[1]: Starting D-Bus System Message Bus... machine # [ 8.056271] systemd[1]: Finished Post-Boot Actions. machine # [ 8.062613] nsncd[490]: Nov 12 13:14:38.665 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.064860] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.065901] systemd[1]: Reached target Host and Network Name Lookups. machine # connecting to host... machine # [ 8.067626] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.068818] systemd[1]: Starting User Login Management... machine # [ 8.082802] systemd[1]: Finished Import lastlog data into lastlog2 database. [9.08s] machine: Guest shell says: b'Spawning backdoor root shell...\n' [9.09s] machine: connected to guest root shell [9.09s] machine: (connecting took 8.74 seconds) machine # [ 8.094233] dbus-broker-launch[495]: Looking up NSS user entry for 'systemd-timesync'... [9.09s] machine: (finished: waiting for the VM to finish booting, in 9.08 seconds) machine # [ 8.095916] dbus-broker-launch[495]: NSS returned no entry for 'systemd-timesync' machine # [ 8.096914] dbus-broker-launch[495]: Invalid user-name in /nix/store/899z35c8qqf7nfj3phc78yqngg57w76b-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 8.108372] systemd[1]: Started D-Bus System Message Bus. machine # [ 8.112697] systemd-logind[513]: New seat seat0. machine # [ 8.114747] systemd-logind[513]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 8.115733] systemd-logind[513]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 8.116958] systemd-logind[513]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 8.118340] dbus-broker-launch[495]: Ready machine # [ 8.119654] systemd[1]: Started User Login Management. machine # [ 8.122443] systemd[1]: Starting linger-users.service... machine # [ 8.128697] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 8.129024] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 8.129639] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 8.130230] systemd[1]: Stopping User and Group Name Lookups... machine # [ 8.130746] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 8.134187] systemd[1]: nscd.service: Deactivated successfully. machine # [ 8.135430] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 8.139130] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.150953] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 8.152079] systemd[1]: Finished linger-users.service. machine # [ 8.164195] nsncd[570]: Nov 12 13:14:38.766 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.166509] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.166868] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.167508] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.168067] systemd[1]: Finished resolvconf update. machine # [ 8.168579] systemd[1]: Reached target Preparation for Network. machine # [ 8.170843] systemd[1]: Starting DHCP Client... machine # [ 8.172419] systemd[1]: Starting Address configuration of eth1... machine # [ 8.174175] systemd[1]: Starting Extra networking commands.... machine # [ 8.218873] network-addresses-eth1-start[599]: adding address 192.168.1.1/24... done machine # [ 8.225050] network-addresses-eth1-start[599]: adding address 2001:db8:1::1/64... done machine # [ 8.237066] systemd[1]: Finished Address configuration of eth1. machine # [ 8.252446] dhcpcd[607]: dhcpcd-10.3.2 starting machine # [ 8.254880] dhcpcd[661]: dev: loaded udev machine # [ 8.261656] systemd[1]: Finished Extra networking commands.. machine # [ 8.262233] systemd[1]: Reached target Network. machine # [ 8.416202] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.264513] systemd[1]: Starting PostgreSQL Server... machine # [ 8.265763] systemd[1]: Starting Permit User Sessions... machine # [ 8.418186] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 8.280678] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.291559] systemd[1]: Finished Permit User Sessions. machine # [ 8.295508] systemd[1]: Started Getty on tty1. machine # [ 8.295985] systemd[1]: Reached target Login Prompts. machine # [ 8.511680] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.512970] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.513787] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.515282] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.516342] cfg80211: failed to load regulatory.db machine # [ 8.545444] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.395429] dhcpcd[661]: eth0: waiting for carrier machine # [ 8.395613] dhcpcd[661]: eth0: carrier acquired machine # [ 8.401316] dhcpcd[661]: DUID 00:01:00:01:32:88:78:3f:52:54:00:12:34:56 machine # [ 8.401686] dhcpcd[661]: eth0: IAID 00:12:34:56 machine # [ 8.402229] dhcpcd[661]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.406883] postgresql-pre-start[675]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.407227] postgresql-pre-start[675]: This user must also own the server process. machine # [ 8.411173] postgresql-pre-start[675]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.411474] postgresql-pre-start[675]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.411980] postgresql-pre-start[675]: The default text search configuration will be set to "english". machine # [ 8.412697] postgresql-pre-start[675]: Data page checksums are enabled. machine # [ 8.413278] postgresql-pre-start[675]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.417593] postgresql-pre-start[675]: creating subdirectories ... ok machine # [ 8.418545] postgresql-pre-start[675]: selecting dynamic shared memory implementation ... posix machine # [ 8.468887] postgresql-pre-start[675]: selecting default "max_connections" ... 100 machine # [ 8.515517] postgresql-pre-start[675]: selecting default "shared_buffers" ... 128MB machine # [ 9.193487] dhcpcd[661]: eth0: soliciting a DHCP lease machine # [ 9.362885] NET: Registered PF_PACKET protocol family machine # [ 9.222673] dhcpcd[661]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 9.228205] postgresql-pre-start[675]: selecting default time zone ... UTC machine # [ 9.230180] dhcpcd[661]: eth0: probing address 10.0.2.15/24 machine # [ 9.230528] postgresql-pre-start[675]: creating configuration files ... ok machine # [ 9.394929] postgresql-pre-start[675]: running bootstrap script ... ok machine # [ 9.886553] postgresql-pre-start[675]: performing post-bootstrap initialization ... ok machine # [ 10.093342] postgresql-pre-start[675]: syncing data to disk ... ok machine # [ 10.093535] postgresql-pre-start[675]: initdb: warning: enabling "trust" authentication for local connections machine # [ 10.093633] postgresql-pre-start[675]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 10.094830] postgresql-pre-start[675]: Success. You can now start the database server using: machine # [ 10.095802] postgresql-pre-start[675]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 10.231221] postgres[707]: [707] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 10.235938] postgres[707]: [707] LOG: listening on IPv6 address "::1", port 5432 machine # [ 10.237131] postgres[707]: [707] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 10.238845] postgres[707]: [707] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 10.252578] postgres[716]: [716] LOG: database system was shut down at 2026-11-12 13:14:40 GMT machine # [ 10.261991] postgres[707]: [707] LOG: database system is ready to accept connections machine # [ 10.267179] systemd[1]: Started PostgreSQL Server. machine # [ 10.270601] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.454747] dhcpcd[661]: eth0: soliciting an IPv6 router machine # [ 10.457171] dhcpcd[661]: eth0: Router Advertisement from fe80::2 machine # [ 10.459489] dhcpcd[661]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 10.461742] dhcpcd[661]: eth0: adding route to fec0::/64 machine # [ 10.463744] dhcpcd[661]: eth0: adding default route via fe80::2 machine # [ 10.489450] postgresql-setup-start[736]: CREATE DATABASE machine # [ 10.529160] postgresql-setup-start[741]: CREATE ROLE machine # [ 10.552391] postgresql-setup-start[743]: ALTER DATABASE machine # [ 10.558809] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.560076] systemd[1]: Reached target PostgreSQL. machine # [ 14.386633] dhcpcd[661]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 14.387111] dhcpcd[661]: eth0: adding route to 10.0.2.0/24 machine # [ 14.388147] dhcpcd[661]: eth0: adding default route via 10.0.2.2 machine # [ 14.525430] systemd[1]: Started DHCP Client. machine # [ 14.527682] systemd[1]: Reached target Network is Online. machine # [ 14.531334] systemd[1]: Started Garage Object Storage (S3 compatible). machine # [ 14.534696] systemd[1]: Starting garage-setup.service... machine # [ 14.538564] systemd[1]: Starting k3s service... machine # [ 14.603829] k3s[836]: time="2026-11-12T13:14:45Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 14.605408] k3s[836]: time="2026-11-12T13:14:45Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/ef9dbb5dcf676c7d5ff5dff91f390634affa84336a5b10858a766dea1eaa5ed9" machine # [ 14.607728] garage[834]: 2026-11-12T13:14:45.209360Z INFO garage::server: Loading configuration... machine # [ 14.609437] garage[834]: 2026-11-12T13:14:45.211802Z INFO garage::server: Initializing Garage main data store... machine # [ 14.611401] garage-setup-start[848]: Error: Unable to read node key. It will be generated by your garage node the first time is it launched. Ensure that your garage node is currently running. (The node key is supposed to be stored in your metadata directory.) machine # [ 14.614419] garage-setup-start[848]: IO error: No such file or directory (os error 2) machine # [ 14.615598] garage[834]: 2026-11-12T13:14:45.212486Z INFO garage_model::garage: Opening database... machine # [ 14.617229] garage[834]: 2026-11-12T13:14:45.212595Z INFO garage_db::lmdb_adapter: Opening LMDB database at: /var/lib/garage/meta/db.lmdb machine # [ 14.619202] garage[834]: 2026-11-12T13:14:45.214360Z INFO garage_model::garage: Initializing RPC... machine # [ 14.620817] garage[834]: 2026-11-12T13:14:45.214404Z WARN garage_rpc::replication_mode: Legacy config option replication_mode in use. Please migrate to replication_factor and consistency_mode machine # [ 14.623502] garage[834]: 2026-11-12T13:14:45.214828Z INFO garage_model::garage: Initialize background variable system... machine # [ 14.625814] garage[834]: 2026-11-12T13:14:45.214972Z INFO garage_model::garage: Initialize membership management system... machine # [ 14.627726] garage[834]: 2026-11-12T13:14:45.215021Z INFO garage_rpc::system: Generating new node key pair. machine # [ 14.629472] garage[834]: 2026-11-12T13:14:45.215410Z INFO garage_rpc::system: Node ID of this node: 7c0c1a2ca90d6317 machine # [ 14.631309] garage[834]: 2026-11-12T13:14:45.215725Z WARN garage_rpc::system: Using autodetected rpc_public_addr: 10.0.2.15:3901. Consider specifying it explicitly in configuration file if possible. machine # [ 14.633963] garage[834]: 2026-11-12T13:14:45.215841Z INFO garage_rpc::layout::manager: No valid previous cluster layout stored (IO error: No such file or directory (os error 2)), starting fresh. machine # [ 14.636623] garage[834]: 2026-11-12T13:14:45.217399Z INFO garage_rpc::layout::helper: ack_until updated to 0 machine # [ 14.638396] garage[834]: 2026-11-12T13:14:45.217836Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.640398] garage[834]: 2026-11-12T13:14:45.217857Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.642386] garage[834]: 2026-11-12T13:14:45.217868Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.644452] garage[834]: 2026-11-12T13:14:45.217880Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.646447] garage[834]: 2026-11-12T13:14:45.217892Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.648442] garage[834]: 2026-11-12T13:14:45.217904Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.650421] garage[834]: 2026-11-12T13:14:45.217916Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.652398] garage[834]: 2026-11-12T13:14:45.217927Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.654359] garage[834]: 2026-11-12T13:14:45.218000Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.656343] garage[834]: 2026-11-12T13:14:45.218011Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.658302] garage[834]: 2026-11-12T13:14:45.218023Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.660294] garage[834]: 2026-11-12T13:14:45.218078Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.662303] garage[834]: 2026-11-12T13:14:45.218089Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.664288] garage[834]: 2026-11-12T13:14:45.218101Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.666378] garage[834]: 2026-11-12T13:14:45.218112Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.668425] garage[834]: 2026-11-12T13:14:45.218123Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.670486] garage[834]: 2026-11-12T13:14:45.218158Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.672690] garage[834]: 2026-11-12T13:14:45.218218Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.674810] garage[834]: 2026-11-12T13:14:45.218229Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.676961] garage[834]: 2026-11-12T13:14:45.218241Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.679165] garage[834]: 2026-11-12T13:14:45.218251Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.681412] garage[834]: 2026-11-12T13:14:45.218263Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.683409] garage[834]: 2026-11-12T13:14:45.218284Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.685424] garage[834]: 2026-11-12T13:14:45.218296Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.687420] garage[834]: 2026-11-12T13:14:45.218307Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.689400] garage[834]: 2026-11-12T13:14:45.218318Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.691377] garage[834]: 2026-11-12T13:14:45.218330Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.693396] garage[834]: 2026-11-12T13:14:45.218409Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.695379] garage[834]: 2026-11-12T13:14:45.218421Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.697317] garage[834]: 2026-11-12T13:14:45.218432Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.699308] garage[834]: 2026-11-12T13:14:45.218442Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.701412] garage[834]: 2026-11-12T13:14:45.218454Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.703516] garage[834]: 2026-11-12T13:14:45.218465Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.705499] garage[834]: 2026-11-12T13:14:45.218480Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.707468] garage[834]: 2026-11-12T13:14:45.218491Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.709452] garage[834]: 2026-11-12T13:14:45.218502Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.711444] garage[834]: 2026-11-12T13:14:45.218513Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.713455] garage[834]: 2026-11-12T13:14:45.218524Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.715464] garage[834]: 2026-11-12T13:14:45.218535Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.717456] garage[834]: 2026-11-12T13:14:45.218611Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.719451] garage[834]: 2026-11-12T13:14:45.218622Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.721456] garage[834]: 2026-11-12T13:14:45.218632Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.723451] garage[834]: 2026-11-12T13:14:45.218643Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.725443] garage[834]: 2026-11-12T13:14:45.218655Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.727465] garage[834]: 2026-11-12T13:14:45.218666Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.729492] garage[834]: 2026-11-12T13:14:45.218677Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.731453] garage[834]: 2026-11-12T13:14:45.218688Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.733434] garage[834]: 2026-11-12T13:14:45.218699Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.735621] garage[834]: 2026-11-12T13:14:45.218710Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.736088] garage[834]: 2026-11-12T13:14:45.218726Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.736604] garage[834]: 2026-11-12T13:14:45.218894Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.737181] garage[834]: 2026-11-12T13:14:45.218908Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.737663] garage[834]: 2026-11-12T13:14:45.218919Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.738224] garage[834]: 2026-11-12T13:14:45.218930Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.738732] garage[834]: 2026-11-12T13:14:45.219004Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.739460] garage[834]: 2026-11-12T13:14:45.219016Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.739956] garage[834]: 2026-11-12T13:14:45.219067Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.740686] garage[834]: 2026-11-12T13:14:45.219079Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.741207] garage[834]: 2026-11-12T13:14:45.219090Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.741810] garage[834]: 2026-11-12T13:14:45.219102Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.742311] garage[834]: 2026-11-12T13:14:45.219113Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.742833] garage[834]: 2026-11-12T13:14:45.219124Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.743539] garage[834]: 2026-11-12T13:14:45.219135Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.744072] garage[834]: 2026-11-12T13:14:45.219217Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.744597] garage[834]: 2026-11-12T13:14:45.219228Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.745114] garage[834]: 2026-11-12T13:14:45.219243Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.745632] garage[834]: 2026-11-12T13:14:45.219254Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.746181] garage[834]: 2026-11-12T13:14:45.219265Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.746714] garage[834]: 2026-11-12T13:14:45.219284Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.747232] garage[834]: 2026-11-12T13:14:45.219296Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.747773] garage[834]: 2026-11-12T13:14:45.219307Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.748515] garage[834]: 2026-11-12T13:14:45.219319Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.749022] garage[834]: 2026-11-12T13:14:45.219329Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.749582] garage[834]: 2026-11-12T13:14:45.219343Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.750086] garage[834]: 2026-11-12T13:14:45.219418Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.750609] garage[834]: 2026-11-12T13:14:45.219429Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.751106] garage[834]: 2026-11-12T13:14:45.219441Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.751606] garage[834]: 2026-11-12T13:14:45.219452Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.752134] garage[834]: 2026-11-12T13:14:45.219463Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.752684] garage[834]: 2026-11-12T13:14:45.219474Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.753209] garage[834]: 2026-11-12T13:14:45.219486Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.753766] garage[834]: 2026-11-12T13:14:45.219502Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.798184] garage[834]: 2026-11-12T13:14:45.219513Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.798444] garage[834]: 2026-11-12T13:14:45.219524Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.798960] garage[834]: 2026-11-12T13:14:45.219536Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.799698] garage[834]: 2026-11-12T13:14:45.219548Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.800693] garage[834]: 2026-11-12T13:14:45.219595Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.801167] garage[834]: 2026-11-12T13:14:45.219600Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.801848] garage[834]: 2026-11-12T13:14:45.219606Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.802549] garage[834]: 2026-11-12T13:14:45.219612Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.803084] garage[834]: 2026-11-12T13:14:45.219618Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.803619] garage[834]: 2026-11-12T13:14:45.219624Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.804150] garage[834]: 2026-11-12T13:14:45.219630Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.804660] garage[834]: 2026-11-12T13:14:45.219636Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.805201] garage[834]: 2026-11-12T13:14:45.219642Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.805750] garage[834]: 2026-11-12T13:14:45.219647Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.806447] garage[834]: 2026-11-12T13:14:45.219653Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.806983] garage[834]: 2026-11-12T13:14:45.219662Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.807716] garage[834]: 2026-11-12T13:14:45.219668Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.808412] garage[834]: 2026-11-12T13:14:45.219674Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.808956] garage[834]: 2026-11-12T13:14:45.219680Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.809691] garage[834]: 2026-11-12T13:14:45.219685Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.810165] garage[834]: 2026-11-12T13:14:45.219691Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.810752] garage[834]: 2026-11-12T13:14:45.219697Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.811423] garage[834]: 2026-11-12T13:14:45.219703Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.811988] garage[834]: 2026-11-12T13:14:45.219708Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.812645] garage[834]: 2026-11-12T13:14:45.219714Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.813176] garage[834]: 2026-11-12T13:14:45.219720Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.813721] garage[834]: 2026-11-12T13:14:45.219726Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.814405] garage[834]: 2026-11-12T13:14:45.219731Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.814917] garage[834]: 2026-11-12T13:14:45.219773Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.815602] garage[834]: 2026-11-12T13:14:45.219779Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.816134] garage[834]: 2026-11-12T13:14:45.219785Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.816489] garage[834]: 2026-11-12T13:14:45.219793Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.816989] garage[834]: 2026-11-12T13:14:45.219799Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.817730] garage[834]: 2026-11-12T13:14:45.219805Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.818421] garage[834]: 2026-11-12T13:14:45.219811Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.819642] garage[834]: 2026-11-12T13:14:45.219817Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.821590] garage[834]: 2026-11-12T13:14:45.219823Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.823729] garage[834]: 2026-11-12T13:14:45.219828Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.825473] garage[834]: 2026-11-12T13:14:45.219834Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.868302] garage[834]: 2026-11-12T13:14:45.219840Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.868945] garage[834]: 2026-11-12T13:14:45.219846Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.869654] garage[834]: 2026-11-12T13:14:45.219851Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.870178] garage[834]: 2026-11-12T13:14:45.219857Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.870715] garage[834]: 2026-11-12T13:14:45.219863Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.871418] garage[834]: 2026-11-12T13:14:45.219869Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.872140] garage[834]: 2026-11-12T13:14:45.219875Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.872643] garage[834]: 2026-11-12T13:14:45.219881Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.873209] garage[834]: 2026-11-12T13:14:45.219888Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.873700] garage[834]: 2026-11-12T13:14:45.219895Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.874415] garage[834]: 2026-11-12T13:14:45.219900Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.874930] garage[834]: 2026-11-12T13:14:45.219906Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.875683] garage[834]: 2026-11-12T13:14:45.219944Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.876215] garage[834]: 2026-11-12T13:14:45.219950Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.876752] garage[834]: 2026-11-12T13:14:45.219956Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.877456] garage[834]: 2026-11-12T13:14:45.219962Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.878020] garage[834]: 2026-11-12T13:14:45.219967Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.878527] garage[834]: 2026-11-12T13:14:45.219973Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.879057] garage[834]: 2026-11-12T13:14:45.219980Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.879578] garage[834]: 2026-11-12T13:14:45.219985Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.880103] garage[834]: 2026-11-12T13:14:45.219992Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.880611] garage[834]: 2026-11-12T13:14:45.219997Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.881140] garage[834]: 2026-11-12T13:14:45.220003Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.881589] garage[834]: 2026-11-12T13:14:45.220009Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.882115] garage[834]: 2026-11-12T13:14:45.220022Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.882809] garage[834]: 2026-11-12T13:14:45.220028Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.883502] garage[834]: 2026-11-12T13:14:45.220054Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.884034] garage[834]: 2026-11-12T13:14:45.220059Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.884560] garage[834]: 2026-11-12T13:14:45.220065Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.885103] garage[834]: 2026-11-12T13:14:45.220071Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.885682] garage[834]: 2026-11-12T13:14:45.220077Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.886167] garage[834]: 2026-11-12T13:14:45.220083Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.886748] garage[834]: 2026-11-12T13:14:45.220101Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.887969] garage[834]: 2026-11-12T13:14:45.220130Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.890474] garage[834]: 2026-11-12T13:14:45.220135Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.891997] garage[834]: 2026-11-12T13:14:45.220141Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.893944] garage[834]: 2026-11-12T13:14:45.220147Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.895852] garage[834]: 2026-11-12T13:14:45.220152Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.897616] garage[834]: 2026-11-12T13:14:45.220158Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.899583] garage[834]: 2026-11-12T13:14:45.220164Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.901514] garage[834]: 2026-11-12T13:14:45.220174Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.903271] garage[834]: 2026-11-12T13:14:45.220181Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.905235] garage[834]: 2026-11-12T13:14:45.220187Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.947126] garage[834]: 2026-11-12T13:14:45.220193Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.947779] garage[834]: 2026-11-12T13:14:45.220199Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.948481] garage[834]: 2026-11-12T13:14:45.220204Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.948982] garage[834]: 2026-11-12T13:14:45.220210Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.949723] garage[834]: 2026-11-12T13:14:45.220215Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.950443] garage[834]: 2026-11-12T13:14:45.220221Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.950923] garage[834]: 2026-11-12T13:14:45.220227Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.951741] garage[834]: 2026-11-12T13:14:45.220233Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.952139] garage[834]: 2026-11-12T13:14:45.220238Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.952624] garage[834]: 2026-11-12T13:14:45.220244Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.953175] garage[834]: 2026-11-12T13:14:45.220249Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.953733] garage[834]: 2026-11-12T13:14:45.220255Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.954411] garage[834]: 2026-11-12T13:14:45.220261Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.954930] garage[834]: 2026-11-12T13:14:45.220314Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.955659] garage[834]: 2026-11-12T13:14:45.220321Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.956185] garage[834]: 2026-11-12T13:14:45.220327Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.956731] garage[834]: 2026-11-12T13:14:45.220333Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.957430] garage[834]: 2026-11-12T13:14:45.220339Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.957942] garage[834]: 2026-11-12T13:14:45.220344Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.958633] garage[834]: 2026-11-12T13:14:45.220350Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.959157] garage[834]: 2026-11-12T13:14:45.220356Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.959715] garage[834]: 2026-11-12T13:14:45.220362Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.960201] garage[834]: 2026-11-12T13:14:45.220368Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.960739] garage[834]: 2026-11-12T13:14:45.220373Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.961462] garage[834]: 2026-11-12T13:14:45.220380Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.961958] garage[834]: 2026-11-12T13:14:45.220385Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.962327] garage[834]: 2026-11-12T13:14:45.220391Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.962863] garage[834]: 2026-11-12T13:14:45.220397Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.963414] garage[834]: 2026-11-12T13:14:45.220403Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.963857] garage[834]: 2026-11-12T13:14:45.220413Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.964494] garage[834]: 2026-11-12T13:14:45.220419Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 14.964935] garage[834]: 2026-11-12T13:14:45.220424Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.006687] garage[834]: 2026-11-12T13:14:45.220430Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.007514] garage[834]: 2026-11-12T13:14:45.220436Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.008076] garage[834]: 2026-11-12T13:14:45.220441Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.008652] garage[834]: 2026-11-12T13:14:45.220448Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.009130] garage[834]: 2026-11-12T13:14:45.220454Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.009482] garage[834]: 2026-11-12T13:14:45.220494Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.009984] garage[834]: 2026-11-12T13:14:45.220500Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.010688] garage[834]: 2026-11-12T13:14:45.220506Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.011442] garage[834]: 2026-11-12T13:14:45.220512Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.011986] garage[834]: 2026-11-12T13:14:45.220518Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.012674] garage[834]: 2026-11-12T13:14:45.220523Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.013186] garage[834]: 2026-11-12T13:14:45.220529Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.013700] garage[834]: 2026-11-12T13:14:45.220535Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.014424] garage[834]: 2026-11-12T13:14:45.220545Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.014946] garage[834]: 2026-11-12T13:14:45.220551Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.015702] garage[834]: 2026-11-12T13:14:45.220557Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.016225] garage[834]: 2026-11-12T13:14:45.220563Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.016771] garage[834]: 2026-11-12T13:14:45.220569Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.017469] garage[834]: 2026-11-12T13:14:45.220575Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.018019] garage[834]: 2026-11-12T13:14:45.220581Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.018537] garage[834]: 2026-11-12T13:14:45.220586Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.019092] garage[834]: 2026-11-12T13:14:45.220592Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.019599] garage[834]: 2026-11-12T13:14:45.220598Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.020117] garage[834]: 2026-11-12T13:14:45.220604Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.020655] garage[834]: 2026-11-12T13:14:45.220610Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.021179] garage[834]: 2026-11-12T13:14:45.220615Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.021699] garage[834]: 2026-11-12T13:14:45.220621Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.022420] garage[834]: 2026-11-12T13:14:45.220627Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.022924] garage[834]: 2026-11-12T13:14:45.220668Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.023630] garage[834]: 2026-11-12T13:14:45.220679Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.024128] garage[834]: 2026-11-12T13:14:45.220685Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.024691] garage[834]: 2026-11-12T13:14:45.220691Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.025176] garage[834]: 2026-11-12T13:14:45.220697Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.026080] garage[834]: 2026-11-12T13:14:45.220703Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.028052] garage[834]: 2026-11-12T13:14:45.220709Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.029995] garage[834]: 2026-11-12T13:14:45.220714Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.031747] garage[834]: 2026-11-12T13:14:45.220720Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.033621] garage[834]: 2026-11-12T13:14:45.220726Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.035728] garage[834]: 2026-11-12T13:14:45.220732Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.037892] garage[834]: 2026-11-12T13:14:45.220738Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.039439] garage[834]: 2026-11-12T13:14:45.220744Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.041172] garage[834]: 2026-11-12T13:14:45.220749Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.043112] garage[834]: 2026-11-12T13:14:45.220755Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.044874] garage[834]: 2026-11-12T13:14:45.220761Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.086832] garage[834]: 2026-11-12T13:14:45.220767Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.087704] garage[834]: 2026-11-12T13:14:45.220775Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.088182] garage[834]: 2026-11-12T13:14:45.220781Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.088881] garage[834]: 2026-11-12T13:14:45.220787Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.089634] garage[834]: 2026-11-12T13:14:45.220793Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.090503] garage[834]: 2026-11-12T13:14:45.220799Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.090982] garage[834]: 2026-11-12T13:14:45.220805Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.091707] garage[834]: 2026-11-12T13:14:45.220847Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.092221] garage[834]: 2026-11-12T13:14:45.220853Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.092764] garage[834]: 2026-11-12T13:14:45.220859Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.093309] garage[834]: 2026-11-12T13:14:45.220865Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.093844] garage[834]: 2026-11-12T13:14:45.220871Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.094552] garage[834]: 2026-11-12T13:14:45.220877Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.095100] garage[834]: 2026-11-12T13:14:45.220882Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.095626] garage[834]: 2026-11-12T13:14:45.220888Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.096182] garage[834]: 2026-11-12T13:14:45.220894Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.096705] garage[834]: 2026-11-12T13:14:45.220900Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.097228] garage[834]: 2026-11-12T13:14:45.220910Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.097760] garage[834]: 2026-11-12T13:14:45.220915Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.098477] garage[834]: 2026-11-12T13:14:45.220921Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.098980] garage[834]: 2026-11-12T13:14:45.220927Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.099693] garage[834]: 2026-11-12T13:14:45.220933Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.100441] garage[834]: 2026-11-12T13:14:45.220939Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.100973] garage[834]: 2026-11-12T13:14:45.220945Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.101708] garage[834]: 2026-11-12T13:14:45.220951Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.102217] garage[834]: 2026-11-12T13:14:45.220957Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.102805] garage[834]: 2026-11-12T13:14:45.220963Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.103345] garage[834]: 2026-11-12T13:14:45.220969Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.103869] garage[834]: 2026-11-12T13:14:45.220974Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.104637] garage[834]: 2026-11-12T13:14:45.220980Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.105145] garage[834]: 2026-11-12T13:14:45.220987Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.105639] garage[834]: 2026-11-12T13:14:45.221023Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.106175] garage[834]: 2026-11-12T13:14:45.221050Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.107761] garage[834]: 2026-11-12T13:14:45.221059Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.150157] garage[834]: 2026-11-12T13:14:45.221065Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.150801] garage[834]: 2026-11-12T13:14:45.221070Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.151342] garage[834]: 2026-11-12T13:14:45.221077Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.151849] garage[834]: 2026-11-12T13:14:45.221083Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.152562] garage[834]: 2026-11-12T13:14:45.221089Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.153119] garage[834]: 2026-11-12T13:14:45.221094Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.153252] garage[834]: 2026-11-12T13:14:45.221100Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.153624] garage[834]: 2026-11-12T13:14:45.221106Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.154212] garage[834]: 2026-11-12T13:14:45.221112Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.154449] garage[834]: 2026-11-12T13:14:45.221118Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.154928] garage[834]: 2026-11-12T13:14:45.221124Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.155630] garage[834]: 2026-11-12T13:14:45.221129Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.156148] garage[834]: 2026-11-12T13:14:45.221135Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.156662] garage[834]: 2026-11-12T13:14:45.221141Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.157177] garage[834]: 2026-11-12T13:14:45.221147Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.157694] garage[834]: 2026-11-12T13:14:45.221156Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.158408] garage[834]: 2026-11-12T13:14:45.221162Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.158895] garage[834]: 2026-11-12T13:14:45.221203Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.159613] garage[834]: 2026-11-12T13:14:45.221209Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.160156] garage[834]: 2026-11-12T13:14:45.221215Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.160716] garage[834]: 2026-11-12T13:14:45.221221Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.161425] garage[834]: 2026-11-12T13:14:45.221227Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.161940] garage[834]: 2026-11-12T13:14:45.221232Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.162686] garage[834]: 2026-11-12T13:14:45.221238Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.163148] garage[834]: 2026-11-12T13:14:45.221243Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.163698] garage[834]: 2026-11-12T13:14:45.221250Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.164249] garage[834]: 2026-11-12T13:14:45.221255Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.164750] garage[834]: 2026-11-12T13:14:45.221261Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.165458] garage[834]: 2026-11-12T13:14:45.221267Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.165964] garage[834]: 2026-11-12T13:14:45.221273Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.166676] garage[834]: 2026-11-12T13:14:45.221284Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.167218] garage[834]: 2026-11-12T13:14:45.221292Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.168599] garage[834]: 2026-11-12T13:14:45.221298Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.210840] garage[834]: 2026-11-12T13:14:45.221304Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.211661] garage[834]: 2026-11-12T13:14:45.221310Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.212171] garage[834]: 2026-11-12T13:14:45.221316Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.212738] garage[834]: 2026-11-12T13:14:45.221321Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.213531] garage[834]: 2026-11-12T13:14:45.221327Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.213949] garage[834]: 2026-11-12T13:14:45.221333Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.214645] garage[834]: 2026-11-12T13:14:45.221340Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.215167] garage[834]: 2026-11-12T13:14:45.221381Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.215695] garage[834]: 2026-11-12T13:14:45.221387Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.216419] garage[834]: 2026-11-12T13:14:45.221393Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.216949] garage[834]: 2026-11-12T13:14:45.221399Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.217676] garage[834]: 2026-11-12T13:14:45.221404Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.218217] garage[834]: 2026-11-12T13:14:45.221410Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.218759] garage[834]: 2026-11-12T13:14:45.221416Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.219440] garage[834]: 2026-11-12T13:14:45.221425Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.219978] garage[834]: 2026-11-12T13:14:45.221431Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.220701] garage[834]: 2026-11-12T13:14:45.221437Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.221409] garage[834]: 2026-11-12T13:14:45.221443Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.221978] garage[834]: 2026-11-12T13:14:45.221448Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.222652] garage[834]: 2026-11-12T13:14:45.221455Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.223177] garage[834]: 2026-11-12T13:14:45.221460Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.223754] garage[834]: 2026-11-12T13:14:45.221466Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.224488] garage[834]: 2026-11-12T13:14:45.221472Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.224985] garage[834]: 2026-11-12T13:14:45.221478Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.225713] garage[834]: 2026-11-12T13:14:45.221483Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.226205] garage[834]: 2026-11-12T13:14:45.221489Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.226747] garage[834]: 2026-11-12T13:14:45.221495Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.227454] garage[834]: 2026-11-12T13:14:45.221500Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.227983] garage[834]: 2026-11-12T13:14:45.221506Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.228358] garage[834]: 2026-11-12T13:14:45.221512Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.228875] garage[834]: 2026-11-12T13:14:45.221557Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.229582] garage[834]: 2026-11-12T13:14:45.221564Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.230164] garage[834]: 2026-11-12T13:14:45.221570Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.271679] garage[834]: 2026-11-12T13:14:45.221576Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.272428] garage[834]: 2026-11-12T13:14:45.221581Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.272961] garage[834]: 2026-11-12T13:14:45.221587Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.273314] garage[834]: 2026-11-12T13:14:45.221593Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.273843] garage[834]: 2026-11-12T13:14:45.221599Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.274562] garage[834]: 2026-11-12T13:14:45.221605Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.275106] garage[834]: 2026-11-12T13:14:45.221610Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.275627] garage[834]: 2026-11-12T13:14:45.221616Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.276146] garage[834]: 2026-11-12T13:14:45.221622Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.276678] garage[834]: 2026-11-12T13:14:45.221628Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.277413] garage[834]: 2026-11-12T13:14:45.221634Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.277930] garage[834]: 2026-11-12T13:14:45.221640Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.278646] garage[834]: 2026-11-12T13:14:45.221645Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.279235] garage[834]: 2026-11-12T13:14:45.221656Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.279723] garage[834]: 2026-11-12T13:14:45.221662Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.280418] garage[834]: 2026-11-12T13:14:45.221667Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.280944] garage[834]: 2026-11-12T13:14:45.221674Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.281674] garage[834]: 2026-11-12T13:14:45.221679Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.282182] garage[834]: 2026-11-12T13:14:45.221685Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.282704] garage[834]: 2026-11-12T13:14:45.221691Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.283420] garage[834]: 2026-11-12T13:14:45.221709Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.283942] garage[834]: 2026-11-12T13:14:45.221739Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.284673] garage[834]: 2026-11-12T13:14:45.221745Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.285217] garage[834]: 2026-11-12T13:14:45.221750Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.285707] garage[834]: 2026-11-12T13:14:45.221757Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.286407] garage[834]: 2026-11-12T13:14:45.221762Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.286925] garage[834]: 2026-11-12T13:14:45.221768Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.287624] garage[834]: 2026-11-12T13:14:45.221774Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.288141] garage[834]: 2026-11-12T13:14:45.221781Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.288673] garage[834]: 2026-11-12T13:14:45.221790Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.289199] garage[834]: 2026-11-12T13:14:45.221796Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.289714] garage[834]: 2026-11-12T13:14:45.221802Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.290426] garage[834]: 2026-11-12T13:14:45.221808Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.291655] garage[834]: 2026-11-12T13:14:45.221814Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.293426] garage[834]: 2026-11-12T13:14:45.221819Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.295486] garage[834]: 2026-11-12T13:14:45.221825Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.297084] garage[834]: 2026-11-12T13:14:45.221831Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.298982] garage[834]: 2026-11-12T13:14:45.221837Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.341782] garage[834]: 2026-11-12T13:14:45.221843Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.342264] garage[834]: 2026-11-12T13:14:45.221849Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.342772] garage[834]: 2026-11-12T13:14:45.221854Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.343531] garage[834]: 2026-11-12T13:14:45.221860Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.344037] garage[834]: 2026-11-12T13:14:45.221866Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.344555] garage[834]: 2026-11-12T13:14:45.221872Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.345104] garage[834]: 2026-11-12T13:14:45.221910Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.345621] garage[834]: 2026-11-12T13:14:45.221919Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.346153] garage[834]: 2026-11-12T13:14:45.221925Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.346673] garage[834]: 2026-11-12T13:14:45.221931Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.347187] garage[834]: 2026-11-12T13:14:45.221937Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.347703] garage[834]: 2026-11-12T13:14:45.221942Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.348231] garage[834]: 2026-11-12T13:14:45.221948Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.348769] garage[834]: 2026-11-12T13:14:45.221954Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.349307] garage[834]: 2026-11-12T13:14:45.221960Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.349833] garage[834]: 2026-11-12T13:14:45.221966Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.350540] garage[834]: 2026-11-12T13:14:45.221972Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.351118] garage[834]: 2026-11-12T13:14:45.221978Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.351241] garage[834]: 2026-11-12T13:14:45.221983Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.351747] garage[834]: 2026-11-12T13:14:45.221989Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.352468] garage[834]: 2026-11-12T13:14:45.221995Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.352997] garage[834]: 2026-11-12T13:14:45.222001Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.353557] garage[834]: 2026-11-12T13:14:45.222007Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.354086] garage[834]: 2026-11-12T13:14:45.222015Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.354614] garage[834]: 2026-11-12T13:14:45.222021Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.355152] garage[834]: 2026-11-12T13:14:45.222027Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.355673] garage[834]: 2026-11-12T13:14:45.222078Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.356223] garage[834]: 2026-11-12T13:14:45.222083Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.356760] garage[834]: 2026-11-12T13:14:45.222090Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.357453] garage[834]: 2026-11-12T13:14:45.222095Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.357945] garage[834]: 2026-11-12T13:14:45.222101Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.358705] garage[834]: 2026-11-12T13:14:45.222107Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.359767] garage[834]: 2026-11-12T13:14:45.222112Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.361736] garage[834]: 2026-11-12T13:14:45.222118Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.363670] garage[834]: 2026-11-12T13:14:45.222124Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.365584] garage[834]: 2026-11-12T13:14:45.222132Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.367907] garage[834]: 2026-11-12T13:14:45.222137Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.369691] garage[834]: 2026-11-12T13:14:45.222142Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.371627] garage[834]: 2026-11-12T13:14:45.222149Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.373702] garage[834]: 2026-11-12T13:14:45.222158Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.375482] garage[834]: 2026-11-12T13:14:45.222164Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.377198] garage[834]: 2026-11-12T13:14:45.222170Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.416450] garage[834]: 2026-11-12T13:14:45.222176Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.417148] garage[834]: 2026-11-12T13:14:45.222181Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.417613] garage[834]: 2026-11-12T13:14:45.222187Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.418220] garage[834]: 2026-11-12T13:14:45.222192Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.418317] garage[834]: 2026-11-12T13:14:45.222198Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.418803] garage[834]: 2026-11-12T13:14:45.222204Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.419439] garage[834]: 2026-11-12T13:14:45.222209Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.419923] garage[834]: 2026-11-12T13:14:45.222250Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.420579] garage[834]: 2026-11-12T13:14:45.222256Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.421096] garage[834]: 2026-11-12T13:14:45.222261Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.421601] garage[834]: 2026-11-12T13:14:45.222267Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.422107] garage[834]: 2026-11-12T13:14:45.222273Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.422585] garage[834]: 2026-11-12T13:14:45.222285Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.423059] garage[834]: 2026-11-12T13:14:45.222294Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.423546] garage[834]: 2026-11-12T13:14:45.222299Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.423996] garage[834]: 2026-11-12T13:14:45.222306Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.424491] garage[834]: 2026-11-12T13:14:45.222311Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.424975] garage[834]: 2026-11-12T13:14:45.222317Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.425584] garage[834]: 2026-11-12T13:14:45.222323Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.426067] garage[834]: 2026-11-12T13:14:45.222329Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.426537] garage[834]: 2026-11-12T13:14:45.222335Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.426989] garage[834]: 2026-11-12T13:14:45.222340Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.427633] garage[834]: 2026-11-12T13:14:45.222346Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.428105] garage[834]: 2026-11-12T13:14:45.222352Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.428578] garage[834]: 2026-11-12T13:14:45.222358Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.429059] garage[834]: 2026-11-12T13:14:45.222364Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.429536] garage[834]: 2026-11-12T13:14:45.222369Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.429987] garage[834]: 2026-11-12T13:14:45.222375Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.430315] garage[834]: 2026-11-12T13:14:45.222381Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.430784] garage[834]: 2026-11-12T13:14:45.222390Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.431416] garage[834]: 2026-11-12T13:14:45.222431Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.431906] garage[834]: 2026-11-12T13:14:45.222437Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.432958] garage[834]: 2026-11-12T13:14:45.222442Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.434555] garage[834]: 2026-11-12T13:14:45.222448Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.436425] garage[834]: 2026-11-12T13:14:45.222454Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.438043] garage[834]: 2026-11-12T13:14:45.222460Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.476065] garage[834]: 2026-11-12T13:14:45.222466Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.476738] garage[834]: 2026-11-12T13:14:45.222471Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.477192] garage[834]: 2026-11-12T13:14:45.222477Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.477686] garage[834]: 2026-11-12T13:14:45.222483Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.478164] garage[834]: 2026-11-12T13:14:45.222489Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.478635] garage[834]: 2026-11-12T13:14:45.222495Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.479128] garage[834]: 2026-11-12T13:14:45.222501Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.479587] garage[834]: 2026-11-12T13:14:45.222506Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.480060] garage[834]: 2026-11-12T13:14:45.222512Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.480620] garage[834]: 2026-11-12T13:14:45.222521Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.480996] garage[834]: 2026-11-12T13:14:45.222527Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.481480] garage[834]: 2026-11-12T13:14:45.222533Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.481941] garage[834]: 2026-11-12T13:14:45.222539Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.482578] garage[834]: 2026-11-12T13:14:45.222545Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.483058] garage[834]: 2026-11-12T13:14:45.222551Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.483528] garage[834]: 2026-11-12T13:14:45.222556Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.483979] garage[834]: 2026-11-12T13:14:45.222562Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.484625] garage[834]: 2026-11-12T13:14:45.222604Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.485095] garage[834]: 2026-11-12T13:14:45.222611Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.485251] garage[834]: 2026-11-12T13:14:45.222616Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.485725] garage[834]: 2026-11-12T13:14:45.222623Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.486202] garage[834]: 2026-11-12T13:14:45.222628Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.486678] garage[834]: 2026-11-12T13:14:45.222634Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.487195] garage[834]: 2026-11-12T13:14:45.222640Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.487628] garage[834]: 2026-11-12T13:14:45.222646Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.488104] garage[834]: 2026-11-12T13:14:45.222657Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.488574] garage[834]: 2026-11-12T13:14:45.222663Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.489050] garage[834]: 2026-11-12T13:14:45.222669Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.489525] garage[834]: 2026-11-12T13:14:45.222675Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.489985] garage[834]: 2026-11-12T13:14:45.222680Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.490617] garage[834]: 2026-11-12T13:14:45.222686Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.491100] garage[834]: 2026-11-12T13:14:45.222692Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.531677] garage[834]: 2026-11-12T13:14:45.222698Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.532375] garage[834]: 2026-11-12T13:14:45.222704Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.532809] garage[834]: 2026-11-12T13:14:45.222710Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.533457] garage[834]: 2026-11-12T13:14:45.222715Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.533963] garage[834]: 2026-11-12T13:14:45.222721Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.534738] garage[834]: 2026-11-12T13:14:45.222727Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.535208] garage[834]: 2026-11-12T13:14:45.222733Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.535740] garage[834]: 2026-11-12T13:14:45.222739Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.536454] garage[834]: 2026-11-12T13:14:45.222760Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.536972] garage[834]: 2026-11-12T13:14:45.222792Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.537677] garage[834]: 2026-11-12T13:14:45.222798Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.538236] garage[834]: 2026-11-12T13:14:45.222803Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.538770] garage[834]: 2026-11-12T13:14:45.222810Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.539275] garage[834]: 2026-11-12T13:14:45.222815Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.539817] garage[834]: 2026-11-12T13:14:45.222822Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.540549] garage[834]: 2026-11-12T13:14:45.222827Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.541084] garage[834]: 2026-11-12T13:14:45.222833Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.541613] garage[834]: 2026-11-12T13:14:45.222839Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.542144] garage[834]: 2026-11-12T13:14:45.222845Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.542724] garage[834]: 2026-11-12T13:14:45.222851Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.543196] garage[834]: 2026-11-12T13:14:45.222857Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.543738] garage[834]: 2026-11-12T13:14:45.222862Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.544469] garage[834]: 2026-11-12T13:14:45.222868Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.544959] garage[834]: 2026-11-12T13:14:45.222874Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! machine # [ 15.545682] garage[834]: 2026-11-12T13:14:45.222897Z INFO garage_model::garage: Initialize block manager... machine # [ 15.546223] garage[834]: 2026-11-12T13:14:45.227372Z INFO garage_model::garage: Initialize bucket_table... machine # [ 15.546765] garage[834]: 2026-11-12T13:14:45.228924Z INFO garage_model::garage: Initialize bucket_alias_table... machine # [ 15.547483] garage[834]: 2026-11-12T13:14:45.229291Z INFO garage_model::garage: Initialize key_table_table... machine # [ 15.547974] garage[834]: 2026-11-12T13:14:45.229362Z INFO garage_model::garage: Initialize block_ref_table... machine # [ 15.548680] garage[834]: 2026-11-12T13:14:45.229874Z INFO garage_model::garage: Initialize version_table... machine # [ 15.549235] garage[834]: 2026-11-12T13:14:45.230079Z INFO garage_model::garage: Initialize multipart upload counter table... machine # [ 15.549756] garage[834]: 2026-11-12T13:14:45.230620Z INFO garage_model::garage: Initialize multipart upload table... machine # [ 15.550479] garage[834]: 2026-11-12T13:14:45.230802Z INFO garage_model::garage: Initialize object counter table... machine # [ 15.550987] garage[834]: 2026-11-12T13:14:45.231106Z INFO garage_model::garage: Initialize object_table... machine # [ 15.551715] garage[834]: 2026-11-12T13:14:45.232001Z INFO garage_model::garage: Load lifecycle worker state... machine # [ 15.552480] garage[834]: 2026-11-12T13:14:45.232169Z INFO garage_model::garage: Initialize K2V counter table... machine # [ 15.553861] garage[834]: 2026-11-12T13:14:45.232762Z INFO garage_model::garage: Initialize K2V subscription manager... machine # [ 15.555639] garage[834]: 2026-11-12T13:14:45.232772Z INFO garage_model::garage: Initialize K2V item table... machine # [ 15.557201] garage[834]: 2026-11-12T13:14:45.233636Z INFO garage_model::garage: Initialize K2V RPC handler... machine # [ 15.559044] garage[834]: 2026-11-12T13:14:45.233982Z INFO garage::server: Initializing background runner... machine # [ 15.560629] garage[834]: 2026-11-12T13:14:45.234858Z INFO garage::server: Spawning Garage workers... machine # [ 15.562026] garage[834]: 2026-11-12T13:14:45.235131Z INFO garage_model::s3::lifecycle_worker: Starting lifecycle worker for 2026-11-12 machine # [ 15.563957] garage[834]: 2026-11-12T13:14:45.235148Z INFO garage::server: Initialize Admin API server and metrics collector... machine # [ 15.565886] garage[834]: 2026-11-12T13:14:45.235365Z INFO garage::server: Launching internal Garage cluster communications... machine # [ 15.567681] garage[834]: 2026-11-12T13:14:45.235459Z INFO garage::server: Create admin RPC handler... machine # [ 15.569476] garage[834]: 2026-11-12T13:14:45.235474Z INFO garage::server: Initializing S3 API server... machine # [ 15.570715] garage[834]: 2026-11-12T13:14:45.269375Z INFO garage_api_common::generic_server: S3 API server listening on http://0.0.0.0:9000 machine # [ 15.572837] garage[834]: 2026-11-12T13:14:45.270331Z INFO garage_net::netapp: Listening on 127.0.0.1:3901 machine # [ 15.574639] garage[834]: 2026-11-12T13:14:45.270442Z INFO garage_rpc::system: Doing a bootstrap/discovery step (not_configured: true, no_peers: false, bad_peers: true) machine # [ 15.576766] garage[834]: 2026-11-12T13:14:45.284173Z INFO garage_model::s3::lifecycle_worker: Lifecycle worker finished for 2026-11-12, objects expired: 0, mpu aborted: 0 machine # [ 15.651350] garage[834]: 2026-11-12T13:14:46.253902Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:39388, negotiating handshake... machine # [ 15.652320] garage[834]: 2026-11-12T13:14:46.255181Z INFO garage_net::netapp: Accepted connection from 9c64631071cda248 at 127.0.0.1:39388 machine # [ 15.696588] garage-setup-start[865]: ==== HEALTHY NODES ==== machine # [ 15.697235] garage-setup-start[865]: ID Hostname Address Tags Zone Capacity DataAvail machine # [ 15.697987] garage-setup-start[865]: 7c0c1a2ca90d6317 machine 10.0.2.15:3901 NO ROLE ASSIGNED machine # [ 15.698953] garage[834]: 2026-11-12T13:14:46.301259Z INFO garage_net::netapp: Connection from 9c64631071cda248 closed machine # [ 15.730896] garage[834]: 2026-11-12T13:14:46.333552Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:39390, negotiating handshake... machine # [ 15.731727] garage[834]: 2026-11-12T13:14:46.334689Z INFO garage_net::netapp: Accepted connection from e60d8e4ca9a6a4d2 at 127.0.0.1:39390 machine # [ 15.774792] garage-setup-start[877]: Role changes are staged but not yet committed. machine # [ 15.774988] garage-setup-start[877]: Use `garage layout show` to view staged role changes, machine # [ 15.776090] garage-setup-start[877]: and `garage layout apply` to enact staged changes. machine # [ 15.776876] garage[834]: 2026-11-12T13:14:46.377680Z INFO garage_net::netapp: Connection from e60d8e4ca9a6a4d2 closed machine # [ 15.788751] garage[834]: 2026-11-12T13:14:46.391736Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:39404, negotiating handshake... machine # [ 15.794085] garage[834]: 2026-11-12T13:14:46.397007Z INFO garage_net::netapp: Accepted connection from f9726dec82522f07 at 127.0.0.1:39404 machine # [ 15.857727] garage-setup-start[882]: ==== COMPUTATION OF A NEW PARTITION ASSIGNATION ==== machine # [ 15.857985] garage-setup-start[882]: Partitions are replicated 1 times on at least 1 distinct zones. machine # [ 15.858756] garage-setup-start[882]: Optimal partition size: 3.9 MB machine # [ 15.859852] garage-setup-start[882]: Usable capacity / total cluster capacity: 1000.0 MB / 1000.0 MB (100.0 %) machine # [ 15.860897] garage-setup-start[882]: Effective capacity (replication factor 1): 1000.0 MB machine # [ 15.862048] garage-setup-start[882]: test Tags Partitions Capacity Usable capacity machine # [ 15.862829] garage-setup-start[882]: 7c0c1a2ca90d6317 256 (256 new) 1000.0 MB 1000.0 MB (100.0%) machine # [ 15.863942] garage-setup-start[882]: TOTAL 256 (256 unique) 1000.0 MB 1000.0 MB (100.0%) machine # [ 15.866092] garage-setup-start[882]: New cluster layout with updated role assignment has been applied in cluster. machine # [ 15.867130] garage-setup-start[882]: Data will now be moved around between nodes accordingly. machine # [ 15.867887] garage[834]: 2026-11-12T13:14:46.469373Z INFO garage_net::netapp: Connection from f9726dec82522f07 closed machine # [ 15.885872] garage[834]: 2026-11-12T13:14:46.488737Z INFO garage_table::sync: (bucket_v2) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list machine # [ 15.886831] garage[834]: 2026-11-12T13:14:46.488814Z INFO garage_table::sync: bucket_v2: Adding full sync for ack layout version 1 machine # [ 15.888144] garage[834]: 2026-11-12T13:14:46.488856Z INFO garage_table::sync: (bucket_alias) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list machine # [ 15.889685] garage[834]: 2026-11-12T13:14:46.488871Z INFO garage_table::sync: bucket_alias: Adding full sync for ack layout version 1 machine # [ 15.890922] garage[834]: 2026-11-12T13:14:46.488894Z INFO garage_table::sync: (key) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list machine # [ 15.891837] garage[834]: 2026-11-12T13:14:46.488908Z INFO garage_table::sync: key: Adding full sync for ack layout version 1 machine # [ 15.892769] garage[834]: 2026-11-12T13:14:46.488929Z INFO garage_table::sync: (object) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list machine # [ 15.900603] garage[834]: 2026-11-12T13:14:46.503500Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:39416, negotiating handshake... machine # [ 15.901799] garage[834]: 2026-11-12T13:14:46.504784Z INFO garage_net::netapp: Accepted connection from c4495aeead0e7adc at 127.0.0.1:39416 machine # [ 15.913544] garage[834]: 2026-11-12T13:14:46.515580Z INFO garage_table::sync: object: Adding full sync for ack layout version 1 machine # [ 15.915548] garage[834]: 2026-11-12T13:14:46.515612Z INFO garage_table::sync: (bucket_object_counter) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list machine # [ 15.918594] garage[834]: 2026-11-12T13:14:46.515718Z INFO garage_table::sync: bucket_object_counter: Adding full sync for ack layout version 1 machine # [ 15.920683] garage[834]: 2026-11-12T13:14:46.515735Z INFO garage_table::sync: (multipart_upload) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list machine # [ 15.923528] garage[834]: 2026-11-12T13:14:46.515834Z INFO garage_table::sync: multipart_upload: Adding full sync for ack layout version 1 machine # [ 15.925540] garage[834]: 2026-11-12T13:14:46.515852Z INFO garage_table::sync: (bucket_mpu_counter) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list machine # [ 15.928477] garage[834]: 2026-11-12T13:14:46.515946Z INFO garage_table::sync: bucket_mpu_counter: Adding full sync for ack layout version 1 machine # [ 15.930543] garage[834]: 2026-11-12T13:14:46.515962Z INFO garage_table::sync: (version) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list machine # [ 15.933377] garage[834]: 2026-11-12T13:14:46.516081Z INFO garage_table::sync: version: Adding full sync for ack layout version 1 machine # [ 15.935307] garage[834]: 2026-11-12T13:14:46.516098Z INFO garage_table::sync: (block_ref) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list machine # [ 15.938145] garage[834]: 2026-11-12T13:14:46.516196Z INFO garage_table::sync: block_ref: Adding full sync for ack layout version 1 machine # [ 15.940154] garage[834]: 2026-11-12T13:14:46.516212Z INFO garage_table::sync: (k2v_item) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list machine # [ 15.943064] garage[834]: 2026-11-12T13:14:46.516315Z INFO garage_table::sync: k2v_item: Adding full sync for ack layout version 1 machine # [ 15.944981] garage[834]: 2026-11-12T13:14:46.516333Z INFO garage_table::sync: (k2v_index_counter_v2) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list machine # [ 15.948049] garage[834]: 2026-11-12T13:14:46.516431Z INFO garage_table::sync: k2v_index_counter_v2: Adding full sync for ack layout version 1 machine # [ 15.950082] garage[834]: 2026-11-12T13:14:46.550467Z INFO garage_net::netapp: Connection from c4495aeead0e7adc closed machine # [ 15.952034] garage-setup-start[887]: Key name: farm machine # [ 15.952765] garage-setup-start[887]: Key ID: GK0123456789abcdef01234567 machine # [ 15.953708] garage-setup-start[887]: Secret key: 0123456789abcdef0123456789abcdef0123456789abcdef0123456789abcdef machine # [ 15.955084] garage-setup-start[887]: Can create buckets: false machine # [ 15.955933] garage-setup-start[887]: Key-specific bucket aliases: machine # [ 15.956821] garage-setup-start[887]: Authorized buckets: machine # [ 15.957610] garage[834]: 2026-11-12T13:14:46.560410Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:39430, negotiating handshake... machine # [ 15.959745] garage[834]: 2026-11-12T13:14:46.561117Z INFO garage_net::netapp: Accepted connection from eb4d7b8bc7ea5227 at 127.0.0.1:39430 machine # [ 15.961912] garage[834]: 2026-11-12T13:14:46.564869Z INFO garage_table::sync: bucket_v2: Completed full sync for ack layout version 1 machine # [ 15.962528] garage[834]: 2026-11-12T13:14:46.564908Z INFO garage_table::sync: bucket_alias: Completed full sync for ack layout version 1 machine # [ 15.963052] garage[834]: 2026-11-12T13:14:46.564920Z INFO garage_table::sync: key: Completed full sync for ack layout version 1 machine # [ 15.969571] garage[834]: 2026-11-12T13:14:46.572539Z INFO garage_table::sync: object: Completed full sync for ack layout version 1 machine # [ 15.971772] garage[834]: 2026-11-12T13:14:46.572563Z INFO garage_table::sync: bucket_object_counter: Completed full sync for ack layout version 1 machine # [ 15.972073] garage[834]: 2026-11-12T13:14:46.572571Z INFO garage_table::sync: multipart_upload: Completed full sync for ack layout version 1 machine # [ 15.972601] garage[834]: 2026-11-12T13:14:46.572579Z INFO garage_table::sync: bucket_mpu_counter: Completed full sync for ack layout version 1 machine # [ 15.973127] garage[834]: 2026-11-12T13:14:46.572587Z INFO garage_table::sync: version: Completed full sync for ack layout version 1 machine # [ 15.973702] garage[834]: 2026-11-12T13:14:46.572594Z INFO garage_table::sync: block_ref: Completed full sync for ack layout version 1 machine # [ 15.974179] garage[834]: 2026-11-12T13:14:46.572602Z INFO garage_table::sync: k2v_item: Completed full sync for ack layout version 1 machine # [ 15.974717] garage[834]: 2026-11-12T13:14:46.572610Z INFO garage_table::sync: k2v_index_counter_v2: Completed full sync for ack layout version 1 machine # [ 16.001695] garage-setup-start[892]: Bucket farm was created. machine # [ 16.003199] garage[834]: 2026-11-12T13:14:46.606178Z INFO garage_net::netapp: Connection from eb4d7b8bc7ea5227 closed machine # [ 16.014529] garage[834]: 2026-11-12T13:14:46.617492Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:39442, negotiating handshake... machine # [ 16.015282] garage[834]: 2026-11-12T13:14:46.618254Z INFO garage_net::netapp: Accepted connection from 2a3659c245de8d78 at 127.0.0.1:39442 machine # [ 16.061239] garage-setup-start[897]: New permissions for GK0123456789abcdef01234567 on farm: read true, write true, owner true. machine # [ 16.062902] garage[834]: 2026-11-12T13:14:46.665844Z INFO garage_net::netapp: Connection from 2a3659c245de8d78 closed machine # [ 16.068435] systemd[1]: Finished garage-setup.service. machine # [ 17.479204] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="Starting k3s 1.36.5+k3s1 (3dd98cc5)" machine # [ 17.489774] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 17.493750] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 17.494883] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 17.514752] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="Database tables and indexes are up to date" machine # [ 17.515362] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 17.598188] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="Startup VACUUM completed successfully" machine # [ 17.604089] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="Kine available at unix://kine.sock" machine # [ 17.605280] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.614565] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 17.616442] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1794489288: notBefore=2026-11-12 12:14:48.218706147 +0000 UTC notAfter=2036-11-09 12:14:48.218706147 +0000 UTC" machine # [ 17.618096] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1794489288: notBefore=2026-11-12 12:14:48 +0000 UTC notAfter=2027-11-12 12:14:48 +0000 UTC" machine # [ 17.619286] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1794489288: notBefore=2026-11-12 12:14:48 +0000 UTC notAfter=2027-11-12 12:14:48 +0000 UTC" machine # [ 17.620382] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1794489288: notBefore=2026-11-12 12:14:48 +0000 UTC notAfter=2027-11-12 12:14:48 +0000 UTC" machine # [ 17.621612] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1794489288: notBefore=2026-11-12 12:14:48 +0000 UTC notAfter=2027-11-12 12:14:48 +0000 UTC" machine # [ 17.623099] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1794489288: notBefore=2026-11-12 12:14:48 +0000 UTC notAfter=2027-11-12 12:14:48 +0000 UTC" machine # [ 17.624389] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1794489288: notBefore=2026-11-12 12:14:48 +0000 UTC notAfter=2027-11-12 12:14:48 +0000 UTC" machine # [ 17.625507] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1794489288: notBefore=2026-11-12 12:14:48.227801995 +0000 UTC notAfter=2036-11-09 12:14:48.227801995 +0000 UTC" machine # [ 17.626971] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1794489288: notBefore=2026-11-12 12:14:48 +0000 UTC notAfter=2027-11-12 12:14:48 +0000 UTC" machine # [ 17.628185] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1794489288: notBefore=2026-11-12 12:14:48 +0000 UTC notAfter=2027-11-12 12:14:48 +0000 UTC" machine # [ 17.629362] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1794489288: notBefore=2026-11-12 12:14:48 +0000 UTC notAfter=2027-11-12 12:14:48 +0000 UTC" machine # [ 17.630567] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1794489288: notBefore=2026-11-12 12:14:48.232133552 +0000 UTC notAfter=2036-11-09 12:14:48.232133552 +0000 UTC" machine # [ 17.631988] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1794489288: notBefore=2026-11-12 12:14:48 +0000 UTC notAfter=2027-11-12 12:14:48 +0000 UTC" machine # [ 17.633242] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1794489288: notBefore=2026-11-12 12:14:48.233908917 +0000 UTC notAfter=2036-11-09 12:14:48.233908917 +0000 UTC" machine # [ 17.634410] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1794489288: notBefore=2026-11-12 12:14:48 +0000 UTC notAfter=2027-11-12 12:14:48 +0000 UTC" machine # [ 17.635883] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1794489288: notBefore=2026-11-12 12:14:48.235625895 +0000 UTC notAfter=2036-11-09 12:14:48.235625895 +0000 UTC" machine # [ 17.637517] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1794489288: notBefore=2026-11-12 12:14:48 +0000 UTC notAfter=2027-11-12 12:14:48 +0000 UTC" machine # [ 17.638972] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1794489288: notBefore=2026-11-12 12:14:48 +0000 UTC notAfter=2027-11-12 12:14:48 +0000 UTC" machine # [ 17.757276] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1794489288: notBefore=2026-11-12 12:14:48 +0000 UTC notAfter=2027-11-12 12:14:48 +0000 UTC" machine # [ 17.757460] k3s[836]: time="2026-11-12T13:14:48Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 17.767198] k3s[836]: time="2026-11-12T13:14:48Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__7c40_6dd5_1fe6_8276-05650b:fec0::7c40:6dd5:1fe6:8276 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=2252ECFE0CE78961C7A14B001366855BBD82D2FB]" machine # [ 18.852285] k3s[836]: time="2026-11-12T13:14:49Z" level=info msg="Password verified locally for node machine" machine # [ 18.852790] k3s[836]: time="2026-11-12T13:14:49Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1794489288: notBefore=2026-11-12 12:14:49 +0000 UTC notAfter=2027-11-12 12:14:49 +0000 UTC" machine # [ 19.123554] k3s[836]: time="2026-11-12T13:14:49Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1794489288: notBefore=2026-11-12 12:14:49 +0000 UTC notAfter=2027-11-12 12:14:49 +0000 UTC" machine # [ 19.196381] k3s[836]: time="2026-11-12T13:14:49Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1794489288: notBefore=2026-11-12 12:14:49 +0000 UTC notAfter=2027-11-12 12:14:49 +0000 UTC" machine # [ 19.279711] k3s[836]: time="2026-11-12T13:14:49Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1794489288: notBefore=2026-11-12 12:14:49 +0000 UTC notAfter=2027-11-12 12:14:49 +0000 UTC" machine # [ 19.383951] k3s[836]: time="2026-11-12T13:14:49Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:37698: runtime core not ready" machine # [ 19.479661] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Module overlay was already loaded" machine # [ 19.732849] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 19.737870] Bridge firewalling registered machine # [ 19.596108] k3s[836]: time="2026-11-12T13:14:50Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 19.605751] k3s[836]: time="2026-11-12T13:14:50Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 19.618865] k3s[836]: time="2026-11-12T13:14:50Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 19.699981] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 19.700888] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 19.706268] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 19.707338] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 19.716521] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.717279] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 19.718168] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 19.723419] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 19.724491] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Connection to etcd is ready" machine # [ 19.725314] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="ETCD server is now running" machine # [ 19.726175] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 19.735177] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Handling backend connection request [machine]" machine # [ 19.735544] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.736040] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.738029] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.739159] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 19.739932] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 19.744571] k3s[836]: I1112 13:14:50.345150 836 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 19.791659] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 19.792095] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 19.792639] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 19.793113] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 19.793631] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 19.794522] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 19.795651] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Run: k3s kubectl" machine # [ 19.796675] k3s[836]: I1112 13:14:50.394953 836 server.go:158] Version: v1.36.5+k3s1 machine # [ 19.797699] k3s[836]: I1112 13:14:50.395003 836 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 19.818683] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 19.818983] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 19.866413] k3s[836]: time="2026-11-12T13:14:50Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:37762: runtime core not ready" machine # [ 19.938937] k3s[836]: I1112 13:14:50.541868 836 shared_informer.go:381] "Waiting for caches to sync" controller="node_authorizer" machine # [ 19.939477] k3s[836]: E1112 13:14:50.541953 836 options.go:205] The manifest file is empty, ignoring. machine # [ 19.944669] k3s[836]: I1112 13:14:50.547599 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 19.947228] k3s[836]: I1112 13:14:50.550192 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 19.948622] k3s[836]: I1112 13:14:50.551533 836 plugins.go:157] Loaded 15 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,PodGroupProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 19.954173] k3s[836]: I1112 13:14:50.551558 836 plugins.go:160] Loaded 17 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,PodGroupWorkloadExists,NodeDeclaredFeatureValidator,JobValidation,PodResizeValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 19.959861] k3s[836]: I1112 13:14:50.551870 836 instance.go:240] Using reconciler: lease machine # [ 19.961132] k3s[836]: I1112 13:14:50.557490 836 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 19.962826] k3s[836]: W1112 13:14:50.557510 836 genericapiserver.go:798] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 19.964769] k3s[836]: I1112 13:14:50.561053 836 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 19.971260] k3s[836]: time="2026-11-12T13:14:50Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 19.987463] k3s[836]: I1112 13:14:50.590415 836 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 19.989025] k3s[836]: I1112 13:14:50.590592 836 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 20.012238] k3s[836]: I1112 13:14:50.615200 836 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 20.053691] k3s[836]: I1112 13:14:50.656648 836 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 20.054112] k3s[836]: W1112 13:14:50.657105 836 genericapiserver.go:798] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 20.054884] k3s[836]: W1112 13:14:50.657881 836 genericapiserver.go:798] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 20.058913] k3s[836]: I1112 13:14:50.661895 836 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 20.059595] k3s[836]: W1112 13:14:50.662591 836 genericapiserver.go:798] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 20.063583] k3s[836]: I1112 13:14:50.666512 836 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 20.066056] k3s[836]: I1112 13:14:50.668994 836 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 20.068513] k3s[836]: I1112 13:14:50.671453 836 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 20.068773] k3s[836]: W1112 13:14:50.671479 836 genericapiserver.go:798] Skipping API batch/v1beta1 because it has no resources. machine # [ 20.072046] k3s[836]: I1112 13:14:50.675002 836 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 20.072508] k3s[836]: W1112 13:14:50.675052 836 genericapiserver.go:798] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 20.073047] k3s[836]: W1112 13:14:50.675064 836 genericapiserver.go:798] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 20.077313] k3s[836]: I1112 13:14:50.680264 836 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 20.077734] k3s[836]: W1112 13:14:50.680294 836 genericapiserver.go:798] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 20.078236] k3s[836]: W1112 13:14:50.680305 836 genericapiserver.go:798] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 20.082414] k3s[836]: I1112 13:14:50.685378 836 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 20.082680] k3s[836]: W1112 13:14:50.685403 836 genericapiserver.go:798] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 20.086975] k3s[836]: I1112 13:14:50.689941 836 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 20.087457] k3s[836]: W1112 13:14:50.689967 836 genericapiserver.go:798] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 20.090377] k3s[836]: I1112 13:14:50.693344 836 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 20.090635] k3s[836]: W1112 13:14:50.693367 836 genericapiserver.go:798] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 20.091141] k3s[836]: W1112 13:14:50.693378 836 genericapiserver.go:798] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 20.095522] k3s[836]: I1112 13:14:50.698476 836 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 20.095803] k3s[836]: W1112 13:14:50.698502 836 genericapiserver.go:798] Skipping API policy/v1beta1 because it has no resources. machine # [ 20.099497] k3s[836]: I1112 13:14:50.702451 836 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 20.099768] k3s[836]: W1112 13:14:50.702474 836 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 20.100253] k3s[836]: W1112 13:14:50.702486 836 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 20.104733] k3s[836]: I1112 13:14:50.707712 836 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 20.105202] k3s[836]: W1112 13:14:50.707732 836 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 20.105720] k3s[836]: W1112 13:14:50.707743 836 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1alpha2 because it has no resources. machine # [ 20.110977] k3s[836]: I1112 13:14:50.713953 836 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 20.111492] k3s[836]: W1112 13:14:50.713983 836 genericapiserver.go:798] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 20.111993] k3s[836]: W1112 13:14:50.713993 836 genericapiserver.go:798] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 20.116883] k3s[836]: I1112 13:14:50.719790 836 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 20.118721] k3s[836]: W1112 13:14:50.719827 836 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 20.120573] k3s[836]: W1112 13:14:50.719839 836 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 20.122437] k3s[836]: W1112 13:14:50.719855 836 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 20.124356] k3s[836]: I1112 13:14:50.721864 836 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 20.125770] k3s[836]: W1112 13:14:50.721884 836 genericapiserver.go:798] Skipping API apps/v1beta2 because it has no resources. machine # [ 20.127385] k3s[836]: W1112 13:14:50.721895 836 genericapiserver.go:798] Skipping API apps/v1beta1 because it has no resources. machine # [ 20.128930] k3s[836]: I1112 13:14:50.723401 836 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 20.130560] k3s[836]: W1112 13:14:50.723419 836 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.132472] k3s[836]: W1112 13:14:50.723430 836 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 20.134328] k3s[836]: I1112 13:14:50.723709 836 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 20.134747] k3s[836]: W1112 13:14:50.723723 836 genericapiserver.go:798] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 20.135262] k3s[836]: I1112 13:14:50.724681 836 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 20.135786] k3s[836]: W1112 13:14:50.724703 836 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 20.136501] k3s[836]: W1112 13:14:50.724713 836 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 20.136989] k3s[836]: W1112 13:14:50.724722 836 genericapiserver.go:798] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 20.137684] k3s[836]: I1112 13:14:50.727241 836 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 20.138223] k3s[836]: W1112 13:14:50.727267 836 genericapiserver.go:798] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.453208] k3s[836]: I1112 13:14:51.053100 836 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.453592] k3s[836]: I1112 13:14:51.053284 836 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.453999] k3s[836]: I1112 13:14:51.053416 836 secure_serving.go:214] Serving securely on 127.0.0.1:6444 machine # [ 20.454552] k3s[836]: I1112 13:14:51.053508 836 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 20.455084] k3s[836]: I1112 13:14:51.053511 836 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 20.455559] k3s[836]: I1112 13:14:51.053672 836 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 20.456041] k3s[836]: I1112 13:14:51.053873 836 remote_available_controller.go:434] Starting RemoteAvailability controller machine # [ 20.456592] k3s[836]: I1112 13:14:51.053890 836 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 20.457135] k3s[836]: I1112 13:14:51.053937 836 aggregator.go:185] waiting for initial CRD sync... machine # [ 20.457669] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 20.463184] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.463909] k3s[836]: I1112 13:14:51.054346 836 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 20.464674] k3s[836]: I1112 13:14:51.054674 836 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 20.467026] k3s[836]: I1112 13:14:51.054912 836 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 20.467583] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.468107] k3s[836]: I1112 13:14:51.054999 836 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 20.468815] k3s[836]: I1112 13:14:51.055084 836 controller.go:89] "Starting OpenAPI V3 AggregationController" machine # [ 20.469534] k3s[836]: I1112 13:14:51.055087 836 controller.go:87] "Starting OpenAPI AggregationController" machine # [ 20.470077] k3s[836]: I1112 13:14:51.055160 836 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 20.470604] k3s[836]: I1112 13:14:51.055171 836 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 20.471117] k3s[836]: I1112 13:14:51.055177 836 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 20.471633] k3s[836]: I1112 13:14:51.055190 836 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 20.472205] k3s[836]: I1112 13:14:51.055242 836 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 20.472685] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 20.473201] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.473731] k3s[836]: I1112 13:14:51.055325 836 storage_readiness_hook.go:70] Storage is ready for all registered resources machine # [ 20.474445] k3s[836]: I1112 13:14:51.055535 836 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 20.474954] k3s[836]: I1112 13:14:51.055550 836 shared_informer.go:381] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 20.475662] k3s[836]: I1112 13:14:51.055908 836 controller.go:142] Starting OpenAPI controller machine # [ 20.476170] k3s[836]: I1112 13:14:51.055975 836 controller.go:90] Starting OpenAPI V3 controller machine # [ 20.476704] k3s[836]: I1112 13:14:51.056025 836 naming_controller.go:305] Starting NamingConditionController machine # [ 20.477236] k3s[836]: I1112 13:14:51.056122 836 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 20.477785] k3s[836]: I1112 13:14:51.056150 836 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 20.478487] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg="Starting CRDFinalizer" logger=k3s machine # [ 20.479086] k3s[836]: I1112 13:14:51.056250 836 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.479559] k3s[836]: I1112 13:14:51.056333 836 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.480086] k3s[836]: I1112 13:14:51.056628 836 repairip.go:210] Starting ipallocator-repair-controller machine # [ 20.480617] k3s[836]: I1112 13:14:51.056641 836 shared_informer.go:381] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 20.481134] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg=Starting controller=kubernetes-service-cidr-controller logger=k3s machine # [ 20.481622] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.539651] k3s[836]: I1112 13:14:51.142578 836 shared_informer.go:388] "Caches are synced" controller="node_authorizer" machine # [ 20.545043] k3s[836]: I1112 13:14:51.147973 836 shared_informer.go:409] "Caches are synced" machine # [ 20.545481] k3s[836]: I1112 13:14:51.148010 836 policy_source.go:248] refreshing policies machine # [ 20.547420] k3s[836]: I1112 13:14:51.150346 836 shared_informer.go:409] "Caches are synced" machine # [ 20.547799] k3s[836]: I1112 13:14:51.150374 836 policy_source.go:248] refreshing policies machine # [ 20.551677] k3s[836]: I1112 13:14:51.154595 836 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 20.553197] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.554472] k3s[836]: I1112 13:14:51.154857 836 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 20.555947] k3s[836]: I1112 13:14:51.154877 836 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 20.557632] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.558852] k3s[836]: I1112 13:14:51.155295 836 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 20.560485] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.561644] k3s[836]: I1112 13:14:51.155558 836 handler_discovery.go:459] Starting ResourceDiscoveryManager machine # [ 20.563038] k3s[836]: I1112 13:14:51.155600 836 shared_informer.go:388] "Caches are synced" controller="crd-autoregister" machine # [ 20.564566] k3s[836]: I1112 13:14:51.155660 836 aggregator.go:187] initial CRD sync complete... machine # [ 20.565825] k3s[836]: I1112 13:14:51.155673 836 autoregister_controller.go:144] Starting autoregister controller machine # [ 20.567291] k3s[836]: I1112 13:14:51.155684 836 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 20.568733] k3s[836]: I1112 13:14:51.155695 836 cache.go:39] Caches are synced for autoregister controller machine # [ 20.570111] k3s[836]: I1112 13:14:51.156729 836 shared_informer.go:388] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 20.571841] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.573059] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg="Creating default ServiceCIDR" CIDRs="[10.43.0.0/16]" logger=k3s machine # [ 20.574698] k3s[836]: I1112 13:14:51.158061 836 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 20.576135] k3s[836]: I1112 13:14:51.169903 836 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.577759] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg="Setting default ServiceCIDR condition Ready to True" logger=k3s machine # [ 20.579332] k3s[836]: I1112 13:14:51.175800 836 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.583663] k3s[836]: I1112 13:14:51.186628 836 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 20.612069] k3s[836]: I1112 13:14:51.213526 836 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 20.618169] k3s[836]: W1112 13:14:51.221144 836 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 20.619769] k3s[836]: I1112 13:14:51.222381 836 controller.go:667] quota admission added evaluator for: endpoints machine # [ 20.624331] k3s[836]: I1112 13:14:51.227293 836 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 20.631913] k3s[836]: E1112 13:14:51.234864 836 controller.go:102] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service machine # [ 20.826854] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg="containerd is now running" machine # [ 20.839072] k3s[836]: time="2026-11-12T13:14:51Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/5b3clszkpd4pxn49dcy20xak4nqmyfh1-k3s-airgap-images-amd64.tar.zst" machine # [ 21.457977] k3s[836]: I1112 13:14:52.060333 836 storage_scheduling.go:137] created PriorityClass system-node-critical with value 2000001000 machine # [ 21.462825] k3s[836]: I1112 13:14:52.065804 836 storage_scheduling.go:137] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 21.463241] k3s[836]: I1112 13:14:52.066181 836 storage_scheduling.go:153] all system priority classes are created successfully or already exist. machine # [ 21.719026] k3s[836]: time="2026-11-12T13:14:52Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 21.993798] k3s[836]: I1112 13:14:52.596674 836 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 22.033817] k3s[836]: I1112 13:14:52.636760 836 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 23.722419] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Waiting for untainted node" machine # [ 23.724079] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 23.724675] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Kube API server is now running" machine # [ 23.725651] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="k3s is up and running" machine # [ 23.726375] systemd[1]: Started k3s service. machine # [ 23.730059] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 23.730569] systemd[1]: Starting niks3 server... machine # [ 23.743106] k3s[836]: E1112 13:14:54.346084 836 options.go:205] The manifest file is empty, ignoring. machine # [ 23.743851] k3s[836]: I1112 13:14:54.346837 836 controllermanager.go:204] "Starting" version="v1.36.5+k3s1" machine # [ 23.744723] k3s[836]: I1112 13:14:54.347696 836 controllermanager.go:206] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 23.747332] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 23.752039] k3s[836]: I1112 13:14:54.354974 836 secure_serving.go:214] Serving securely on 127.0.0.1:10257 machine # [ 23.752676] k3s[836]: I1112 13:14:54.355654 836 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 23.753537] k3s[836]: I1112 13:14:54.355685 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.754030] k3s[836]: I1112 13:14:54.355827 836 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 23.754611] k3s[836]: I1112 13:14:54.355970 836 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.755124] k3s[836]: I1112 13:14:54.356220 836 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 23.755639] k3s[836]: I1112 13:14:54.356240 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.756612] k3s[836]: I1112 13:14:54.356271 836 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 23.757490] k3s[836]: I1112 13:14:54.356295 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.767423] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 23.788961] k3s[836]: I1112 13:14:54.391809 836 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 23.790553] k3s[836]: I1112 13:14:54.393360 836 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.796587] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 23.818218] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 23.822061] k3s[836]: I1112 13:14:54.424164 836 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.843231] k3s[836]: I1112 13:14:54.446129 836 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 23.843534] k3s[836]: I1112 13:14:54.446209 836 controllermanager.go:641] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 23.853478] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.854256] k3s[836]: I1112 13:14:54.456606 836 shared_informer.go:409] "Caches are synced" machine # [ 23.855316] k3s[836]: I1112 13:14:54.456755 836 shared_informer.go:409] "Caches are synced" machine # [ 23.856723] k3s[836]: I1112 13:14:54.457272 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.873397] k3s[836]: I1112 13:14:54.476323 836 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 23.873964] k3s[836]: I1112 13:14:54.476692 836 controllermanager.go:641] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 23.895919] k3s[836]: I1112 13:14:54.498857 836 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.905717] k3s[836]: I1112 13:14:54.508601 836 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.953056] k3s[836]: I1112 13:14:54.555970 836 shared_informer.go:409] "Caches are synced" machine # [ 24.030131] k3s[836]: W1112 13:14:54.632861 836 probe.go:275] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. [25.03s] machine: (finished: waiting for unit k3s.service, in 25.03 seconds) [25.03s] machine: waiting for success: kubectl get ns farm machine # [ 24.055273] k3s[836]: I1112 13:14:54.658217 836 shared_informer.go:409] "Caches are synced" machine # [ 24.193950] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 24.198864] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 24.199355] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 24.212179] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 24.212736] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.224078] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 24.226425] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.7" machine # [ 24.228046] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:7efd3c635b03efd68c4e8398fc45f0d993d0e9ab016f72c1cefb0fd6d01aa286" machine # [ 24.230367] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 24.231915] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 24.234294] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.13" machine # [ 24.235952] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:f86a2cab1b5c649070c49f883c743dd32d8485a56e3368c5f93b9e91f1e91259" machine # [ 24.238214] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 24.239812] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 24.242674] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 24.244133] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 24.329031] k3s[836]: I1112 13:14:54.931877 836 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podgroup-protection-controller" requiredFeatureGates=["GenericWorkload"] machine # [ 24.329240] k3s[836]: I1112 13:14:54.931909 836 controllermanager.go:641] "Warning: skipping controller" controller="podgroup-protection-controller" machine # [ 24.375603] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.375779] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.380464] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.380722] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.5+up40.1.0.tgz" machine # [ 24.383059] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.5+up40.1.0.tgz" machine # [ 24.383893] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 24.384440] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 24.384982] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 24.385786] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 24.386606] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 24.387236] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 24.391305] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::7c40:6dd5:1fe6:8276 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 24.392108] k3s[836]: time="2026-11-12T13:14:54Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 24.509974] k3s[836]: time="2026-11-12T13:14:55Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/nixos/5b3clszkpd4pxn49dcy20xak4nqmyfh1-k3s-airgap-images-amd64.tar.zst in 3.671369405s" machine # [ 24.510402] k3s[836]: time="2026-11-12T13:14:55Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/dkjbsjj4lfjmmla8354am7bzgxwhnjvw-nix-grpc-farm-lb.tar" machine # [ 24.761578] k3s[836]: time="2026-11-12T13:14:55Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__7c40_6dd5_1fe6_8276-05650b:fec0::7c40:6dd5:1fe6:8276 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=2252ECFE0CE78961C7A14B001366855BBD82D2FB]" machine # [ 24.781719] k3s[836]: time="2026-11-12T13:14:55Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=239) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__7c40_6dd5_1fe6_8276-05650b:fec0::7c40:6dd5:1fe6:8276 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=2252ECFE0CE78961C7A14B001366855BBD82D2FB]" machine # [ 24.935686] k3s[836]: I1112 13:14:55.538317 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 24.935906] k3s[836]: I1112 13:14:55.538401 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 24.936506] k3s[836]: I1112 13:14:55.538431 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 24.936970] k3s[836]: I1112 13:14:55.538464 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 24.937605] k3s[836]: I1112 13:14:55.538528 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 24.938075] k3s[836]: I1112 13:14:55.538552 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 24.938548] k3s[836]: I1112 13:14:55.538577 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 24.939033] k3s[836]: I1112 13:14:55.538614 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 24.939512] k3s[836]: I1112 13:14:55.538643 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 24.939965] k3s[836]: I1112 13:14:55.538682 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 24.940658] k3s[836]: I1112 13:14:55.538709 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 24.941097] k3s[836]: I1112 13:14:55.538733 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 24.941249] k3s[836]: I1112 13:14:55.538758 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 24.941715] k3s[836]: I1112 13:14:55.538782 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 24.942197] k3s[836]: I1112 13:14:55.538807 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 24.942683] k3s[836]: I1112 13:14:55.538833 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 24.943158] k3s[836]: I1112 13:14:55.538857 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 24.943639] k3s[836]: I1112 13:14:55.538881 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 24.944123] k3s[836]: I1112 13:14:55.538908 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 24.944604] k3s[836]: I1112 13:14:55.538931 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 24.945080] k3s[836]: I1112 13:14:55.538958 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 24.945562] k3s[836]: I1112 13:14:55.538982 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 24.946047] k3s[836]: I1112 13:14:55.539007 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 24.946525] k3s[836]: I1112 13:14:55.539097 836 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 25.129036] k3s[836]: I1112 13:14:55.731877 836 controllermanager.go:689] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 25.129242] k3s[836]: I1112 13:14:55.731919 836 controllermanager.go:689] "Warning: controller is disabled" controller="service-lb-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.498175] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 25.498564] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Creating deploy event broadcaster" machine # [ 25.502217] k3s[836]: I1112 13:14:56.105141 836 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 25.504486] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 25.504748] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.506368] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Registered handlers for helm-controller-chart-registration" logger=k3s/helm-controller machine # [ 25.514055] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.517484] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 25.520438] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 25.640036] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 25.652152] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 25.672702] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 25.676093] k3s[836]: I1112 13:14:56.279074 836 node_lifecycle_controller.go:402] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 25.676685] k3s[836]: I1112 13:14:56.279612 836 controllermanager.go:689] "Warning: controller is disabled" controller="node-route-controller" machine # [ 25.677517] k3s[836]: I1112 13:14:56.279635 836 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 25.677919] k3s[836]: I1112 13:14:56.279652 836 controllermanager.go:641] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 25.678234] k3s[836]: I1112 13:14:56.279666 836 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="resourcepoolstatusrequest-controller" requiredFeatureGates=["DRAResourcePoolStatus"] machine # [ 25.678705] k3s[836]: I1112 13:14:56.279677 836 controllermanager.go:641] "Warning: skipping controller" controller="resourcepoolstatusrequest-controller" machine # [ 25.685864] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 25.802052] k3s[836]: I1112 13:14:56.404566 836 serving.go:417] Generated self-signed cert in-memory machine # [ 25.809584] k3s[836]: I1112 13:14:56.412456 836 controller.go:667] quota admission added evaluator for: deployments.apps machine # [ 25.826066] k3s[836]: I1112 13:14:56.427387 836 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 25.826375] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 25.916109] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 25.927053] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 25.931520] k3s[836]: I1112 13:14:56.534493 836 serving.go:417] Generated self-signed cert in-memory machine # [ 25.936835] k3s[836]: I1112 13:14:56.539548 836 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 25.940047] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 25.952050] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 26.039086] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 26.051473] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 26.092529] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 26.100067] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 26.142052] k3s[836]: I1112 13:14:56.744473 836 controllermanager.go:163] Version: v1.36.5+k3s1 machine # [ 26.145818] k3s[836]: I1112 13:14:56.748756 836 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 26.146112] k3s[836]: I1112 13:14:56.748804 836 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 26.146568] k3s[836]: I1112 13:14:56.748831 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.147104] k3s[836]: I1112 13:14:56.749746 836 secure_serving.go:214] Serving securely on 127.0.0.1:10258 machine # [ 26.147552] k3s[836]: I1112 13:14:56.750221 836 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 26.148055] k3s[836]: I1112 13:14:56.750336 836 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 26.148661] k3s[836]: I1112 13:14:56.750360 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.149365] k3s[836]: I1112 13:14:56.751111 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.163628] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 26.246236] k3s[836]: I1112 13:14:56.849148 836 shared_informer.go:409] "Caches are synced" machine # [ 26.247497] k3s[836]: I1112 13:14:56.850468 836 shared_informer.go:409] "Caches are synced" machine # [ 26.248531] k3s[836]: I1112 13:14:56.851485 836 shared_informer.go:409] "Caches are synced" machine # [ 26.287435] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 26.291420] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 26.295159] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 26.299194] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 26.299551] k3s[836]: I1112 13:14:56.902348 836 controllermanager.go:338] Started "cloud-node-controller" machine # [ 26.300048] k3s[836]: I1112 13:14:56.902457 836 controllermanager.go:338] Started "cloud-node-lifecycle-controller" machine # [ 26.300586] k3s[836]: I1112 13:14:56.902838 836 controllermanager.go:338] Started "service-lb-controller" machine # [ 26.301026] k3s[836]: W1112 13:14:56.902853 836 controllermanager.go:315] "node-route-controller" is disabled machine # [ 26.301523] k3s[836]: I1112 13:14:56.903305 836 node_controller.go:179] Sending events to api server. machine # [ 26.301958] k3s[836]: I1112 13:14:56.903351 836 node_lifecycle_controller.go:112] Sending events to api server machine # [ 26.302606] k3s[836]: I1112 13:14:56.903490 836 node_controller.go:188] Waiting for informer caches to sync machine # [ 26.303121] k3s[836]: I1112 13:14:56.903627 836 controller.go:235] Starting service controller machine # [ 26.303566] k3s[836]: I1112 13:14:56.903646 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.394323] k3s[836]: time="2026-11-12T13:14:56Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.2.3" machine # [ 26.400930] k3s[836]: I1112 13:14:57.003807 836 shared_informer.go:409] "Caches are synced" machine # [ 26.402294] k3s[836]: time="2026-11-12T13:14:57Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:d5daeeda4d2e5d6e611f2321590b741d5da9f0ef0bc79f2e247231e846c85ae0" machine # [ 26.467191] k3s[836]: time="2026-11-12T13:14:57Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/dkjbsjj4lfjmmla8354am7bzgxwhnjvw-nix-grpc-farm-lb.tar in 1.956793391s" machine # [ 26.469685] k3s[836]: time="2026-11-12T13:14:57Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/f8h8xa6ny4ha0i9hvn6ikxncvh7nbg1n-nix-grpc-farm.tar" machine # [ 26.507517] k3s[836]: time="2026-11-12T13:14:57Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" [27.54s] machine: (finished: waiting for success: kubectl get ns farm, in 2.50 seconds) [27.54s] machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/lb.crt --key=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/lb.key machine # [ 26.618686] k3s[836]: time="2026-11-12T13:14:57Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 26.622171] k3s[836]: time="2026-11-12T13:14:57Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 26.623542] k3s[836]: time="2026-11-12T13:14:57Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 26.624782] k3s[836]: time="2026-11-12T13:14:57Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 26.626085] k3s[836]: time="2026-11-12T13:14:57Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 26.631467] k3s[836]: time="2026-11-12T13:14:57Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 26.633047] k3s[836]: time="2026-11-12T13:14:57Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 26.652109] k3s[836]: time="2026-11-12T13:14:57Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal [27.67s] machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/lb.crt --key=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/lb.key, in 0.13 seconds) [27.67s] machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/worker.crt --key=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/worker.key machine # [ 26.688313] k3s[836]: I1112 13:14:57.291234 836 controller.go:667] quota admission added evaluator for: jobs.batch [27.81s] machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/worker.crt --key=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/worker.key, in 0.14 seconds) [27.81s] machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt [27.95s] machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt, in 0.14 seconds) [27.95s] subtest: chart deploys and workers become Ready [27.95s] machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 27.511684] k3s[836]: time="2026-11-12T13:14:58Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.731511] k3s[836]: I1112 13:14:58.334344 836 controllermanager.go:689] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 27.882613] k3s[836]: I1112 13:14:58.485096 836 controllermanager.go:641] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 28.038165] k3s[836]: I1112 13:14:58.641078 836 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.478635] k3s[836]: I1112 13:14:59.081559 836 controllermanager.go:689] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 28.481849] k3s[836]: I1112 13:14:59.084120 836 servicecidrs_controller.go:137] "Starting" controller="service-cidr-controller" machine # [ 28.482133] k3s[836]: I1112 13:14:59.084149 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.482653] k3s[836]: I1112 13:14:59.085130 836 namespace_controller.go:202] "Starting namespace controller" machine # [ 28.483142] k3s[836]: I1112 13:14:59.085171 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.483697] k3s[836]: I1112 13:14:59.085192 836 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 28.486082] k3s[836]: I1112 13:14:59.085216 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.486644] k3s[836]: I1112 13:14:59.085266 836 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 28.487120] k3s[836]: I1112 13:14:59.085293 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.487603] k3s[836]: I1112 13:14:59.085576 836 replica_set.go:285] "Starting controller" name="replicaset" machine # [ 28.488084] k3s[836]: I1112 13:14:59.085592 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.488574] k3s[836]: I1112 13:14:59.085633 836 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 28.489127] k3s[836]: I1112 13:14:59.085688 836 horizontal.go:204] "Starting HPA controller" machine # [ 28.489559] k3s[836]: I1112 13:14:59.085710 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.492108] k3s[836]: I1112 13:14:59.085802 836 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 28.492695] k3s[836]: I1112 13:14:59.085818 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.493173] k3s[836]: I1112 13:14:59.085860 836 ttl_controller.go:127] "Starting TTL controller" machine # [ 28.493645] k3s[836]: I1112 13:14:59.085884 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.494138] k3s[836]: I1112 13:14:59.085934 836 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 28.494614] k3s[836]: I1112 13:14:59.085957 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.495093] k3s[836]: I1112 13:14:59.085998 836 device_taint_eviction.go:783] "Starting" controller="device-taint-eviction-controller" numWorkers=8 machine # [ 28.495261] k3s[836]: I1112 13:14:59.086068 836 daemon_controller.go:364] "Starting daemon sets controller" machine # [ 28.495728] k3s[836]: I1112 13:14:59.086098 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.496197] k3s[836]: I1112 13:14:59.086214 836 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 28.496698] k3s[836]: I1112 13:14:59.086230 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.497182] k3s[836]: I1112 13:14:59.086312 836 replica_set.go:285] "Starting controller" name="replicationcontroller" machine # [ 28.497661] k3s[836]: I1112 13:14:59.086325 836 job_controller.go:336] "Starting job controller" machine # [ 28.498135] k3s[836]: I1112 13:14:59.086346 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.498619] k3s[836]: I1112 13:14:59.085942 836 node_lifecycle_controller.go:436] "Sending events to api server" machine # [ 28.499095] k3s[836]: I1112 13:14:59.086412 836 node_lifecycle_controller.go:443] "Starting node controller" machine # [ 28.499579] k3s[836]: I1112 13:14:59.086423 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.500058] k3s[836]: I1112 13:14:59.086418 836 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 28.500538] k3s[836]: I1112 13:14:59.086448 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.501021] k3s[836]: I1112 13:14:59.086455 836 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 28.501510] k3s[836]: I1112 13:14:59.086542 836 controller.go:753] "Starting resource claim controller" machine # [ 28.501973] k3s[836]: I1112 13:14:59.086562 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.502613] k3s[836]: I1112 13:14:59.086600 836 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 28.503092] k3s[836]: I1112 13:14:59.086616 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.503250] k3s[836]: I1112 13:14:59.086666 836 device_taint_eviction.go:823] "Sending events to api server" machine # [ 28.503726] k3s[836]: I1112 13:14:59.086690 836 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 28.504194] k3s[836]: I1112 13:14:59.086722 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.504681] k3s[836]: I1112 13:14:59.086761 836 device_taint_eviction.go:1023] "Waiting" for="cache and event handler sync" machine # [ 28.505154] k3s[836]: I1112 13:14:59.086328 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.505645] k3s[836]: I1112 13:14:59.086818 836 graph_builder.go:387] "Running" component="GraphBuilder" machine # [ 28.506125] k3s[836]: I1112 13:14:59.086858 836 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 28.506598] k3s[836]: I1112 13:14:59.086874 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.507084] k3s[836]: I1112 13:14:59.086936 836 stateful_set.go:234] "Starting stateful set controller" machine # [ 28.507571] k3s[836]: I1112 13:14:59.086951 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.508054] k3s[836]: I1112 13:14:59.086981 836 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 28.508536] k3s[836]: I1112 13:14:59.086996 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.508989] k3s[836]: I1112 13:14:59.087001 836 pvc_protection_controller.go:172] "Starting PVC protection controller" machine # [ 28.509640] k3s[836]: I1112 13:14:59.087067 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.510115] k3s[836]: I1112 13:14:59.087126 836 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 28.510599] k3s[836]: I1112 13:14:59.087144 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.511357] k3s[836]: I1112 13:14:59.087232 836 pv_controller_base.go:318] "Starting persistent volume controller" machine # [ 28.511867] k3s[836]: I1112 13:14:59.087265 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.512573] k3s[836]: I1112 13:14:59.097769 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.512977] k3s[836]: I1112 13:14:59.097828 836 gc_controller.go:98] "Starting GC controller" machine # [ 28.513628] k3s[836]: I1112 13:14:59.097848 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.514109] k3s[836]: I1112 13:14:59.097950 836 deployment_controller.go:180] "Starting controller" controller="deployment" machine # [ 28.514590] k3s[836]: I1112 13:14:59.097971 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.515062] k3s[836]: I1112 13:14:59.098110 836 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 28.515550] k3s[836]: I1112 13:14:59.098159 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.516027] k3s[836]: I1112 13:14:59.098192 836 expand_controller.go:328] "Starting expand controller" machine # [ 28.516509] k3s[836]: I1112 13:14:59.098212 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.516969] k3s[836]: I1112 13:14:59.098244 836 disruption.go:453] "Sending events to api server." machine # [ 28.517302] k3s[836]: I1112 13:14:59.098290 836 disruption.go:460] "Starting disruption controller" machine # [ 28.518106] k3s[836]: I1112 13:14:59.098300 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.519071] k3s[836]: I1112 13:14:59.098331 836 clusterroleaggregation_controller.go:176] "Starting ClusterRoleAggregator controller" machine # [ 28.520649] k3s[836]: I1112 13:14:59.098351 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.521618] k3s[836]: I1112 13:14:59.098383 836 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 28.522863] k3s[836]: I1112 13:14:59.098427 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.523961] k3s[836]: I1112 13:14:59.098464 836 controller.go:174] "Starting ephemeral volume controller" machine # [ 28.525095] k3s[836]: I1112 13:14:59.098484 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.526195] k3s[836]: I1112 13:14:59.098512 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.527143] k3s[836]: I1112 13:14:59.098577 836 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 28.528581] k3s[836]: I1112 13:14:59.098596 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.529554] k3s[836]: I1112 13:14:59.098689 836 attach_detach_controller.go:334] "Starting attach detach controller" machine # [ 28.530833] k3s[836]: I1112 13:14:59.098736 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.531940] k3s[836]: I1112 13:14:59.098786 836 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 28.533200] k3s[836]: I1112 13:14:59.098804 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.534490] k3s[836]: I1112 13:14:59.098855 836 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 28.535609] k3s[836]: I1112 13:14:59.098936 836 taint_eviction.go:288] "Sending events to API server" machine # [ 28.536725] k3s[836]: I1112 13:14:59.098946 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.537843] k3s[836]: I1112 13:14:59.101089 836 endpointslice_controller.go:280] "Starting endpoint slice controller" machine # [ 28.539105] k3s[836]: I1112 13:14:59.101108 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.540053] k3s[836]: I1112 13:14:59.103018 836 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 28.541664] k3s[836]: I1112 13:14:59.103067 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.542776] k3s[836]: I1112 13:14:59.103238 836 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 28.581134] k3s[836]: I1112 13:14:59.103254 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.581826] k3s[836]: I1112 13:14:59.103463 836 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 28.582483] k3s[836]: I1112 13:14:59.103478 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.582936] k3s[836]: I1112 13:14:59.103619 836 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.584540] k3s[836]: I1112 13:14:59.104513 836 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.584972] k3s[836]: I1112 13:14:59.104931 836 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.585297] k3s[836]: I1112 13:14:59.108215 836 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.585832] k3s[836]: time="2026-11-12T13:14:59Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.586238] k3s[836]: I1112 13:14:59.151657 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.586720] k3s[836]: I1112 13:14:59.168243 836 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.590100] k3s[836]: I1112 13:14:59.169403 836 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice" machine # [ 28.590775] k3s[836]: I1112 13:14:59.172332 836 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.DeviceClass" machine # [ 28.591234] k3s[836]: I1112 13:14:59.176573 836 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim" machine # [ 28.591728] k3s[836]: I1112 13:14:59.176943 836 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.592212] k3s[836]: I1112 13:14:59.180173 836 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod" machine # [ 28.592691] k3s[836]: I1112 13:14:59.180206 836 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.593173] k3s[836]: I1112 13:14:59.185644 836 shared_informer.go:409] "Caches are synced" machine # [ 28.593653] k3s[836]: I1112 13:14:59.185695 836 shared_informer.go:409] "Caches are synced" machine # [ 28.594137] k3s[836]: I1112 13:14:59.185814 836 shared_informer.go:409] "Caches are synced" machine # [ 28.594622] k3s[836]: I1112 13:14:59.185868 836 shared_informer.go:409] "Caches are synced" machine # [ 28.595105] k3s[836]: I1112 13:14:59.186326 836 shared_informer.go:409] "Caches are synced" machine # [ 28.595578] k3s[836]: I1112 13:14:59.186394 836 shared_informer.go:409] "Caches are synced" machine # [ 28.596057] k3s[836]: I1112 13:14:59.186516 836 shared_informer.go:409] "Caches are synced" machine # [ 28.596535] k3s[836]: I1112 13:14:59.186671 836 shared_informer.go:409] "Caches are synced" machine # [ 28.596989] k3s[836]: I1112 13:14:59.186840 836 shared_informer.go:409] "Caches are synced" machine # [ 28.597640] k3s[836]: I1112 13:14:59.186973 836 shared_informer.go:409] "Caches are synced" machine # [ 28.598119] k3s[836]: I1112 13:14:59.187091 836 shared_informer.go:409] "Caches are synced" machine # [ 28.598598] k3s[836]: I1112 13:14:59.187149 836 shared_informer.go:409] "Caches are synced" machine # [ 28.599077] k3s[836]: I1112 13:14:59.187220 836 shared_informer.go:409] "Caches are synced" machine # [ 28.599572] k3s[836]: I1112 13:14:59.187309 836 range_allocator.go:177] "Sending events to api server" machine # [ 28.600060] k3s[836]: I1112 13:14:59.187350 836 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 28.600545] k3s[836]: I1112 13:14:59.187361 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.604055] k3s[836]: I1112 13:14:59.187373 836 shared_informer.go:409] "Caches are synced" machine # [ 28.604633] k3s[836]: I1112 13:14:59.188129 836 shared_informer.go:409] "Caches are synced" machine # [ 28.605148] k3s[836]: I1112 13:14:59.192179 836 shared_informer.go:409] "Caches are synced" machine # [ 28.605581] k3s[836]: I1112 13:14:59.196082 836 shared_informer.go:409] "Caches are synced" machine # [ 28.606057] k3s[836]: I1112 13:14:59.196357 836 shared_informer.go:409] "Caches are synced" machine # [ 28.606526] k3s[836]: I1112 13:14:59.196783 836 shared_informer.go:409] "Caches are synced" machine # [ 28.606982] k3s[836]: I1112 13:14:59.197132 836 shared_informer.go:409] "Caches are synced" machine # [ 28.607625] k3s[836]: I1112 13:14:59.197393 836 shared_informer.go:409] "Caches are synced" machine # [ 28.608093] k3s[836]: I1112 13:14:59.197494 836 shared_informer.go:409] "Caches are synced" machine # [ 28.608557] k3s[836]: I1112 13:14:59.199191 836 shared_informer.go:409] "Caches are synced" machine # [ 28.609058] k3s[836]: I1112 13:14:59.199327 836 shared_informer.go:409] "Caches are synced" machine # [ 28.609517] k3s[836]: I1112 13:14:59.199383 836 shared_informer.go:409] "Caches are synced" machine # [ 28.609975] k3s[836]: I1112 13:14:59.199443 836 shared_informer.go:409] "Caches are synced" machine # [ 28.610645] k3s[836]: I1112 13:14:59.200208 836 shared_informer.go:409] "Caches are synced" machine # [ 28.611141] k3s[836]: I1112 13:14:59.200252 836 shared_informer.go:409] "Caches are synced" machine # [ 28.611614] k3s[836]: I1112 13:14:59.200323 836 shared_informer.go:409] "Caches are synced" machine # [ 28.612101] k3s[836]: I1112 13:14:59.200356 836 shared_informer.go:409] "Caches are synced" machine # [ 28.612595] k3s[836]: I1112 13:14:59.200969 836 shared_informer.go:409] "Caches are synced" machine # [ 28.613075] k3s[836]: I1112 13:14:59.201011 836 shared_informer.go:409] "Caches are synced" machine # [ 28.613571] k3s[836]: I1112 13:14:59.201098 836 shared_informer.go:409] "Caches are synced" machine # [ 28.614072] k3s[836]: I1112 13:14:59.201134 836 shared_informer.go:409] "Caches are synced" machine # [ 28.614550] k3s[836]: I1112 13:14:59.201169 836 shared_informer.go:409] "Caches are synced" machine # [ 28.615045] k3s[836]: I1112 13:14:59.201228 836 shared_informer.go:409] "Caches are synced" machine # [ 28.615530] k3s[836]: I1112 13:14:59.201374 836 shared_informer.go:409] "Caches are synced" machine # [ 28.615994] k3s[836]: I1112 13:14:59.204160 836 shared_informer.go:409] "Caches are synced" machine # [ 28.616500] k3s[836]: I1112 13:14:59.204459 836 shared_informer.go:409] "Caches are synced" machine # [ 28.616964] k3s[836]: I1112 13:14:59.204563 836 shared_informer.go:409] "Caches are synced" machine # [ 28.617642] k3s[836]: I1112 13:14:59.220299 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.649092] k3s[836]: I1112 13:14:59.252051 836 shared_informer.go:409] "Caches are synced" machine # [ 28.682499] k3s[836]: I1112 13:14:59.285445 836 shared_informer.go:409] "Caches are synced" machine # [ 28.684844] k3s[836]: I1112 13:14:59.287766 836 shared_informer.go:409] "Caches are synced" machine # [ 28.928304] k3s[836]: time="2026-11-12T13:14:59Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 29.113973] k3s[836]: time="2026-11-12T13:14:59Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 29.186395] k3s[836]: I1112 13:14:59.789204 836 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.193881] k3s[836]: I1112 13:14:59.796769 836 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.331221] k3s[836]: I1112 13:14:59.934143 836 controller.go:667] quota admission added evaluator for: replicasets.apps machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.508189] k3s[836]: time="2026-11-12T13:15:00Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.588483] k3s[836]: E1112 13:15:00.190954 836 replica_set.go:640] "Unhandled Error" err="sync \"kube-system/coredns-7cfb7bc9c7\" failed with read version: 350 is not as new as written version: 369 for group resource replicasets.apps" logger="UnhandledError" machine # [ 29.684916] k3s[836]: I1112 13:15:00.287829 836 shared_informer.go:409] "Caches are synced" machine # [ 29.685476] k3s[836]: I1112 13:15:00.287871 836 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 29.685877] k3s[836]: I1112 13:15:00.287893 836 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 29.718700] k3s[836]: I1112 13:15:00.321499 836 shared_informer.go:409] "Caches are synced" machine # [ 29.736291] k3s[836]: time="2026-11-12T13:15:00Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 29.736571] k3s[836]: time="2026-11-12T13:15:00Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 29.737072] k3s[836]: time="2026-11-12T13:15:00Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 29.737515] k3s[836]: time="2026-11-12T13:15:00Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 29.738025] k3s[836]: time="2026-11-12T13:15:00Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 29.738804] k3s[836]: time="2026-11-12T13:15:00Z" level=info msg="Handling backend connection request [machine]" machine # [ 29.739452] k3s[836]: time="2026-11-12T13:15:00Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 29.739880] k3s[836]: time="2026-11-12T13:15:00Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 30.508529] k3s[836]: time="2026-11-12T13:15:01Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.565587] niks3-server[1185]: 2026/11/12 13:15:01 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 30.566073] niks3-server[1185]: 2026/11/12 13:15:01 INFO OIDC authentication enabled config=/nix/store/sm4vz87309i3azg73dm44nb915zdljva-niks3-oidc.json machine # [ 30.567317] niks3-server[1185]: 2026/11/12 13:15:01 INFO Loaded signing key name=farm-test-1 path=/nix/store/i8pw345f2cpx4hsyfpcgqv4nnm329abs-key machine # [ 30.571931] garage[834]: 2026-11-12T13:15:01.173981Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) GET /farm/?location= machine # [ 30.574033] garage[834]: 2026-11-12T13:15:01.176970Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nix-cache-info machine # [ 30.575712] garage[834]: 2026-11-12T13:15:01.178663Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 30.576703] garage[834]: 2026-11-12T13:15:01.179645Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) PUT /farm/nix-cache-info machine # [ 30.579607] garage[834]: 2026-11-12T13:15:01.182339Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) GET /farm/?lifecycle=&withUpdatedAt=true machine # [ 30.580029] niks3-server[1185]: 2026/11/12 13:15:01 WARN Cannot read the bucket lifecycle configuration; incomplete uploads are only removed by niks3 gc. Add an AbortIncompleteMultipartUpload lifecycle rule to the bucket, or set --abort-incomplete-uploads-days=0 to silence this warning bucket=farm error="The specified bucket does not exist." machine # [ 30.582116] niks3-server[1185]: 2026/11/12 13:15:01 INFO Read proxy enabled — serving cache objects from S3 machine # [ 30.583225] niks3-server[1185]: 2026/11/12 13:15:01 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 30.584203] niks3-server[1185]: 2026/11/12 13:15:01 INFO systemd watchdog enabled interval=15s machine # [ 30.584598] niks3-server[1185]: 2026/11/12 13:15:01 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 30.585332] systemd[1]: Started niks3 server. machine # [ 30.585831] systemd[1]: Reached target Multi-User System. machine # [ 30.586525] systemd[1]: Startup finished in 1.097s (kernel) + 3.729s (initrd) + 25.757s (userspace) = 30.584s. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.508401] k3s[836]: time="2026-11-12T13:15:02Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.577732] k3s[836]: time="2026-11-12T13:15:02Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.2.3" machine # [ 31.582278] k3s[836]: time="2026-11-12T13:15:02Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:36cf30f467bfb10cdcbefc149f813e1f876bb6921d25e65640d3179283a28521" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.977056] k3s[836]: time="2026-11-12T13:15:02Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/f8h8xa6ny4ha0i9hvn6ikxncvh7nbg1n-nix-grpc-farm.tar in 5.509227569s" machine # [ 31.982793] k3s[836]: time="2026-11-12T13:15:02Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/k3j8q2lqqzrjgiw30a4mnynw96b6b1ln-nix-grpc-farm-client.tar" machine # [ 32.349281] k3s[836]: time="2026-11-12T13:15:02Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::7c40:6dd5:1fe6:8276 --node-labels= --read-only-port=0" machine # [ 32.360326] k3s[836]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 32.377203] k3s[836]: I1112 13:15:02.980070 836 server.go:541] "Kubelet version" kubeletVersion="v1.36.5+k3s1" machine # [ 32.379886] k3s[836]: I1112 13:15:02.980096 836 server.go:543] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 32.380038] k3s[836]: I1112 13:15:02.980133 836 watchdog_linux.go:94] "Systemd watchdog is not enabled" machine # [ 32.380928] k3s[836]: I1112 13:15:02.980145 836 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 32.381887] k3s[836]: I1112 13:15:02.981487 836 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 32.385229] k3s[836]: I1112 13:15:02.988192 836 server.go:1444] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 32.389749] k3s[836]: I1112 13:15:02.992726 836 server.go:804] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 32.390634] k3s[836]: I1112 13:15:02.992756 836 server.go:865] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 32.391220] k3s[836]: I1112 13:15:02.992919 836 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 32.391797] k3s[836]: I1112 13:15:02.992940 836 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"MemoryReservationPolicy":"None","PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 32.392638] k3s[836]: I1112 13:15:02.993127 836 topology_manager.go:172] "Creating topology manager with none policy" machine # [ 32.393140] k3s[836]: I1112 13:15:02.993143 836 container_manager_linux.go:309] "Creating device plugin manager" machine # [ 32.393751] k3s[836]: I1112 13:15:02.993211 836 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 32.396054] k3s[836]: I1112 13:15:02.999019 836 state_mem.go:45] "Initialized" logger="CPUManager state memory" machine # [ 32.396690] k3s[836]: I1112 13:15:02.999242 836 kubelet.go:485] "Attempting to sync node with API server" machine # [ 32.397413] k3s[836]: I1112 13:15:02.999259 836 kubelet.go:386] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 32.398496] k3s[836]: I1112 13:15:02.999296 836 kubelet.go:397] "Adding apiserver pod source" machine # [ 32.399200] k3s[836]: I1112 13:15:02.999311 836 apiserver.go:41] "Waiting for node sync before watching apiserver pods" machine # [ 32.399893] k3s[836]: I1112 13:15:03.002873 836 kuberuntime_manager.go:308] "Container runtime initialized" containerRuntime="containerd" version="2.3.4-k3s1.36" apiVersion="v1" machine # [ 32.403071] k3s[836]: I1112 13:15:03.004532 836 kubelet.go:1002] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 32.403752] k3s[836]: I1112 13:15:03.004562 836 kubelet.go:1029] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 32.405764] k3s[836]: I1112 13:15:03.008720 836 server.go:1280] "Started kubelet" machine # [ 32.409310] k3s[836]: I1112 13:15:03.012270 836 server.go:193] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 32.410077] k3s[836]: I1112 13:15:03.013058 836 server.go:354] "Adding debug handlers to kubelet server" machine # [ 32.410673] k3s[836]: I1112 13:15:03.013591 836 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 32.411714] k3s[836]: I1112 13:15:03.013641 836 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 32.412629] k3s[836]: I1112 13:15:03.013770 836 server.go:264] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 32.413607] k3s[836]: I1112 13:15:03.014474 836 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 32.414843] k3s[836]: I1112 13:15:03.015480 836 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 32.415751] k3s[836]: I1112 13:15:03.015566 836 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 32.417119] k3s[836]: I1112 13:15:03.019785 836 volume_manager.go:310] "Starting Kubelet Volume Manager" machine # [ 32.418124] k3s[836]: I1112 13:15:03.019936 836 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 32.419224] k3s[836]: I1112 13:15:03.019986 836 reconciler.go:29] "Reconciler: start to sync state" machine # [ 32.420165] k3s[836]: I1112 13:15:03.020813 836 factory.go:222] Registration of the systemd container factory successfully machine # [ 32.420813] k3s[836]: I1112 13:15:03.020906 836 factory.go:220] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 32.421733] k3s[836]: E1112 13:15:03.021582 836 kubelet_node_status.go:396] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 32.422603] k3s[836]: I1112 13:15:03.022365 836 factory.go:222] Registration of the containerd container factory successfully machine # [ 32.426946] k3s[836]: E1112 13:15:03.029922 836 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 32.430563] k3s[836]: E1112 13:15:03.030868 836 kubelet.go:1725] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 32.437578] k3s[836]: E1112 13:15:03.040559 836 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 32.442852] k3s[836]: I1112 13:15:03.045596 836 cpu_manager.go:235] "Starting" policy="none" machine # [ 32.443762] k3s[836]: I1112 13:15:03.045613 836 cpu_manager.go:236] "Reconciling" reconcilePeriod="10s" machine # [ 32.444689] k3s[836]: I1112 13:15:03.045648 836 state_mem.go:45] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 32.447867] k3s[836]: I1112 13:15:03.050843 836 policy_none.go:50] "Start" machine # [ 32.448331] k3s[836]: I1112 13:15:03.050866 836 memory_manager.go:190] "Starting memorymanager" policy="None" machine # [ 32.448924] k3s[836]: I1112 13:15:03.050883 836 state_mem.go:40] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 32.452060] k3s[836]: I1112 13:15:03.053667 836 policy_none.go:44] "Start" machine # [ 32.471746] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 32.483591] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 32.487581] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 32.497218] k3s[836]: E1112 13:15:03.100190 836 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 32.497548] k3s[836]: I1112 13:15:03.100328 836 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 32.497960] k3s[836]: I1112 13:15:03.100347 836 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 32.499042] k3s[836]: I1112 13:15:03.101159 836 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 32.504265] k3s[836]: E1112 13:15:03.107239 836 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 32.505120] k3s[836]: E1112 13:15:03.107280 836 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 32.507128] k3s[836]: time="2026-11-12T13:15:03Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.528177] k3s[836]: E1112 13:15:03.130691 836 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 32.580332] k3s[836]: I1112 13:15:03.183249 836 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv4" machine # [ 32.588590] k3s[836]: I1112 13:15:03.191565 836 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv6" machine # [ 32.590081] k3s[836]: I1112 13:15:03.192138 836 status_manager.go:277] "Starting to sync pod status with apiserver" machine # [ 32.590384] k3s[836]: I1112 13:15:03.192193 836 kubelet.go:2622] "Starting kubelet main sync loop" machine # [ 32.590896] k3s[836]: E1112 13:15:03.192248 836 kubelet.go:2646] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 32.599375] k3s[836]: I1112 13:15:03.202291 836 kubelet_node_status.go:75] "Attempting to register node" node="machine" machine # [ 32.606874] k3s[836]: I1112 13:15:03.209689 836 kubelet_node_status.go:78] "Successfully registered node" node="machine" machine # [ 32.608474] k3s[836]: E1112 13:15:03.209780 836 kubelet_node_status.go:479] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 32.610749] k3s[836]: time="2026-11-12T13:15:03Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 32.612535] k3s[836]: I1112 13:15:03.213414 836 node_controller.go:432] Initializing node machine with cloud provider machine # [ 32.614053] k3s[836]: I1112 13:15:03.213460 836 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 32.616332] k3s[836]: E1112 13:15:03.213479 836 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 32.619118] k3s[836]: I1112 13:15:03.213525 836 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 32.622571] k3s[836]: I1112 13:15:03.218903 836 node_controller.go:432] Initializing node machine with cloud provider machine # [ 32.624325] k3s[836]: I1112 13:15:03.218947 836 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 32.626663] k3s[836]: E1112 13:15:03.218965 836 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 32.630322] k3s[836]: time="2026-11-12T13:15:03Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 32.635212] k3s[836]: time="2026-11-12T13:15:03Z" level=info msg="Starting flannel with backend vxlan" machine # [ 32.636479] k3s[836]: I1112 13:15:03.229297 836 node_controller.go:432] Initializing node machine with cloud provider machine # [ 32.637966] k3s[836]: I1112 13:15:03.230927 836 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 32.639649] k3s[836]: time="2026-11-12T13:15:03Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 32.656214] k3s[836]: time="2026-11-12T13:15:03Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 32.662764] k3s[836]: time="2026-11-12T13:15:03Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 32.664481] k3s[836]: I1112 13:15:03.266559 836 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 32.665818] k3s[836]: I1112 13:15:03.266666 836 kube.go:537] Starting kube subnet manager machine # [ 32.733851] k3s[836]: I1112 13:15:03.336775 836 kuberuntime_manager.go:2172] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 32.736032] k3s[836]: I1112 13:15:03.338001 836 kubelet_network.go:48] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 32.742641] k3s[836]: E1112 13:15:03.345002 836 options.go:205] The manifest file is empty, ignoring. machine # [ 32.743701] k3s[836]: I1112 13:15:03.346675 836 node_controller.go:477] Successfully initialized node machine with cloud provider machine # [ 32.744332] k3s[836]: I1112 13:15:03.347314 836 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 32.749899] k3s[836]: I1112 13:15:03.352865 836 server.go:176] "Starting Kubernetes Scheduler" version="v1.36.5+k3s1" machine # [ 32.750217] k3s[836]: I1112 13:15:03.352888 836 server.go:178] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 32.753067] k3s[836]: I1112 13:15:03.356000 836 secure_serving.go:214] Serving securely on 127.0.0.1:10259 machine # [ 32.753581] k3s[836]: I1112 13:15:03.356000 836 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 32.754523] k3s[836]: I1112 13:15:03.357499 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 32.755899] k3s[836]: I1112 13:15:03.356014 836 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 32.764413] k3s[836]: I1112 13:15:03.356030 836 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 32.764677] k3s[836]: I1112 13:15:03.365182 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 32.765189] k3s[836]: I1112 13:15:03.356002 836 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 32.765703] k3s[836]: I1112 13:15:03.365215 836 shared_informer.go:402] "Waiting for caches to sync" machine # [ 32.766438] k3s[836]: I1112 13:15:03.356089 836 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 32.842171] k3s[836]: I1112 13:15:03.445113 836 kubelet_node_status.go:431] "Fast updating node status as it just became ready" machine # [ 32.851510] k3s[836]: I1112 13:15:03.454407 836 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 32.854618] k3s[836]: I1112 13:15:03.457589 836 shared_informer.go:409] "Caches are synced" machine # [ 32.862293] k3s[836]: I1112 13:15:03.465253 836 shared_informer.go:409] "Caches are synced" machine # [ 32.862665] k3s[836]: I1112 13:15:03.465310 836 shared_informer.go:409] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.056174] k3s[836]: I1112 13:15:03.658804 836 server.go:228] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::7c40:6dd5:1fe6:8276"] machine # [ 33.064717] k3s[836]: E1112 13:15:03.667630 836 server.go:265] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 33.101485] k3s[836]: I1112 13:15:03.704357 836 server.go:274] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 33.102446] k3s[836]: I1112 13:15:03.704435 836 server_linux.go:137] "Using iptables Proxier" machine # [ 33.133431] k3s[836]: I1112 13:15:03.736231 836 proxier.go:241] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 33.149820] k3s[836]: I1112 13:15:03.752725 836 server.go:539] "Version info" version="v1.36.5+k3s1" machine # [ 33.150118] k3s[836]: I1112 13:15:03.752762 836 server.go:541] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.153405] k3s[836]: I1112 13:15:03.756271 836 config.go:200] "Starting service config controller" machine # [ 33.154097] k3s[836]: I1112 13:15:03.756342 836 shared_informer.go:381] "Waiting for caches to sync" controller="service config" machine # [ 33.155075] k3s[836]: I1112 13:15:03.756383 836 config.go:403] "Starting serviceCIDR config controller" machine # [ 33.156065] k3s[836]: I1112 13:15:03.756397 836 shared_informer.go:381] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 33.157070] k3s[836]: I1112 13:15:03.756433 836 config.go:106] "Starting endpoint slice config controller" machine # [ 33.159178] k3s[836]: I1112 13:15:03.757768 836 config.go:309] "Starting node config controller" machine # [ 33.160064] k3s[836]: I1112 13:15:03.757809 836 shared_informer.go:381] "Waiting for caches to sync" controller="node config" machine # [ 33.160853] k3s[836]: I1112 13:15:03.757833 836 shared_informer.go:388] "Caches are synced" controller="node config" machine # [ 33.164375] k3s[836]: I1112 13:15:03.767330 836 shared_informer.go:381] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 33.254358] k3s[836]: I1112 13:15:03.857190 836 shared_informer.go:388] "Caches are synced" controller="serviceCIDR config" machine # [ 33.255080] k3s[836]: I1112 13:15:03.857205 836 shared_informer.go:388] "Caches are synced" controller="service config" machine # [ 33.365742] k3s[836]: I1112 13:15:03.968578 836 shared_informer.go:388] "Caches are synced" controller="endpoint slice config" machine # [ 33.398423] k3s[836]: I1112 13:15:04.001156 836 apiserver.go:51] "Watching apiserver" machine # [ 33.420087] k3s[836]: I1112 13:15:04.020370 836 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 33.420829] k3s[836]: I1112 13:15:04.023732 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6pb4\" (UniqueName: \"kubernetes.io/projected/8ae9a91a-c14a-425e-87d3-77611a84432f-kube-api-access-g6pb4\") pod \"coredns-7cfb7bc9c7-mvmwv\" (UID: \"8ae9a91a-c14a-425e-87d3-77611a84432f\") " pod="kube-system/coredns-7cfb7bc9c7-mvmwv" machine # [ 33.421681] k3s[836]: I1112 13:15:04.023779 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-klipper-helm\") pod \"helm-install-nix-grpc-farm-fm85x\" (UID: \"fee4c6b8-b275-44e3-8596-12338ddd15e0\") " pod="kube-system/helm-install-nix-grpc-farm-fm85x" machine # [ 33.423760] k3s[836]: I1112 13:15:04.023807 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-klipper-cache\") pod \"helm-install-nix-grpc-farm-fm85x\" (UID: \"fee4c6b8-b275-44e3-8596-12338ddd15e0\") " pod="kube-system/helm-install-nix-grpc-farm-fm85x" machine # [ 33.424776] k3s[836]: I1112 13:15:04.023834 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/fee4c6b8-b275-44e3-8596-12338ddd15e0-content\") pod \"helm-install-nix-grpc-farm-fm85x\" (UID: \"fee4c6b8-b275-44e3-8596-12338ddd15e0\") " pod="kube-system/helm-install-nix-grpc-farm-fm85x" machine # [ 33.425657] k3s[836]: I1112 13:15:04.023861 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-klipper-config\") pod \"helm-install-nix-grpc-farm-fm85x\" (UID: \"fee4c6b8-b275-44e3-8596-12338ddd15e0\") " pod="kube-system/helm-install-nix-grpc-farm-fm85x" machine # [ 33.427875] k3s[836]: I1112 13:15:04.023886 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-tmp\") pod \"helm-install-nix-grpc-farm-fm85x\" (UID: \"fee4c6b8-b275-44e3-8596-12338ddd15e0\") " pod="kube-system/helm-install-nix-grpc-farm-fm85x" machine # [ 33.428776] k3s[836]: I1112 13:15:04.023922 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/fee4c6b8-b275-44e3-8596-12338ddd15e0-values\") pod \"helm-install-nix-grpc-farm-fm85x\" (UID: \"fee4c6b8-b275-44e3-8596-12338ddd15e0\") " pod="kube-system/helm-install-nix-grpc-farm-fm85x" machine # [ 33.429672] k3s[836]: I1112 13:15:04.023946 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vglqk\" (UniqueName: \"kubernetes.io/projected/fee4c6b8-b275-44e3-8596-12338ddd15e0-kube-api-access-vglqk\") pod \"helm-install-nix-grpc-farm-fm85x\" (UID: \"fee4c6b8-b275-44e3-8596-12338ddd15e0\") " pod="kube-system/helm-install-nix-grpc-farm-fm85x" machine # [ 33.430529] k3s[836]: I1112 13:15:04.023974 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae9a91a-c14a-425e-87d3-77611a84432f-config-volume\") pod \"coredns-7cfb7bc9c7-mvmwv\" (UID: \"8ae9a91a-c14a-425e-87d3-77611a84432f\") " pod="kube-system/coredns-7cfb7bc9c7-mvmwv" machine # [ 33.431257] k3s[836]: I1112 13:15:04.024002 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae9a91a-c14a-425e-87d3-77611a84432f-custom-config-volume\") pod \"coredns-7cfb7bc9c7-mvmwv\" (UID: \"8ae9a91a-c14a-425e-87d3-77611a84432f\") " pod="kube-system/coredns-7cfb7bc9c7-mvmwv" machine # [ 33.435315] systemd[1]: Created slice libcontainer container kubepods-burstable-podfee4c6b8_b275_44e3_8596_12338ddd15e0.slice. machine # [ 33.477539] systemd[1]: Created slice libcontainer container kubepods-burstable-pod8ae9a91a_c14a_425e_87d3_77611a84432f.slice. machine # [ 33.510140] k3s[836]: time="2026-11-12T13:15:04Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 33.595544] k3s[836]: I1112 13:15:04.197902 836 node_lifecycle_controller.go:1217] "Initializing eviction metric for zone" zone="" machine # [ 33.595853] k3s[836]: I1112 13:15:04.198012 836 node_lifecycle_controller.go:869] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 33.596518] k3s[836]: I1112 13:15:04.198126 836 node_lifecycle_controller.go:1063] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 33.664812] k3s[836]: I1112 13:15:04.267669 836 kube.go:163] Node controller sync successful machine # [ 33.664987] k3s[836]: I1112 13:15:04.267750 836 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 33.667800] k3s[836]: I1112 13:15:04.270725 836 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::7c40:6dd5:1fe6:8276", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::7c40:6dd5:1fe6:8276", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 33.689638] (udev-worker)[1215]: Network interface NamePolicy= disabled on kernel command line. machine # [ 33.695386] k3s[836]: I1112 13:15:04.298150 836 iptables.go:50] Starting flannel in iptables mode... machine # [ 33.695672] k3s[836]: time="2026-11-12T13:15:04Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 33.696162] k3s[836]: time="2026-11-12T13:15:04Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 33.696857] k3s[836]: time="2026-11-12T13:15:04Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 33.697581] k3s[836]: time="2026-11-12T13:15:04Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 33.701082] k3s[836]: I1112 13:15:04.298238 836 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 33.701828] k3s[836]: I1112 13:15:04.304802 836 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 33.731100] dhcpcd[661]: flannel.1: IAID 8b:1e:e6:1c machine # [ 33.732107] dhcpcd[661]: flannel.1: adding address fe80::641f:8bff:fe1e:e61c machine # [ 33.734895] k3s[836]: time="2026-11-12T13:15:04Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 33.755713] k3s[836]: I1112 13:15:04.358653 836 iptables.go:111] Setting up masking rules machine # [ 33.766058] k3s[836]: I1112 13:15:04.368987 836 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 33.774415] k3s[836]: time="2026-11-12T13:15:04Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 33.774699] k3s[836]: time="2026-11-12T13:15:04Z" level=info msg="Running flannel backend" machine # [ 33.775228] k3s[836]: I1112 13:15:04.377417 836 vxlan_network.go:68] watching for new subnet leases machine # [ 33.775721] k3s[836]: I1112 13:15:04.377439 836 vxlan_network.go:115] starting vxlan device watcher machine # [ 33.994008] cni0: port 1(vethc700f5b1) entered blocking state machine # [ 33.994885] cni0: port 1(vethc700f5b1) entered disabled state machine # [ 33.995489] vethc700f5b1: entered allmulticast mode machine # [ 33.996318] vethc700f5b1: entered promiscuous mode machine # [ 33.998077] cni0: port 2(veth1d7b47cf) entered blocking state machine # [ 33.846711] k3s[836]: I1112 1[ 33.999183] cni0: port 2(veth1d7b47cf) entered disabled state machine # 3:15:04.449600 836 iptables.go:358] bootstra[ 34.000428] veth1d7b47cf: entered allmulticast mode machine # p done machine # [ 34.001439] veth1d7b47cf: entered promiscuous mode machine # [ 34.010724] cni0: port 1(vethc700f5b1) entered blocking state machine # [ 34.011480] cni0: port 1(vethc700f5b1) entered forwarding state machine # [ 34.014317] cni0: port 2(veth1d7b47cf) entered blocking state machine # [ 34.015015] cni0: port 2(veth1d7b47cf) entered forwarding state machine # [ 33.888855] k3s[836]: I1112 13:15:04.491812 836 iptables.go:358] bootstrap done machine # [ 33.892785] (udev-worker)[1504]: Network interface NamePolicy= disabled on kernel command line. machine # [ 33.894411] (udev-worker)[1509]: Network interface NamePolicy= disabled on kernel command line. machine # [ 33.896021] (udev-worker)[1508]: Network interface NamePolicy= disabled on kernel command line. machine # [ 33.920200] dhcpcd[661]: vethc700f5b1: IAID 64:9a:8d:55 machine # [ 33.921177] dhcpcd[661]: vethc700f5b1: adding address fe80::7c2f:64ff:fe9a:8d55 machine # [ 33.929200] dhcpcd[661]: veth1d7b47cf: IAID ca:f7:5f:40 machine # [ 33.929602] dhcpcd[661]: veth1d7b47cf: adding address fe80::5865:caff:fef7:5f40 machine # [ 34.065492] systemd[1]: Started libcontainer container be18e6ad9f04cdde63bad4ef922d3adbea28db08377422599e1ee24e7c15df00. machine # [ 34.082484] dhcpcd[661]: veth1d7b47cf: soliciting a DHCP lease machine # [ 34.090327] systemd[1]: Started libcontainer container 52a2ae7dab8f3c6b4351f26dc06e750bc5024df263d84c385fdc60f1939a24fc. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.402588] dhcpcd[661]: flannel.1: soliciting a DHCP lease machine # [ 34.719451] k3s[836]: time="2026-11-12T13:15:05Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.10" machine # [ 34.719601] k3s[836]: I1112 13:15:05.321932 836 network_policy_controller.go:164] Starting network policy controller machine # [ 34.981552] k3s[836]: I1112 13:15:05.584426 836 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 35.078545] systemd[1]: Started libcontainer container 2524c2fa698bef3342227fe951f6cef37b8a088c1da4715d3ff2ae6c24acbf29. machine # [ 35.130081] dhcpcd[661]: vethc700f5b1: soliciting an IPv6 router machine # [ 35.165306] k3s[836]: I1112 13:15:05.768006 836 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-7cfb7bc9c7-mvmwv" podStartSLOduration=5.7679846139999995 podStartE2EDuration="5.767984614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-12 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-12 13:15:05.766001122 +0000 UTC m=+17.846716550" watchObservedRunningTime="2026-11-12 13:15:05.767984614 +0000 UTC m=+17.848699763" machine # [ 35.248429] systemd[1]: Started libcontainer container 11676ff611d9912656db055722f1da0aebff576120fc8e27f2897056f0ad4e18. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.344067] k3s[836]: I1112 13:15:05.943974 836 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-fm85x" podStartSLOduration=6.943952789 podStartE2EDuration="6.943952789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-12 13:14:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-12 13:15:05.94213971 +0000 UTC m=+18.022878046" watchObservedRunningTime="2026-11-12 13:15:05.943952789 +0000 UTC m=+18.024667938" machine # [ 35.687099] dhcpcd[661]: vethc700f5b1: soliciting a DHCP lease machine # [ 35.761424] dhcpcd[661]: veth1d7b47cf: soliciting an IPv6 router machine # [ 35.835241] k3s[836]: I1112 13:15:06.437792 836 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.86.99"} machine # [ 35.883877] systemd[1]: cri-containerd-11676ff611d9912656db055722f1da0aebff576120fc8e27f2897056f0ad4e18.scope: Deactivated successfully. machine # [ 35.886692] systemd[1]: cri-containerd-11676ff611d9912656db055722f1da0aebff576120fc8e27f2897056f0ad4e18.scope: Consumed 565ms CPU time over 635ms wall clock time, 35M memory peak, 2.6M incoming IP traffic, 167.2K outgoing IP traffic. machine # [ 35.935374] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-11676ff611d9912656db055722f1da0aebff576120fc8e27f2897056f0ad4e18-rootfs.mount: Deactivated successfully. machine # [ 35.945125] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2fc8151b_6df9_4eb4_a1c0_d3eea850ba5f.slice. machine # [ 35.973668] systemd[1]: Created slice libcontainer container kubepods-besteffort-poda316198e_7639_4476_a07f_dd00baffe7de.slice. machine # [ 35.988092] systemd[1]: Created slice libcontainer container kubepods-besteffort-podbb73edeb_7065_467f_be27_2129c9fcdecd.slice. machine # [ 36.001069] k3s[836]: E1112 13:15:06.603928 836 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44\" failed with read version: 478 is not as new as written version: 487 for group resource replicasets.apps" logger="UnhandledError" machine # [ 36.026549] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod783c6954_eef0_4e60_bbbe_5bc7640e9bb5.slice. machine # [ 36.034720] k3s[836]: I1112 13:15:06.637686 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/a316198e-7639-4476-a07f-dd00baffe7de-tls-lb\") pod \"nix-grpc-farm-lb-5b4c784fd-pkvkn\" (UID: \"a316198e-7639-4476-a07f-dd00baffe7de\") " pod="farm/nix-grpc-farm-lb-5b4c784fd-pkvkn" machine # [ 36.037944] k3s[836]: I1112 13:15:06.640921 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/bb73edeb-7065-467f-be27-2129c9fcdecd-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c\" (UID: \"bb73edeb-7065-467f-be27-2129c9fcdecd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c" machine # [ 36.039033] k3s[836]: I1112 13:15:06.642001 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/bb73edeb-7065-467f-be27-2129c9fcdecd-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c\" (UID: \"bb73edeb-7065-467f-be27-2129c9fcdecd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c" machine # [ 36.040106] k3s[836]: I1112 13:15:06.643094 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/bb73edeb-7065-467f-be27-2129c9fcdecd-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c\" (UID: \"bb73edeb-7065-467f-be27-2129c9fcdecd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c" machine # [ 36.042069] k3s[836]: I1112 13:15:06.644001 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/2fc8151b-6df9-4eb4-a1c0-d3eea850ba5f-niks3-token\") pod \"nix-grpc-farm-scheduler-7c4c49d5f5-svlwc\" (UID: \"2fc8151b-6df9-4eb4-a1c0-d3eea850ba5f\") " pod="farm/nix-grpc-farm-scheduler-7c4c49d5f5-svlwc" machine # [ 36.042721] k3s[836]: I1112 13:15:06.644183 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzvrh\" (UniqueName: \"kubernetes.io/projected/bb73edeb-7065-467f-be27-2129c9fcdecd-kube-api-access-xzvrh\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c\" (UID: \"bb73edeb-7065-467f-be27-2129c9fcdecd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c" machine # [ 36.043426] k3s[836]: I1112 13:15:06.644216 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/2fc8151b-6df9-4eb4-a1c0-d3eea850ba5f-tls\") pod \"nix-grpc-farm-scheduler-7c4c49d5f5-svlwc\" (UID: \"2fc8151b-6df9-4eb4-a1c0-d3eea850ba5f\") " pod="farm/nix-grpc-farm-scheduler-7c4c49d5f5-svlwc" machine # [ 36.043902] k3s[836]: I1112 13:15:06.644270 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2fc8151b-6df9-4eb4-a1c0-d3eea850ba5f-ca\") pod \"nix-grpc-farm-scheduler-7c4c49d5f5-svlwc\" (UID: \"2fc8151b-6df9-4eb4-a1c0-d3eea850ba5f\") " pod="farm/nix-grpc-farm-scheduler-7c4c49d5f5-svlwc" machine # [ 36.045872] k3s[836]: I1112 13:15:06.644305 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/2fc8151b-6df9-4eb4-a1c0-d3eea850ba5f-oidc\") pod \"nix-grpc-farm-scheduler-7c4c49d5f5-svlwc\" (UID: \"2fc8151b-6df9-4eb4-a1c0-d3eea850ba5f\") " pod="farm/nix-grpc-farm-scheduler-7c4c49d5f5-svlwc" machine # [ 36.046709] k3s[836]: I1112 13:15:06.644331 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7qbd\" (UniqueName: \"kubernetes.io/projected/2fc8151b-6df9-4eb4-a1c0-d3eea850ba5f-kube-api-access-x7qbd\") pod \"nix-grpc-farm-scheduler-7c4c49d5f5-svlwc\" (UID: \"2fc8151b-6df9-4eb4-a1c0-d3eea850ba5f\") " pod="farm/nix-grpc-farm-scheduler-7c4c49d5f5-svlwc" machine # [ 36.047440] k3s[836]: I1112 13:15:06.644364 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a316198e-7639-4476-a07f-dd00baffe7de-tmp\") pod \"nix-grpc-farm-lb-5b4c784fd-pkvkn\" (UID: \"a316198e-7639-4476-a07f-dd00baffe7de\") " pod="farm/nix-grpc-farm-lb-5b4c784fd-pkvkn" machine # [ 36.047973] k3s[836]: I1112 13:15:06.644391 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/bb73edeb-7065-467f-be27-2129c9fcdecd-build\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c\" (UID: \"bb73edeb-7065-467f-be27-2129c9fcdecd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c" machine # [ 36.049714] k3s[836]: I1112 13:15:06.644423 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/bb73edeb-7065-467f-be27-2129c9fcdecd-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c\" (UID: \"bb73edeb-7065-467f-be27-2129c9fcdecd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c" machine # [ 36.051025] k3s[836]: I1112 13:15:06.644451 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bb73edeb-7065-467f-be27-2129c9fcdecd-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c\" (UID: \"bb73edeb-7065-467f-be27-2129c9fcdecd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c" machine # [ 36.096520] k3s[836]: I1112 13:15:06.644483 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/a316198e-7639-4476-a07f-dd00baffe7de-tls-ca\") pod \"nix-grpc-farm-lb-5b4c784fd-pkvkn\" (UID: \"a316198e-7639-4476-a07f-dd00baffe7de\") " pod="farm/nix-grpc-farm-lb-5b4c784fd-pkvkn" machine # [ 36.096994] k3s[836]: I1112 13:15:06.644515 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/bb73edeb-7065-467f-be27-2129c9fcdecd-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c\" (UID: \"bb73edeb-7065-467f-be27-2129c9fcdecd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c" machine # [ 36.097532] k3s[836]: I1112 13:15:06.644546 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/bb73edeb-7065-467f-be27-2129c9fcdecd-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c\" (UID: \"bb73edeb-7065-467f-be27-2129c9fcdecd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c" machine # [ 36.098072] k3s[836]: I1112 13:15:06.644576 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a316198e-7639-4476-a07f-dd00baffe7de-config\") pod \"nix-grpc-farm-lb-5b4c784fd-pkvkn\" (UID: \"a316198e-7639-4476-a07f-dd00baffe7de\") " pod="farm/nix-grpc-farm-lb-5b4c784fd-pkvkn" machine # [ 36.141938] k3s[836]: I1112 13:15:06.744893 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/783c6954-eef0-4e60-bbbe-5bc7640e9bb5-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j\" (UID: \"783c6954-eef0-4e60-bbbe-5bc7640e9bb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j" machine # [ 36.143499] k3s[836]: I1112 13:15:06.746465 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/783c6954-eef0-4e60-bbbe-5bc7640e9bb5-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j\" (UID: \"783c6954-eef0-4e60-bbbe-5bc7640e9bb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j" machine # [ 36.144121] k3s[836]: I1112 13:15:06.746514 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/783c6954-eef0-4e60-bbbe-5bc7640e9bb5-build\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j\" (UID: \"783c6954-eef0-4e60-bbbe-5bc7640e9bb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j" machine # [ 36.144601] k3s[836]: I1112 13:15:06.746618 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/783c6954-eef0-4e60-bbbe-5bc7640e9bb5-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j\" (UID: \"783c6954-eef0-4e60-bbbe-5bc7640e9bb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j" machine # [ 36.145137] k3s[836]: I1112 13:15:06.746685 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/783c6954-eef0-4e60-bbbe-5bc7640e9bb5-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j\" (UID: \"783c6954-eef0-4e60-bbbe-5bc7640e9bb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j" machine # [ 36.145668] k3s[836]: I1112 13:15:06.746719 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/783c6954-eef0-4e60-bbbe-5bc7640e9bb5-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j\" (UID: \"783c6954-eef0-4e60-bbbe-5bc7640e9bb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j" machine # [ 36.146205] k3s[836]: I1112 13:15:06.746817 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/783c6954-eef0-4e60-bbbe-5bc7640e9bb5-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j\" (UID: \"783c6954-eef0-4e60-bbbe-5bc7640e9bb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j" machine # [ 36.146700] k3s[836]: I1112 13:15:06.746870 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/783c6954-eef0-4e60-bbbe-5bc7640e9bb5-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j\" (UID: \"783c6954-eef0-4e60-bbbe-5bc7640e9bb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j" machine # [ 36.147226] k3s[836]: I1112 13:15:06.746893 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dhj6\" (UniqueName: \"kubernetes.io/projected/783c6954-eef0-4e60-bbbe-5bc7640e9bb5-kube-api-access-6dhj6\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j\" (UID: \"783c6954-eef0-4e60-bbbe-5bc7640e9bb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j" machine # [ 36.498207] cni0: port 3(vethe8cf0c32) entered blocking state machine # [ 36.499107] cni0: port 3(vethe8cf0c32) entered disabled state machine # [ 36.500196] vethe8cf0c32: entered allmulticast mode machine # [ 36.501243] vethe8cf0c32: entered promiscuous mode machine # [ 36.521245] cni0: port 3(vethe8cf0c32) entered blocking state machine # [ 36.521928] cni0: port 3(vethe8cf0c32) entered forwarding state machine # [ 36.524837] cni0: port 4(vethd2c025bf) entered blocking state machine # [ 36.525496] cni0: port 4(vethd2c025bf) entered disabled state machine # [ 36.526304] vethd2c025bf: entered allmulticast mode machine # [ 36.527052] vethd2c025bf: entered promiscuous mode machine # [ 36.534463] cni0: port 4(vethd2c025bf) entered blocking state machine # [ 36.535157] cni0: port 4(vethd2c025bf) entered forwarding state machine # [ 36.405780] dhcpcd[661]: vethe8cf0c32: waiting for carrier machine # [ 36.427692] dhcpcd[661]: vethd2c025bf: IAID 4c:61:b5:a9 machine # [ 36.428651] dhcpcd[661]: vethd2c025bf: adding address fe80::78c7:4cff:fe61:b5a9 machine # [ 36.429478] dhcpcd[661]: vethd2c025bf: old hardware address: 7a:c7:4c:61:b5:a9 machine # [ 36.429746] dhcpcd[661]: vethd2c025bf: new hardware address: de:5b:bf:a3:9d:db machine # [ 36.430480] dhcpcd[661]: vethd2c025bf: carrier lost machine # [ 36.465329] dhcpcd[661]: vethd2c025bf: deleting address fe80::78c7:4cff:fe61:b5a9 machine # [ 36.465547] dhcpcd[661]: vethd2c025bf: old hardware address: de:5b:bf:a3:9d:db machine # [ 36.466093] dhcpcd[661]: vethd2c025bf: new hardware address: 7a:c7:4c:61:b5:a9 machine # [ 36.466853] dhcpcd[661]: vethe8cf0c32: carrier acquired machine # [ 36.477458] dhcpcd[661]: vethe8cf0c32: IAID f1:9e:1f:69 machine # [ 36.478481] dhcpcd[661]: vethe8cf0c32: adding address fe80::1c06:f1ff:fe9e:1f69 machine # [ 36.478954] dhcpcd[661]: vethd2c025bf: carrier acquired machine # [ 36.487877] dhcpcd[661]: vethd2c025bf: IAID 4c:61:b5:a9 machine # [ 36.488667] dhcpcd[661]: vethd2c025bf: adding address fe80::78c7:4cff:fe61:b5a9 machine # [ 36.682777] cni0: port 5(veth2ec99ffd) entered blocking state machine # [ 36.683440] cni0: port 5(veth2ec99ffd) entered disabled state machine # [ 36.684134] veth2ec99ffd: entered allmulticast mode machine # [ 36.684943] veth2ec99ffd: entered promiscuous mode machine # [ 36.541718] dhcpcd[661]: flannel.1: soliciting an IPv6 router machine # [ 36.711136] cni0: port 6(veth5ef9135b) entered blocking state machine # [ 36.712628] cni0: port 6(veth5ef9135b) entered disabled state machine # [ 36.713413] veth5ef9135b: entered allmulticast mode machine # [ 36.714528] veth5ef9135b: entered promiscuous mode machine # [ 36.718189] cni0: port 5(veth2ec99ffd) entered blocking state machine # [ 36.718882] cni0: port 5(veth2ec99ffd) entered forwarding state machine # [ 36.582670] dhcpcd[661]: veth2ec99ffd: waiting for carrier machine # [ 36.584987] systemd[1]: Started libcontainer container d4534f27808764e1bb2a148f97663dae3575c14bbada1fbc50ded52783f81981. machine # [ 36.738540] cni0: port 6(veth5ef9135b) entered blocking state machine # [ 36.739239] cni0: port 6(veth5ef9135b) entered forwarding state machine # [ 36.605605] systemd[1]: Started libcontainer container 78de720d2bf7006a39ea1e2af92eb0af9f8039315b1b89f9899a587e3c6a5b77. machine # [ 36.627238] dhcpcd[661]: veth5ef9135b: waiting for carrier machine # [ 36.627658] dhcpcd[661]: veth5ef9135b: old hardware address: 7a:f3:ad:f1:42:50 machine # [ 36.628144] dhcpcd[661]: veth5ef9135b: new hardware address: 56:ec:85:fb:22:22 machine # [ 36.628613] dhcpcd[661]: veth2ec99ffd: carrier acquired machine # [ 36.641376] dhcpcd[661]: veth2ec99ffd: IAID b1:77:59:38 machine # [ 36.641701] dhcpcd[661]: veth2ec99ffd: adding address fe80::28a8:b1ff:fe77:5938 machine # [ 36.646048] dhcpcd[661]: veth5ef9135b: carrier acquired machine # [ 36.652609] dhcpcd[661]: veth5ef9135b: IAID 85:fb:22:22 machine # [ 36.653206] dhcpcd[661]: veth5ef9135b: adding address fe80::54ec:85ff:fefb:2222 machine # [ 36.776325] systemd[1]: Started libcontainer container 137130e525d0f9de864ced55081ca2f6ed17d41f4d18efcf8f6a3141da484273. machine # [ 36.799485] systemd[1]: Started libcontainer container fecc21f8e339c5f9110a03dec74fdc5a2c4a494321bd76a97258df272e2076ec. machine # [ 37.137823] dhcpcd[661]: veth2ec99ffd: soliciting a DHCP lease machine # [ 37.660501] systemd[1]: cri-containerd-52a2ae7dab8f3c6b4351f26dc06e750bc5024df263d84c385fdc60f1939a24fc.scope: Deactivated successfully. machine # [ 37.734486] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-52a2ae7dab8f3c6b4351f26dc06e750bc5024df263d84c385fdc60f1939a24fc-rootfs.mount: Deactivated successfully. machine # [ 37.737762] dhcpcd[661]: veth5ef9135b: soliciting a DHCP lease machine # [ 37.985350] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-52a2ae7dab8f3c6b4351f26dc06e750bc5024df263d84c385fdc60f1939a24fc-shm.mount: Deactivated successfully. machine # [ 38.174658] cni0: port 2(veth1d7b47cf) entered disabled state machine # [ 38.023122] dhcpcd[661]: veth1d7b47cf: carrier lost machine # [ 38.176535] veth1d7b47cf (unregistering): left allmulticast mode machine # [ 38.177449] veth1d7b47cf (unregistering): left promiscuous mode machine # [ 38.178375] cni0: port 2(veth1d7b47cf) entered disabled state machine # [ 38.050348] systemd[1]: Started libcontainer container 0ad3614c336ff2681ec410bb03d0f2e505f0ac86c63e405351cd080bef97ca9f. machine # [ 38.056296] systemd[1]: run-netns-cni\x2d0eb7f306\x2dd8af\x2dba01\x2d8764\x2db976abeb2328.mount: Deactivated successfully. machine # [ 38.075270] dhcpcd[661]: veth1d7b47cf: deleting address fe80::5865:caff:fef7:5f40 machine # [ 38.118443] dhcpcd[661]: veth1d7b47cf: removing interface machine # [ 38.165432] k3s[836]: I1112 13:15:08.768116 836 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-klipper-cache\") pod \"fee4c6b8-b275-44e3-8596-12338ddd15e0\" (UID: \"fee4c6b8-b275-44e3-8596-12338ddd15e0\") " machine # [ 38.175898] k3s[836]: I1112 13:15:08.768162 836 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fee4c6b8-b275-44e3-8596-12338ddd15e0-content\" (UniqueName: \"kubernetes.io/configmap/fee4c6b8-b275-44e3-8596-12338ddd15e0-content\") pod \"fee4c6b8-b275-44e3-8596-12338ddd15e0\" (UID: \"fee4c6b8-b275-44e3-8596-12338ddd15e0\") " machine # [ 38.181211] k3s[836]: I1112 13:15:08.768188 836 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-tmp\" (UniqueName: \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-tmp\") pod \"fee4c6b8-b275-44e3-8596-12338ddd15e0\" (UID: \"fee4c6b8-b275-44e3-8596-12338ddd15e0\") " machine # [ 38.185724] k3s[836]: I1112 13:15:08.768222 836 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-klipper-config\") pod \"fee4c6b8-b275-44e3-8596-12338ddd15e0\" (UID: \"fee4c6b8-b275-44e3-8596-12338ddd15e0\") " machine # [ 38.191095] k3s[836]: I1112 13:15:08.768248 836 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fee4c6b8-b275-44e3-8596-12338ddd15e0-values\" (UniqueName: \"kubernetes.io/projected/fee4c6b8-b275-44e3-8596-12338ddd15e0-values\") pod \"fee4c6b8-b275-44e3-8596-12338ddd15e0\" (UID: \"fee4c6b8-b275-44e3-8596-12338ddd15e0\") " machine # [ 38.196577] k3s[836]: I1112 13:15:08.768281 836 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fee4c6b8-b275-44e3-8596-12338ddd15e0-kube-api-access-vglqk\" (UniqueName: \"kubernetes.io/projected/fee4c6b8-b275-44e3-8596-12338ddd15e0-kube-api-access-vglqk\") pod \"fee4c6b8-b275-44e3-8596-12338ddd15e0\" (UID: \"fee4c6b8-b275-44e3-8596-12338ddd15e0\") " machine # [ 38.201908] k3s[836]: I1112 13:15:08.768307 836 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-klipper-helm\") pod \"fee4c6b8-b275-44e3-8596-12338ddd15e0\" (UID: \"fee4c6b8-b275-44e3-8596-12338ddd15e0\") " machine # [ 38.207054] k3s[836]: I1112 13:15:08.777223 836 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fee4c6b8-b275-44e3-8596-12338ddd15e0-content" pod "fee4c6b8-b275-44e3-8596-12338ddd15e0" (UID: "fee4c6b8-b275-44e3-8596-12338ddd15e0"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 38.207599] k3s[836]: I1112 13:15:08.777367 836 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-klipper-helm" pod "fee4c6b8-b275-44e3-8596-12338ddd15e0" (UID: "fee4c6b8-b275-44e3-8596-12338ddd15e0"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 38.208229] k3s[836]: I1112 13:15:08.778307 836 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-klipper-cache" pod "fee4c6b8-b275-44e3-8596-12338ddd15e0" (UID: "fee4c6b8-b275-44e3-8596-12338ddd15e0"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 38.209255] k3s[836]: I1112 13:15:08.778663 836 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fee4c6b8-b275-44e3-8596-12338ddd15e0-kube-api-access-vglqk" pod "fee4c6b8-b275-44e3-8596-12338ddd15e0" (UID: "fee4c6b8-b275-44e3-8596-12338ddd15e0"). InnerVolumeSpecName "kube-api-access-vglqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 38.209991] k3s[836]: I1112 13:15:08.778987 836 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-klipper-config" pod "fee4c6b8-b275-44e3-8596-12338ddd15e0" (UID: "fee4c6b8-b275-44e3-8596-12338ddd15e0"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 38.210838] systemd[1]: var-lib-kubelet-pods-fee4c6b8\x2db275\x2d44e3\x2d8596\x2d12338ddd15e0-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 38.211620] k3s[836]: I1112 13:15:08.788955 836 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fee4c6b8-b275-44e3-8596-12338ddd15e0-values" pod "fee4c6b8-b275-44e3-8596-12338ddd15e0" (UID: "fee4c6b8-b275-44e3-8596-12338ddd15e0"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 38.212159] k3s[836]: I1112 13:15:08.789789 836 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-tmp" pod "fee4c6b8-b275-44e3-8596-12338ddd15e0" (UID: "fee4c6b8-b275-44e3-8596-12338ddd15e0"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 38.212824] systemd[1]: var-lib-kubelet-pods-fee4c6b8\x2db275\x2d44e3\x2d8596\x2d12338ddd15e0-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 38.221425] dhcpcd[661]: vethe8cf0c32: soliciting a DHCP lease machine # [ 38.266201] k3s[836]: I1112 13:15:08.868924 836 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 38.266744] k3s[836]: I1112 13:15:08.868956 836 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/fee4c6b8-b275-44e3-8596-12338ddd15e0-values\") on node \"machine\" DevicePath \"\"" machine # [ 38.267520] k3s[836]: I1112 13:15:08.868972 836 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vglqk\" (UniqueName: \"kubernetes.io/projected/fee4c6b8-b275-44e3-8596-12338ddd15e0-kube-api-access-vglqk\") on node \"machine\" DevicePath \"\"" machine # [ 38.268100] k3s[836]: I1112 13:15:08.868987 836 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 38.268805] k3s[836]: I1112 13:15:08.869000 836 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 38.269725] k3s[836]: I1112 13:15:08.869012 836 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/fee4c6b8-b275-44e3-8596-12338ddd15e0-content\") on node \"machine\" DevicePath \"\"" machine # [ 38.270448] k3s[836]: I1112 13:15:08.869025 836 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fee4c6b8-b275-44e3-8596-12338ddd15e0-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 38.380659] dhcpcd[661]: veth2ec99ffd: soliciting an IPv6 router machine # [ 38.386076] k3s[836]: I1112 13:15:08.988936 836 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5b4c784fd-pkvkn" podStartSLOduration=2.98891381 podStartE2EDuration="2.98891381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-12 13:15:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-12 13:15:08.743581513 +0000 UTC m=+20.824296662" watchObservedRunningTime="2026-11-12 13:15:08.98891381 +0000 UTC m=+21.069628959" machine # [ 38.419919] dhcpcd[661]: vethd2c025bf: soliciting an IPv6 router machine # [ 38.422141] dhcpcd[661]: vethd2c025bf: soliciting a DHCP lease machine # [ 38.599963] dhcpcd[661]: vethe8cf0c32: soliciting an IPv6 router machine # [ 38.600756] systemd[1]: Removed slice libcontainer container kubepods-burstable-podfee4c6b8_b275_44e3_8596_12338ddd15e0.slice. machine # [ 38.601305] systemd[1]: kubepods-burstable-podfee4c6b8_b275_44e3_8596_12338ddd15e0.slice: Consumed 601ms CPU time over 5.163s wall clock time, 35.2M memory peak, 2.6M incoming IP traffic, 167.2K outgoing IP traffic. machine # [ 38.632483] k3s[836]: I1112 13:15:09.235382 836 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52a2ae7dab8f3c6b4351f26dc06e750bc5024df263d84c385fdc60f1939a24fc" machine # [ 38.633315] k3s[836]: E1112 13:15:09.235413 836 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee4c6b8_b275_44e3_8596_12338ddd15e0.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee4c6b8_b275_44e3_8596_12338ddd15e0.slice/memory.max: no such file or directory" podName="helm-install-nix-grpc-farm-fm85x" machine # [ 38.635816] k3s[836]: E1112 13:15:09.235513 836 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee4c6b8_b275_44e3_8596_12338ddd15e0.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee4c6b8_b275_44e3_8596_12338ddd15e0.slice/cpu.max: no such file or directory" podName="helm-install-nix-grpc-farm-fm85x" machine # [ 38.636765] k3s[836]: I1112 13:15:09.235532 836 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" machine # [ 38.985493] systemd[1]: var-lib-kubelet-pods-fee4c6b8\x2db275\x2d44e3\x2d8596\x2d12338ddd15e0-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dvglqk.mount: Deactivated successfully. machine # [ 38.985993] systemd[1]: var-lib-kubelet-pods-fee4c6b8\x2db275\x2d44e3\x2d8596\x2d12338ddd15e0-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 38.986411] systemd[1]: var-lib-kubelet-pods-fee4c6b8\x2db275\x2d44e3\x2d8596\x2d12338ddd15e0-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 38.987036] systemd[1]: var-lib-kubelet-pods-fee4c6b8\x2db275\x2d44e3\x2d8596\x2d12338ddd15e0-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 39.212723] dhcpcd[661]: veth5ef9135b: soliciting an IPv6 router machine # [ 39.402854] dhcpcd[661]: flannel.1: probing for an IPv4LL address machine # [ 40.624031] k3s[836]: time="2026-11-12T13:15:11Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.2.3" machine # [ 40.641069] k3s[836]: time="2026-11-12T13:15:11Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:7112ee8d97b4a92a59095656577c45f1af47e274fb0c68c66e697269bd3e073c" machine # [ 40.687595] dhcpcd[661]: vethc700f5b1: probing for an IPv4LL address machine # [ 41.623163] k3s[836]: time="2026-11-12T13:15:12Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/k3j8q2lqqzrjgiw30a4mnynw96b6b1ln-nix-grpc-farm-client.tar in 9.645713071s" machine # [ 42.139221] dhcpcd[661]: veth2ec99ffd: probing for an IPv4LL address machine # [ 42.738535] dhcpcd[661]: veth5ef9135b: probing for an IPv4LL address machine # [ 42.915573] systemd[1]: Started libcontainer container e0abf880b366165e05606c4dcc1a06d4ea018d320f3485bdc7396bb8a38abd12. machine # [ 42.969580] systemd[1]: tmp-ovl\x2didmapped1404937579.mount: Deactivated successfully. machine # [ 42.990069] systemd[1]: Started libcontainer container a16e735a2beac31ebb1eb98c7403c059202368f6a83bceb2a3ed05061d744049. machine # [ 43.045702] systemd[1]: Started libcontainer container 3b67dac6ea5787450ddbec1623a2563ee8aef7e8b8df6fbf1dab217334f3e6fc. machine # [ 43.074367] niks3-server[1185]: 2026/11/12 13:15:13 INFO lead: acquired remote=10.42.0.4:49492 machine # [ 43.107638] k3s[836]: I1112 13:15:13.710240 836 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-7c4c49d5f5-svlwc" podStartSLOduration=7.710216936 podStartE2EDuration="7.710216936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-12 13:15:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-12 13:15:13.595471068 +0000 UTC m=+25.676186496" watchObservedRunningTime="2026-11-12 13:15:13.710216936 +0000 UTC m=+25.790932085" machine # [ 43.224340] dhcpcd[661]: vethe8cf0c32: probing for an IPv4LL address machine # [ 43.422688] dhcpcd[661]: vethd2c025bf: probing for an IPv4LL address machine # [ 43.601445] systemd[1]: cri-containerd-3b67dac6ea5787450ddbec1623a2563ee8aef7e8b8df6fbf1dab217334f3e6fc.scope: Deactivated successfully. machine # [ 43.602315] systemd[1]: cri-containerd-3b67dac6ea5787450ddbec1623a2563ee8aef7e8b8df6fbf1dab217334f3e6fc.scope: Consumed 452ms CPU time over 556ms wall clock time, 307.8M memory peak, 6.8M read from disk, 137.9M written to disk. machine # [ 43.606318] systemd[1]: cri-containerd-a16e735a2beac31ebb1eb98c7403c059202368f6a83bceb2a3ed05061d744049.scope: Deactivated successfully. machine # [ 43.607844] systemd[1]: cri-containerd-a16e735a2beac31ebb1eb98c7403c059202368f6a83bceb2a3ed05061d744049.scope: Consumed 466ms CPU time over 617ms wall clock time, 313.4M memory peak, 19.8M read from disk, 260.8M written to disk. machine # [ 43.893783] systemd[1]: tmp-ovl\x2didmapped1508566931.mount: Deactivated successfully. machine # [ 43.895063] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a16e735a2beac31ebb1eb98c7403c059202368f6a83bceb2a3ed05061d744049-rootfs.mount: Deactivated successfully. machine # [ 44.058284] dhcpcd[661]: flannel.1: using IPv4LL address 169.254.64.163 machine # [ 44.059323] dhcpcd[661]: flannel.1: adding route to 169.254.0.0/16 machine # [ 44.802034] systemd[1]: tmp-ovl\x2didmapped112401224.mount: Deactivated successfully. machine # [ 44.819299] systemd[1]: Started libcontainer container 1b26f768f0a8c9db673d9a7051fe6bb6e82569c1e5bab8919442b739bfce58c2. machine # [ 44.890304] systemd[1]: Started libcontainer container 6e307515f9baf97d9bef016b65ea5b9aa6c6b1194603f073d0cd7ac654aefd48. machine # [ 44.964495] systemd[1]: tmp-ovl\x2didmapped2186918509.mount: Deactivated successfully. machine # [ 44.981233] systemd[1]: Started libcontainer container 89f6814a3f2d47d3cfad6a2f08018d54792f866ec6ce5828e9e0ea4a7ad8bae7. machine # [ 45.047846] systemd[1]: Started libcontainer container cc28b3ac505028f706219af10b40712a94b379335841bf99fe2f0a05b7cb5520. machine # [ 45.166563] systemd[1]: Started libcontainer container 7be3a7ee58956f197457d5b90d056472b43e5c46bfd0a55794fe9319a6229435. machine # [ 45.212826] dhcpcd[661]: vethc700f5b1: using IPv4LL address 169.254.24.1 machine # [ 45.213484] dhcpcd[661]: vethc700f5b1: adding route to 169.254.0.0/16 machine # [ 45.240630] k3s[836]: I1112 13:15:15.843285 836 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c" podStartSLOduration=9.277069147 podStartE2EDuration="9.843253397s" totalImagesPullingTime="0s" totalInitContainerRuntime="566.18425ms" isStatefulPod=false podCreationTimestamp="2026-11-12 13:15:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-12 13:15:15.842083975 +0000 UTC m=+27.922799124" watchObservedRunningTime="2026-11-12 13:15:15.843253397 +0000 UTC m=+27.923968546" machine # [ 45.247462] systemd[1]: Started libcontainer container bd81b2f15ff3393c9180d21743568ac35ccf8451b6bfb419e9542b497526e54f. machine # [ 45.311628] k3s[836]: I1112 13:15:15.914549 836 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j" podStartSLOduration=9.423718792 podStartE2EDuration="9.91452726s" totalImagesPullingTime="0s" totalInitContainerRuntime="490.808468ms" isStatefulPod=false podCreationTimestamp="2026-11-12 13:15:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-12 13:15:15.913717381 +0000 UTC m=+27.994432809" watchObservedRunningTime="2026-11-12 13:15:15.91452726 +0000 UTC m=+27.995242689" machine # error: timed out waiting for the condition machine # [ 47.134428] dhcpcd[661]: vethc700f5b1: no IPv6 Routers available machine # [ 47.888432] dhcpcd[661]: veth2ec99ffd: using IPv4LL address 169.254.193.204 machine # [ 47.888928] dhcpcd[661]: veth2ec99ffd: adding route to 169.254.0.0/16 machine # [ 48.154899] dhcpcd[661]: veth5ef9135b: using IPv4LL address 169.254.86.172 machine # [ 48.156151] dhcpcd[661]: veth5ef9135b: adding route to 169.254.0.0/16 machine # [ 48.452852] dhcpcd[661]: vethd2c025bf: using IPv4LL address 169.254.147.116 machine # [ 48.453764] dhcpcd[661]: vethd2c025bf: adding route to 169.254.0.0/16 machine # [ 48.543898] dhcpcd[661]: flannel.1: no IPv6 Routers available machine # [ 48.916612] dhcpcd[661]: vethe8cf0c32: using IPv4LL address 169.254.208.129 machine # [ 48.917690] dhcpcd[661]: vethe8cf0c32: adding route to 169.254.0.0/16 machine # [ 50.382856] dhcpcd[661]: veth2ec99ffd: no IPv6 Routers available machine # [ 50.421735] dhcpcd[661]: vethd2c025bf: no IPv6 Routers available machine # [ 50.604228] dhcpcd[661]: vethe8cf0c32: no IPv6 Routers available machine # [ 51.215431] dhcpcd[661]: veth5ef9135b: no IPv6 Routers available machine # error: timed out waiting for the condition [60.73s] machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 32.78 seconds) [60.73s] machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s [60.88s] machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.15 seconds) [60.88s] machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s [61.03s] machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.15 seconds) [61.03s] machine: waiting for unit niks3.service [61.07s] machine: (finished: waiting for unit niks3.service, in 0.04 seconds) [61.07s] machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' [61.20s] machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.13 seconds) [61.20s] machine: waiting for success: test $(curl -sf 10.42.0.5:9901/stats/prometheus | grep -v '^#' | grep '^envoy_cluster_membership_healthy' | grep -v 'envoy_cluster_name="admin"' | awk '{s+=$2} END {print s+0}') -ge 3 [71.91s] machine: (finished: waiting for success: test $(curl -sf 10.42.0.5:9901/stats/prometheus | grep -v '^#' | grep '^envoy_cluster_membership_healthy' | grep -v 'envoy_cluster_name="admin"' | awk '{s+=$2} END {print s+0}') -ge 3, in 10.71 seconds) [71.91s] machine: must fail: curl -sf 10.42.0.5:9901/clusters [71.95s] machine: (finished: must fail: curl -sf 10.42.0.5:9901/clusters, in 0.05 seconds) [71.95s] machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' [72.17s] machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.21 seconds) [72.17s] machine: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' [72.22s] machine: (finished: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.05 seconds) [72.22s] (finished: subtest: chart deploys and workers become Ready, in 44.27 seconds) [72.22s] machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' [72.40s] machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.18 seconds) [72.40s] machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt [72.56s] machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.16 seconds) [72.56s] subtest: build through the balancer lands in the cache [72.56s] machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zbdavbwghh5fi44cpdq7rn5xz10ifqfn-job.nix --argstr tag t1 2>&1 machine # [ 79.914358] garage[834]: 2026-11-12T13:15:50.516593Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nix-cache-info machine # [ 79.918452] garage[834]: 2026-11-12T13:15:50.521356Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) GET /farm/nix-cache-info machine # [ 103.932510] garage[834]: 2026-11-12T13:16:14.533963Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 103.932902] garage[834]: 2026-11-12T13:16:14.534666Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 103.935938] garage[834]: 2026-11-12T13:16:14.536601Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 103.937403] garage[834]: 2026-11-12T13:16:14.537001Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 103.938904] garage[834]: 2026-11-12T13:16:14.538104Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 103.940547] garage[834]: 2026-11-12T13:16:14.538531Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 103.969935] garage[834]: 2026-11-12T13:16:14.572842Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 103.971161] garage[834]: 2026-11-12T13:16:14.573350Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 103.973477] garage[834]: 2026-11-12T13:16:14.576402Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 103.975354] garage[834]: 2026-11-12T13:16:14.576817Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 103.997956] garage[834]: 2026-11-12T13:16:14.600868Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/nix-cache-info machine # [ 104.002913] garage[834]: 2026-11-12T13:16:14.605841Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) GET /farm/nix-cache-info machine # [ 128.627438] garage[834]: 2026-11-12T13:16:39.229596Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 128.628073] garage[834]: 2026-11-12T13:16:39.230209Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 128.630579] garage[834]: 2026-11-12T13:16:39.233442Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 128.632577] garage[834]: 2026-11-12T13:16:39.233995Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 128.638791] garage[834]: 2026-11-12T13:16:39.241692Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 128.640869] garage[834]: 2026-11-12T13:16:39.242148Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 128.642432] garage[834]: 2026-11-12T13:16:39.244783Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 128.643580] garage[834]: 2026-11-12T13:16:39.245255Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 128.653115] garage[834]: 2026-11-12T13:16:39.254713Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 128.655804] garage[834]: 2026-11-12T13:16:39.255335Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 128.657466] garage[834]: 2026-11-12T13:16:39.257315Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 128.658923] garage[834]: 2026-11-12T13:16:39.257587Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 128.660509] garage[834]: 2026-11-12T13:16:39.257757Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 128.662075] garage[834]: 2026-11-12T13:16:39.258004Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 128.795327] niks3-server[1185]: 2026/11/12 13:16:39 INFO Received push request method=POST path=/api/pushes machine # [ 128.806388] garage[834]: 2026-11-12T13:16:39.409141Z INFO garage_api_common::generic_server: 10.42.0.6:55540 PUT /farm/nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131639Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1bf17e30d341ad8c8afde7c8758d810dc090cbe6224eddc32914b2944c0d8bc2 machine # [ 128.812771] garage[834]: 2026-11-12T13:16:39.415645Z INFO garage_api_common::generic_server: 10.42.0.6:55544 PUT /farm/yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131639Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c3059377ef3d581e5972fd3130fa088ef66928e38aa48c58e74f9a447bdb842c machine # [ 128.814842] garage[834]: 2026-11-12T13:16:39.417806Z INFO garage_api_common::generic_server: 10.42.0.6:55552 PUT /farm/nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131639Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f1f3f1923def302b7ad1a3169f72a511bbfe24c912ec2cf4820d15f9f5c86e2e machine # [ 128.816170] garage[834]: 2026-11-12T13:16:39.418920Z INFO garage_api_common::generic_server: 10.42.0.6:55554 PUT /farm/nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131639Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d4fed0c4a0ff3bfa50f518125296eae0bf0d54bbaaaf1eef6b37445a51589c72 machine # [ 128.817889] garage[834]: 2026-11-12T13:16:39.419690Z INFO garage_api_common::generic_server: 10.42.0.6:55540 PUT /farm/n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131639Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d156fe596f2a27e4a26c62025434ba6cc4a33ba6df28c7024d7b34002126b9e2 machine # [ 128.818571] garage[834]: 2026-11-12T13:16:39.421177Z INFO garage_api_common::generic_server: 10.42.0.6:55570 PUT /farm/zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131639Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a1e4c3fe192880b05771f794a1196045813ecbe859d69fd80b9a9d1d2a7b9c75 machine # [ 128.820674] garage[834]: 2026-11-12T13:16:39.421873Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 128.824270] garage[834]: 2026-11-12T13:16:39.427255Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 128.826827] garage[834]: 2026-11-12T13:16:39.429803Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 128.828062] garage[834]: 2026-11-12T13:16:39.430760Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 128.853693] niks3-server[1185]: 2026/11/12 13:16:39 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 128.854648] niks3-server[1185]: 2026/11/12 13:16:39 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 128.857223] niks3-server[1185]: 2026/11/12 13:16:39 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 128.858952] niks3-server[1185]: 2026/11/12 13:16:39 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 128.860815] niks3-server[1185]: 2026/11/12 13:16:39 INFO Signed narinfos id=1 count=3 machine # [ 128.862241] garage[834]: 2026-11-12T13:16:39.465190Z INFO garage_api_common::generic_server: 10.42.0.6:55544 PUT /farm/yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131639Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6e42f1f47650425e3a76422afe6988daf97d8faa671b85fcceea8c19f970bf04 machine # [ 128.868047] garage[834]: 2026-11-12T13:16:39.467432Z INFO garage_api_common::generic_server: 10.42.0.6:55552 PUT /farm/n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131639Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6d5523c6fa769e4f5f800a6dba32790693646b2be2bba2fe10a736543e840f16 machine # [ 128.873664] garage[834]: 2026-11-12T13:16:39.467643Z INFO garage_api_common::generic_server: 10.42.0.6:55570 PUT /farm/zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131639Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5108f2fe8abd543708c831667e1d132e578e9ce20a9cde03364837cc9c6fe98d machine # [ 128.879133] garage[834]: 2026-11-12T13:16:39.467695Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 128.882099] garage[834]: 2026-11-12T13:16:39.469456Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 128.882379] garage[834]: 2026-11-12T13:16:39.469781Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 128.882974] garage[834]: 2026-11-12T13:16:39.470095Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 128.883815] niks3-server[1185]: 2026/11/12 13:16:39 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 128.884523] niks3-server[1185]: 2026/11/12 13:16:39 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 128.885030] niks3-server[1185]: 2026/11/12 13:16:39 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 128.885752] niks3-server[1185]: 2026/11/12 13:16:39 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 128.886484] niks3-server[1185]: 2026/11/12 13:16:39 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 128.886994] niks3-server[1185]: 2026/11/12 13:16:39 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 128.887559] niks3-server[1185]: 2026/11/12 13:16:39 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 128.888306] garage[834]: 2026-11-12T13:16:39.482724Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 128.888833] niks3-server[1185]: 2026/11/12 13:16:39 INFO Completed push id=1 objects=9 duration=5.172725ms machine # [ 157.319826] garage[834]: 2026-11-12T13:17:07.922084Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 157.320287] garage[834]: 2026-11-12T13:17:07.922641Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 157.323660] garage[834]: 2026-11-12T13:17:07.926541Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 157.325694] garage[834]: 2026-11-12T13:17:07.926944Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 157.641379] niks3-server[1185]: 2026/11/12 13:17:08 INFO Received push request method=POST path=/api/pushes machine # [ 157.646471] garage[834]: 2026-11-12T13:17:08.248004Z INFO garage_api_common::generic_server: 10.42.0.6:55570 PUT /farm/log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131708Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ad76762c8f6b76cdddb5a6e68bf3673745f179658becd93e217555af4a7d8686 machine # [ 157.659377] garage[834]: 2026-11-12T13:17:08.248748Z INFO garage_api_common::generic_server: 10.42.0.6:55544 PUT /farm/r95r891injj9ski5c4w89yxjvjy065mx.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131708Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=560659af86aed04d6fa983cae7c8d81d086485845f40e30905c39a4f30a343dd machine # [ 157.670895] garage[834]: 2026-11-12T13:17:08.248891Z INFO garage_api_common::generic_server: 10.42.0.6:55552 PUT /farm/nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131708Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=975e0eea403c12ede53f190f8bcb6e60fd60bb2a5bf02b2a82464d4c61fea00d machine # [ 157.683171] garage[834]: 2026-11-12T13:17:08.250922Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 157.689084] garage[834]: 2026-11-12T13:17:08.252830Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 157.694443] garage[834]: 2026-11-12T13:17:08.254871Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 157.699267] garage[834]: 2026-11-12T13:17:08.255752Z INFO garage_api_common::generic_server: 10.42.0.6:55570 PUT /farm/r95r891injj9ski5c4w89yxjvjy065mx.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131708Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f9b653952ed6b56d75de87f83413f96e4f59577c012205a065c801666b8bbe71 machine # [ 157.708746] garage[834]: 2026-11-12T13:17:08.259354Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 157.712462] niks3-server[1185]: 2026/11/12 13:17:08 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 157.714063] niks3-server[1185]: 2026/11/12 13:17:08 INFO Signed narinfos id=2 count=1 machine # [ 157.715182] niks3-server[1185]: 2026/11/12 13:17:08 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 157.716830] niks3-server[1185]: 2026/11/12 13:17:08 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 157.718810] niks3-server[1185]: 2026/11/12 13:17:08 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 157.720448] niks3-server[1185]: 2026/11/12 13:17:08 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 157.722180] niks3-server[1185]: 2026/11/12 13:17:08 INFO Completed push id=2 objects=4 duration=3.771988ms machine # [ 157.723585] niks3-server[1185]: 2026/11/12 13:17:08 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 182.007305] garage[834]: 2026-11-12T13:17:32.609474Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 182.013803] garage[834]: 2026-11-12T13:17:32.610021Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 182.020146] garage[834]: 2026-11-12T13:17:32.622999Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 182.020851] garage[834]: 2026-11-12T13:17:32.623479Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 182.196782] niks3-server[1185]: 2026/11/12 13:17:32 INFO Received push request method=POST path=/api/pushes machine # [ 182.203515] garage[834]: 2026-11-12T13:17:32.806422Z INFO garage_api_common::generic_server: 10.42.0.6:55570 PUT /farm/nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131732Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9d74f5b3b9db5ea7d076f44e47a32417e4856ed609cc6bed0e5582c8f8896f21 machine # [ 182.216437] garage[834]: 2026-11-12T13:17:32.807250Z INFO garage_api_common::generic_server: 10.42.0.6:55544 PUT /farm/mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131732Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=19244cada57dd59b316a1ce4bb520d29e359ea2f469519903502db8b8682c667 machine # [ 182.228623] garage[834]: 2026-11-12T13:17:32.807322Z INFO garage_api_common::generic_server: 10.42.0.6:55552 PUT /farm/log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131732Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1eb81774b9bbc7b4e938a4e784fea12498619c5890332ce1fb984406e475c873 machine # [ 182.238631] garage[834]: 2026-11-12T13:17:32.811876Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 182.243767] garage[834]: 2026-11-12T13:17:32.812795Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 182.248564] garage[834]: 2026-11-12T13:17:32.813117Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 182.252303] garage[834]: 2026-11-12T13:17:32.813416Z INFO garage_api_common::generic_server: 10.42.0.6:55552 PUT /farm/mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131732Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f35587c0463d962669140a1f7ff92c5f258440b89fffe6f31790c5821afaa768 machine # [ 182.257953] niks3-server[1185]: 2026/11/12 13:17:32 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 182.259588] niks3-server[1185]: 2026/11/12 13:17:32 INFO Signed narinfos id=3 count=1 machine # [ 182.260719] niks3-server[1185]: 2026/11/12 13:17:32 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 182.262668] niks3-server[1185]: 2026/11/12 13:17:32 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 182.264206] niks3-server[1185]: 2026/11/12 13:17:32 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 182.265808] niks3-server[1185]: 2026/11/12 13:17:32 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 182.267569] niks3-server[1185]: 2026/11/12 13:17:32 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 182.269338] niks3-server[1185]: 2026/11/12 13:17:32 INFO Completed push id=3 objects=8 duration=6.500268ms machine # [ 182.270740] garage[834]: 2026-11-12T13:17:32.817760Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 207.049132] garage[834]: 2026-11-12T13:17:57.651167Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 207.055472] garage[834]: 2026-11-12T13:17:57.651753Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 207.060219] garage[834]: 2026-11-12T13:17:57.661416Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 207.066224] garage[834]: 2026-11-12T13:17:57.661835Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 207.359203] niks3-server[1185]: 2026/11/12 13:17:57 INFO Received push request method=POST path=/api/pushes machine # [ 207.368277] garage[834]: 2026-11-12T13:17:57.970541Z INFO garage_api_common::generic_server: 10.42.0.6:55570 PUT /farm/log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131757Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c5eb44c88f27c80906a11f73a33873cded4101a995dc1cbbcfe7c7910c72f873 machine # [ 207.378099] garage[834]: 2026-11-12T13:17:57.970613Z INFO garage_api_common::generic_server: 10.42.0.6:55552 PUT /farm/nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131757Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91f276d360f7d0eb834b8b4ad81c79c0675c524efbbb5763008d10fdab7703de machine # [ 207.385721] garage[834]: 2026-11-12T13:17:57.970732Z INFO garage_api_common::generic_server: 10.42.0.6:55544 PUT /farm/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131757Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ded07797cd93ce318cbb6448a96b307cd0a434d8535a2c037118dd07bedf9c1e machine # [ 207.391345] garage[834]: 2026-11-12T13:17:57.977305Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 207.394020] garage[834]: 2026-11-12T13:17:57.977970Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 207.396803] garage[834]: 2026-11-12T13:17:57.978539Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 207.399838] garage[834]: 2026-11-12T13:17:57.981026Z INFO garage_api_common::generic_server: 10.42.0.6:55544 PUT /farm/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131757Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=749d572d27fb4dd350f62c0d15d32defb5393f1f6fe4b515ae090f067841a56b machine # [ 207.405218] garage[834]: 2026-11-12T13:17:57.987678Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 207.407951] niks3-server[1185]: 2026/11/12 13:17:57 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 207.409544] niks3-server[1185]: 2026/11/12 13:17:57 INFO Signed narinfos id=4 count=1 machine # [ 207.410653] niks3-server[1185]: 2026/11/12 13:17:57 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 207.412311] niks3-server[1185]: 2026/11/12 13:17:57 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 207.414073] niks3-server[1185]: 2026/11/12 13:17:57 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 207.416066] niks3-server[1185]: 2026/11/12 13:17:57 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 207.417746] niks3-server[1185]: 2026/11/12 13:17:57 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 207.419483] niks3-server[1185]: 2026/11/12 13:17:57 INFO Completed push id=4 objects=12 duration=5.206248ms [208.46s] machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zbdavbwghh5fi44cpdq7rn5xz10ifqfn-job.nix --argstr tag t1 2>&1, in 135.90 seconds) [208.46s] machine: must succeed: nix eval --raw -f /nix/store/zbdavbwghh5fi44cpdq7rn5xz10ifqfn-job.nix --argstr tag t1 outPath [208.58s] machine: (finished: must succeed: nix eval --raw -f /nix/store/zbdavbwghh5fi44cpdq7rn5xz10ifqfn-job.nix --argstr tag t1 outPath, in 0.13 seconds) [208.58s] machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top [208.59s] machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) [208.59s] machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # [ 207.727958] garage[834]: 2026-11-12T13:17:58.330836Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/nix-cache-info machine # [ 207.730486] garage[834]: 2026-11-12T13:17:58.332115Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) GET /farm/nix-cache-info machine # [ 207.732841] garage[834]: 2026-11-12T13:17:58.335468Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 207.735774] garage[834]: 2026-11-12T13:17:58.338741Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 207.739040] garage[834]: 2026-11-12T13:17:58.341985Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 207.741737] garage[834]: 2026-11-12T13:17:58.343077Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) GET /farm/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 207.744424] garage[834]: 2026-11-12T13:17:58.346021Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 207.747076] garage[834]: 2026-11-12T13:17:58.347009Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 207.749795] garage[834]: 2026-11-12T13:17:58.347988Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) GET /farm/r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # copying 3 paths... machine # [ 207.752745] garage[834]: 2026-11-12T13:17:58.348164Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) GET /farm/mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # [ 207.756697] garage[834]: 2026-11-12T13:17:58.359669Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 207.759661] garage[834]: 2026-11-12T13:17:58.360597Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) GET /farm/nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # [ 207.764309] garage[834]: 2026-11-12T13:17:58.367283Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine # [ 207.768466] garage[834]: 2026-11-12T13:17:58.367966Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) GET /farm/nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 207.771477] garage[834]: 2026-11-12T13:17:58.371553Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 207.774625] garage[834]: 2026-11-12T13:17:58.372629Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) GET /farm/nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst [208.81s] machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.21 seconds) [208.81s] machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zbdavbwghh5fi44cpdq7rn5xz10ifqfn-job.nix --argstr tag t2 2>&1 machine # [ 207.944324] garage[834]: 2026-11-12T13:17:58.547262Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine # [ 207.944926] garage[834]: 2026-11-12T13:17:58.547915Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 207.946081] garage[834]: 2026-11-12T13:17:58.548938Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 207.946840] garage[834]: 2026-11-12T13:17:58.549534Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 207.947951] garage[834]: 2026-11-12T13:17:58.549780Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 207.949137] garage[834]: 2026-11-12T13:17:58.550184Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 207.979465] garage[834]: 2026-11-12T13:17:58.582267Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine # [ 207.980147] garage[834]: 2026-11-12T13:17:58.582506Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 207.981641] garage[834]: 2026-11-12T13:17:58.584570Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine # [ 207.982783] garage[834]: 2026-11-12T13:17:58.584745Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 207.986995] garage[834]: 2026-11-12T13:17:58.589935Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 207.988270] garage[834]: 2026-11-12T13:17:58.590138Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 207.990374] garage[834]: 2026-11-12T13:17:58.593309Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 207.991880] garage[834]: 2026-11-12T13:17:58.593705Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 207.996438] garage[834]: 2026-11-12T13:17:58.599401Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 207.997260] garage[834]: 2026-11-12T13:17:58.599712Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 207.998938] garage[834]: 2026-11-12T13:17:58.601911Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 207.999972] garage[834]: 2026-11-12T13:17:58.602272Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 208.006635] garage[834]: 2026-11-12T13:17:58.609089Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 208.007522] garage[834]: 2026-11-12T13:17:58.609303Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 208.008047] garage[834]: 2026-11-12T13:17:58.609407Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 208.008566] garage[834]: 2026-11-12T13:17:58.609486Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 208.009099] garage[834]: 2026-11-12T13:17:58.609555Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 208.009646] garage[834]: 2026-11-12T13:17:58.610003Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 208.077657] niks3-server[1185]: 2026/11/12 13:17:58 INFO Received push request method=POST path=/api/pushes machine # [ 208.086346] garage[834]: 2026-11-12T13:17:58.688164Z INFO garage_api_common::generic_server: 10.42.0.6:55552 PUT /farm/nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131758Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2aade5824c31cf0bee416cdc810758efe29b878b79b93a0d5b0a54292b1f0d28 machine # [ 208.086466] garage[834]: 2026-11-12T13:17:58.688223Z INFO garage_api_common::generic_server: 10.42.0.6:55544 PUT /farm/nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131758Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2e6e70c8d93379fd476dbc8a99c9addd7c8a8d99d99b82faffb05b69ff9b332b machine # [ 208.086937] garage[834]: 2026-11-12T13:17:58.688717Z INFO garage_api_common::generic_server: 10.42.0.6:55570 PUT /farm/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131758Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1255f3d769a19b83dd81c924deaeb55b550548bfdba65aa832bc59abd38362a3 machine # [ 208.087636] garage[834]: 2026-11-12T13:17:58.688936Z INFO garage_api_common::generic_server: 10.42.0.6:55554 PUT /farm/nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131758Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31c70b49543e019376e6aa93ff57eb1fe490ccf214aa97954ec7b428e4e27052 machine # [ 208.089722] garage[834]: 2026-11-12T13:17:58.689023Z INFO garage_api_common::generic_server: 10.42.0.6:55552 PUT /farm/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131758Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=42bd29314c8631b8a3060d530337fa32c149964c1c954f67c50973e66318baa9 machine # [ 208.091157] garage[834]: 2026-11-12T13:17:58.694116Z INFO garage_api_common::generic_server: 10.42.0.6:55552 PUT /farm/894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131758Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dab1b3bdc2dd428384fa083cee4450a44212ab1c1c2aa42f177b62a45c0db424 machine # [ 208.092526] garage[834]: 2026-11-12T13:17:58.694767Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 208.093606] garage[834]: 2026-11-12T13:17:58.695765Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 208.094475] garage[834]: 2026-11-12T13:17:58.696124Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 208.095033] garage[834]: 2026-11-12T13:17:58.697350Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 208.095575] niks3-server[1185]: 2026/11/12 13:17:58 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 208.096221] garage[834]: 2026-11-12T13:17:58.698089Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 208.096721] niks3-server[1185]: 2026/11/12 13:17:58 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 208.097439] niks3-server[1185]: 2026/11/12 13:17:58 INFO Signed narinfos id=5 count=3 machine # [ 208.098032] niks3-server[1185]: 2026/11/12 13:17:58 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 208.098547] garage[834]: 2026-11-12T13:17:58.700193Z INFO garage_api_common::generic_server: 10.42.0.6:55554 PUT /farm/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131758Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5339644bf2f18598a61841d405d1740bce744679f3944701b3b02d6b5bdf3ae6 machine # [ 208.099437] garage[834]: 2026-11-12T13:17:58.700361Z INFO garage_api_common::generic_server: 10.42.0.6:55552 PUT /farm/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131758Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5be26de8a75eaf13f43db5ad01501fb8398751c8d06a646e3bb9c87cda673a0e machine # [ 208.143159] garage[834]: 2026-11-12T13:17:58.700597Z INFO garage_api_common::generic_server: 10.42.0.6:55570 PUT /farm/894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131758Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3cebe42f4c750ef93dd70fa1ee6d982eebb4d7f06cd5f1f8a4af236f05f101bd machine # [ 208.143913] garage[834]: 2026-11-12T13:17:58.701905Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 208.144421] garage[834]: 2026-11-12T13:17:58.705831Z INFO garage_api_common::generic_server: 192.168.1.1:48576 (key GK0123456789abcdef01234567) HEAD /farm/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 208.144938] garage[834]: 2026-11-12T13:17:58.706669Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 208.145656] garage[834]: 2026-11-12T13:17:58.707407Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 208.146305] niks3-server[1185]: 2026/11/12 13:17:58 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 208.146960] niks3-server[1185]: 2026/11/12 13:17:58 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 208.147669] niks3-server[1185]: 2026/11/12 13:17:58 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 208.148393] niks3-server[1185]: 2026/11/12 13:17:58 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 208.149475] niks3-server[1185]: 2026/11/12 13:17:58 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 208.149976] niks3-server[1185]: 2026/11/12 13:17:58 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 208.150719] niks3-server[1185]: 2026/11/12 13:17:58 INFO Completed push id=5 objects=9 duration=5.378896ms machine # [ 208.151232] niks3-server[1185]: 2026/11/12 13:17:58 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 208.151810] niks3-server[1185]: 2026/11/12 13:17:58 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 208.180100] garage[834]: 2026-11-12T13:17:58.783058Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 208.183147] garage[834]: 2026-11-12T13:17:58.786120Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) GET /farm/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 208.186414] garage[834]: 2026-11-12T13:17:58.789145Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 208.187173] garage[834]: 2026-11-12T13:17:58.790132Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) GET /farm/nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 232.302118] garage[834]: 2026-11-12T13:18:22.904304Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 232.302740] garage[834]: 2026-11-12T13:18:22.904846Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 232.315803] garage[834]: 2026-11-12T13:18:22.918682Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 232.322652] garage[834]: 2026-11-12T13:18:22.925559Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 232.558918] niks3-server[1185]: 2026/11/12 13:18:23 INFO Received push request method=POST path=/api/pushes machine # [ 232.572749] garage[834]: 2026-11-12T13:18:23.175657Z INFO garage_api_common::generic_server: 10.42.0.7:54924 PUT /farm/log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131823Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a275ab38e35d3c0682f666c4c383572b10de8d55bea0bedfb622bb9c905771c2 machine # [ 232.586644] garage[834]: 2026-11-12T13:18:23.178356Z INFO garage_api_common::generic_server: 10.42.0.7:54916 PUT /farm/nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131823Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1a445636bf98c932e3015c3e0058ea17902bcf5bc569d366c8eb61f86d425799 machine # [ 232.609142] garage[834]: 2026-11-12T13:18:23.178996Z INFO garage_api_common::generic_server: 10.42.0.7:54926 PUT /farm/r1wl8yi1c55jrx53153rpsk307x9c14q.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131823Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bbb7ccd0b83c0d3f131e87ec1164f426686579315fa90435409830d444df48ac machine # [ 232.617184] garage[834]: 2026-11-12T13:18:23.181376Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 232.619882] garage[834]: 2026-11-12T13:18:23.183014Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 232.622798] garage[834]: 2026-11-12T13:18:23.184341Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 232.629354] garage[834]: 2026-11-12T13:18:23.186836Z INFO garage_api_common::generic_server: 10.42.0.7:54916 PUT /farm/r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131823Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=903e13707c8e490fc6c8ccd96a80a8996546ed6ea017f6288ef9cf893cd6ab99 machine # [ 232.629703] niks3-server[1185]: 2026/11/12 13:18:23 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 232.630170] niks3-server[1185]: 2026/11/12 13:18:23 INFO Signed narinfos id=6 count=1 machine # [ 232.630315] niks3-server[1185]: 2026/11/12 13:18:23 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 232.630841] niks3-server[1185]: 2026/11/12 13:18:23 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 232.631572] niks3-server[1185]: 2026/11/12 13:18:23 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 232.632137] niks3-server[1185]: 2026/11/12 13:18:23 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 232.632643] niks3-server[1185]: 2026/11/12 13:18:23 INFO Completed push id=6 objects=4 duration=3.839594ms machine # [ 232.633177] niks3-server[1185]: 2026/11/12 13:18:23 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 232.633763] garage[834]: 2026-11-12T13:18:23.190863Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 232.634457] garage[834]: 2026-11-12T13:18:23.219228Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 232.634943] garage[834]: 2026-11-12T13:18:23.219880Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) GET /farm/894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 232.635313] garage[834]: 2026-11-12T13:18:23.222488Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 232.635840] garage[834]: 2026-11-12T13:18:23.223137Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) GET /farm/nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 257.034772] garage[834]: 2026-11-12T13:18:47.637148Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 257.035153] garage[834]: 2026-11-12T13:18:47.637699Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 257.047677] garage[834]: 2026-11-12T13:18:47.650601Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 257.054089] garage[834]: 2026-11-12T13:18:47.656963Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 257.359214] niks3-server[1185]: 2026/11/12 13:18:47 INFO Received push request method=POST path=/api/pushes machine # [ 257.369358] garage[834]: 2026-11-12T13:18:47.972224Z INFO garage_api_common::generic_server: 10.42.0.7:54916 PUT /farm/log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131847Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1c55191b9e5956aac41bae02ea64e07a2f21b574102edfb18b17c2eeec83c6fb machine # [ 257.370439] garage[834]: 2026-11-12T13:18:47.973345Z INFO garage_api_common::generic_server: 10.42.0.7:54926 PUT /farm/nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131847Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=119f588897fcd34676ed2b8f2d2b224f31138d32dbf5166f5c0bd45817edf3ea machine # [ 257.374156] garage[834]: 2026-11-12T13:18:47.976878Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 257.376326] garage[834]: 2026-11-12T13:18:47.977591Z INFO garage_api_common::generic_server: 10.42.0.7:54926 PUT /farm/zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131847Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8734274074ff406a1fac47801f18a0171e582bf909d6404213f781556014145e machine # [ 257.377633] niks3-server[1185]: 2026/11/12 13:18:47 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 257.414919] niks3-server[1185]: 2026/11/12 13:18:48 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 257.418231] niks3-server[1185]: 2026/11/12 13:18:48 INFO Signed narinfos id=7 count=1 machine # [ 257.420405] garage[834]: 2026-11-12T13:18:48.016997Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 257.420963] garage[834]: 2026-11-12T13:18:48.017693Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 257.422520] garage[834]: 2026-11-12T13:18:48.018830Z INFO garage_api_common::generic_server: 10.42.0.7:54926 PUT /farm/zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131847Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a5edd3030074aa500671fe2cae713c56946d1c8375f0c7dbecd74255691fc554 machine # [ 257.425201] garage[834]: 2026-11-12T13:18:48.022823Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 257.426454] niks3-server[1185]: 2026/11/12 13:18:48 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 257.427601] niks3-server[1185]: 2026/11/12 13:18:48 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 257.428412] niks3-server[1185]: 2026/11/12 13:18:48 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 257.429270] niks3-server[1185]: 2026/11/12 13:18:48 INFO Completed push id=7 objects=8 duration=4.60282ms machine # [ 257.430052] niks3-server[1185]: 2026/11/12 13:18:48 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 257.453731] garage[834]: 2026-11-12T13:18:48.056684Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 257.454593] garage[834]: 2026-11-12T13:18:48.057558Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) GET /farm/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 257.461317] garage[834]: 2026-11-12T13:18:48.064291Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 257.462043] garage[834]: 2026-11-12T13:18:48.064996Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) GET /farm/nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 282.011295] garage[834]: 2026-11-12T13:19:12.613488Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine # [ 282.011861] garage[834]: 2026-11-12T13:19:12.613983Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 282.026177] garage[834]: 2026-11-12T13:19:12.628998Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine # [ 282.032570] garage[834]: 2026-11-12T13:19:12.629568Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 282.172168] niks3-server[1185]: 2026/11/12 13:19:12 INFO Received push request method=POST path=/api/pushes machine # [ 282.177899] garage[834]: 2026-11-12T13:19:12.780827Z INFO garage_api_common::generic_server: 10.42.0.7:54926 PUT /farm/log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131912Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d876ef0269ddc00088a076ab0fc5d0abce0b8577b300107ef5a38188116a44ab machine # [ 282.183759] garage[834]: 2026-11-12T13:19:12.786595Z INFO garage_api_common::generic_server: 10.42.0.7:54924 PUT /farm/5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131912Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a021e32f5b28b797ed711d2db5ab0bccd4ea5477f3ae4ee5e6b36127e22f762f machine # [ 282.184463] garage[834]: 2026-11-12T13:19:12.786635Z INFO garage_api_common::generic_server: 10.42.0.7:54916 PUT /farm/nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131912Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8416c25fd848e903cc9fa29952aca5959518e6235aac3f6db08743c45fb9ec57 machine # [ 282.197211] niks3-server[1185]: 2026/11/12 13:19:12 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 282.198310] niks3-server[1185]: 2026/11/12 13:19:12 INFO Signed narinfos id=8 count=1 machine # [ 282.199214] garage[834]: 2026-11-12T13:19:12.801264Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 282.200581] garage[834]: 2026-11-12T13:19:12.801564Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 282.201749] garage[834]: 2026-11-12T13:19:12.802671Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 282.202884] niks3-server[1185]: 2026/11/12 13:19:12 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 282.204787] garage[834]: 2026-11-12T13:19:12.805264Z INFO garage_api_common::generic_server: 10.42.0.7:54916 PUT /farm/5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131912Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b22043925f48866a6227608234c9ee32cc992339373eef0407061cf86ad0e37d machine # [ 282.205855] garage[834]: 2026-11-12T13:19:12.807450Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine # [ 282.206911] niks3-server[1185]: 2026/11/12 13:19:12 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 282.207820] niks3-server[1185]: 2026/11/12 13:19:12 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 282.208912] niks3-server[1185]: 2026/11/12 13:19:12 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 282.209875] niks3-server[1185]: 2026/11/12 13:19:12 INFO Completed push id=8 objects=12 duration=2.2176ms machine # [ 282.212290] niks3-server[1185]: 2026/11/12 13:19:12 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo [283.26s] machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zbdavbwghh5fi44cpdq7rn5xz10ifqfn-job.nix --argstr tag t2 2>&1, in 74.45 seconds) [283.26s] (finished: subtest: build through the balancer lands in the cache, in 210.70 seconds) [283.26s] subtest: a Job with the client image builds through the farm with its service account [283.26s] machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt [283.40s] machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt, in 0.14 seconds) [283.40s] machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/zbdavbwghh5fi44cpdq7rn5xz10ifqfn-job.nix --from-file=flake.nix=/nix/store/778ca1ra8vvl785z4cc3gz3jybkgs9s2-flake.nix [283.54s] machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/zbdavbwghh5fi44cpdq7rn5xz10ifqfn-job.nix --from-file=flake.nix=/nix/store/778ca1ra8vvl785z4cc3gz3jybkgs9s2-flake.nix, in 0.14 seconds) [283.54s] machine: must succeed: kubectl apply -f /nix/store/9jfvfdfszc4ggil0lymlnslf6x1d0bki-ci-job.json [283.69s] machine: (finished: must succeed: kubectl apply -f /nix/store/9jfvfdfszc4ggil0lymlnslf6x1d0bki-ci-job.json, in 0.15 seconds) [283.69s] machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 282.711572] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod65969460_b34a_4409_81d1_27d82a911771.slice. machine # [ 282.757093] k3s[836]: I1112 13:19:13.359750 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/65969460-b34a-4409-81d1-27d82a911771-job\") pod \"ci-8nm4k\" (UID: \"65969460-b34a-4409-81d1-27d82a911771\") " pod="ci/ci-8nm4k" machine # [ 282.757279] k3s[836]: I1112 13:19:13.359801 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/65969460-b34a-4409-81d1-27d82a911771-nix-grpc-farm\") pod \"ci-8nm4k\" (UID: \"65969460-b34a-4409-81d1-27d82a911771\") " pod="ci/ci-8nm4k" machine # [ 282.757803] k3s[836]: I1112 13:19:13.359831 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb7zd\" (UniqueName: \"kubernetes.io/projected/65969460-b34a-4409-81d1-27d82a911771-kube-api-access-bb7zd\") pod \"ci-8nm4k\" (UID: \"65969460-b34a-4409-81d1-27d82a911771\") " pod="ci/ci-8nm4k" machine # [ 283.206197] cni0: port 2(vetha09340a7) entered blocking state machine # [ 283.206972] cni0: port 2(vetha09340a7) entered disabled state machine # [ 283.208191] vetha09340a7: entered allmulticast mode machine # [ 283.209291] vetha09340a7: entered promiscuous mode machine # [ 283.219068] cni0: port 2(vetha09340a7) entered blocking state machine # [ 283.219956] cni0: port 2(vetha09340a7) entered forwarding state machine # [ 283.121869] (udev-worker)[7340]: Network interface NamePolicy= disabled on kernel command line. machine # [ 283.149315] dhcpcd[661]: vetha09340a7: IAID bf:d6:83:41 machine # [ 283.149673] dhcpcd[661]: vetha09340a7: adding address fe80::ac26:bfff:fed6:8341 machine # [ 283.160286] systemd[1]: Started libcontainer container 35e18fa9540dc6e2de22a291318753ca5571d075f583539bd97b442c8a1ed1ae. machine # [ 283.559254] dhcpcd[661]: vetha09340a7: soliciting a DHCP lease machine # [ 284.999536] dhcpcd[661]: vetha09340a7: soliciting an IPv6 router machine # [ 285.094601] systemd[1]: Started libcontainer container 0baf5233090b47cb519987f174219a30c264c907033ac80a35a023bee5c10975. machine # [ 285.156061] k3s[836]: I1112 13:19:15.758378 836 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-8nm4k" podStartSLOduration=2.758356267 podStartE2EDuration="2.758356267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-12 13:19:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-12 13:19:15.758311289 +0000 UTC m=+267.839026438" watchObservedRunningTime="2026-11-12 13:19:15.758356267 +0000 UTC m=+267.839071416" machine # [ 286.366988] garage[834]: 2026-11-12T13:19:16.969380Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 286.367395] garage[834]: 2026-11-12T13:19:16.969938Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 286.376522] garage[834]: 2026-11-12T13:19:16.979486Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 286.376961] garage[834]: 2026-11-12T13:19:16.979556Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 286.377879] garage[834]: 2026-11-12T13:19:16.979844Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 286.389932] garage[834]: 2026-11-12T13:19:16.992189Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 286.393190] garage[834]: 2026-11-12T13:19:16.996009Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 286.395946] garage[834]: 2026-11-12T13:19:16.996313Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 286.398049] garage[834]: 2026-11-12T13:19:16.998356Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 286.400775] garage[834]: 2026-11-12T13:19:16.998649Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 286.404187] garage[834]: 2026-11-12T13:19:17.001864Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 286.407021] garage[834]: 2026-11-12T13:19:17.002095Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 286.409128] garage[834]: 2026-11-12T13:19:17.003451Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 286.411859] garage[834]: 2026-11-12T13:19:17.003667Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 286.414086] garage[834]: 2026-11-12T13:19:17.007529Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 286.416834] garage[834]: 2026-11-12T13:19:17.007811Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 286.418869] garage[834]: 2026-11-12T13:19:17.008857Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 286.421595] garage[834]: 2026-11-12T13:19:17.009090Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 286.423629] garage[834]: 2026-11-12T13:19:17.012591Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 286.426356] garage[834]: 2026-11-12T13:19:17.012762Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 286.428403] garage[834]: 2026-11-12T13:19:17.013056Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 286.431325] garage[834]: 2026-11-12T13:19:17.013255Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 286.433387] garage[834]: 2026-11-12T13:19:17.013355Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 286.436060] garage[834]: 2026-11-12T13:19:17.013493Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 286.474755] niks3-server[1185]: 2026/11/12 13:19:17 INFO Received push request method=POST path=/api/pushes machine # [ 286.480623] garage[834]: 2026-11-12T13:19:17.083585Z INFO garage_api_common::generic_server: 10.42.0.7:54916 PUT /farm/nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131917Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d46c2ea68484ed23ca71ab3ffc42855daf88440b9b4420540c7cabb27749c94d machine # [ 286.486173] garage[834]: 2026-11-12T13:19:17.083997Z INFO garage_api_common::generic_server: 10.42.0.7:54926 PUT /farm/rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131917Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b6cebb3736ebd5b28ab1a17dacdd832f95217d19bb3fcf8de75d5a1ee6304f5b machine # [ 286.486689] garage[834]: 2026-11-12T13:19:17.084089Z INFO garage_api_common::generic_server: 10.42.0.7:54924 PUT /farm/nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131917Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2ddc03f591ca2f303ea8c7ad628f2fc18ab014f7f7a513c64b347c6dc23e5687 machine # [ 286.487485] garage[834]: 2026-11-12T13:19:17.088475Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 286.488066] niks3-server[1185]: 2026/11/12 13:19:17 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 286.490306] garage[834]: 2026-11-12T13:19:17.093254Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 286.491753] garage[834]: 2026-11-12T13:19:17.094155Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 286.493076] niks3-server[1185]: 2026/11/12 13:19:17 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 286.494235] niks3-server[1185]: 2026/11/12 13:19:17 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 286.510764] garage[834]: 2026-11-12T13:19:17.113624Z INFO garage_api_common::generic_server: 10.42.0.7:54924 PUT /farm/nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131917Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3290f68bb57e353cb260d81120881e98bbbd22a7994a093500a681be54829161 machine # [ 286.511108] garage[834]: 2026-11-12T13:19:17.113919Z INFO garage_api_common::generic_server: 10.42.0.7:54926 PUT /farm/fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131917Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5d2c457699e550b39bf7911cfd87901c2a05ce3170ee8ff394e973595eac2c4a machine # [ 286.511898] garage[834]: 2026-11-12T13:19:17.114884Z INFO garage_api_common::generic_server: 10.42.0.7:54916 PUT /farm/1fq6z4j3ry021a66ia281js0yid1pi8j.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131917Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=da9b38b0ff336a3505e5399b70f6705d3b44abe6569022d089da83239324fb80 machine # [ 286.512842] garage[834]: 2026-11-12T13:19:17.115831Z INFO garage_api_common::generic_server: 192.168.1.1:48572 (key GK0123456789abcdef01234567) HEAD /farm/nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 286.513590] garage[834]: 2026-11-12T13:19:17.116114Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 286.514126] niks3-server[1185]: 2026/11/12 13:19:17 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 286.514730] garage[834]: 2026-11-12T13:19:17.117148Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 286.515557] niks3-server[1185]: 2026/11/12 13:19:17 INFO Signed narinfos id=9 count=3 machine # [ 286.516182] niks3-server[1185]: 2026/11/12 13:19:17 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 286.516745] garage[834]: 2026-11-12T13:19:17.119103Z INFO garage_api_common::generic_server: 10.42.0.7:54924 PUT /farm/rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131917Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f7143532fbb940bf92409cc5aa4650f7680f2d75dcb6df1bd01b31439463e1f1 machine # [ 286.517090] garage[834]: 2026-11-12T13:19:17.119381Z INFO garage_api_common::generic_server: 10.42.0.7:54916 PUT /farm/1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131917Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=63871a0cd1425067994f6d905a4b9ee03f10d99c411b37f0a78e28b86fbc56b8 machine # [ 286.517699] garage[834]: 2026-11-12T13:19:17.119566Z INFO garage_api_common::generic_server: 10.42.0.7:54926 PUT /farm/fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131917Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b2ed145750b3015c5d1f07d7aa06682b64e0728027194a2ce6f5ad66c7710a03 machine # [ 286.518264] niks3-server[1185]: 2026/11/12 13:19:17 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 286.518822] niks3-server[1185]: 2026/11/12 13:19:17 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 286.519598] niks3-server[1185]: 2026/11/12 13:19:17 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 286.520526] garage[834]: 2026-11-12T13:19:17.123503Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 286.521067] garage[834]: 2026-11-12T13:19:17.123772Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 286.521658] niks3-server[1185]: 2026/11/12 13:19:17 INFO Completed push id=9 objects=9 duration=3.479492ms machine # [ 286.524753] niks3-server[1185]: 2026/11/12 13:19:17 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 286.525758] niks3-server[1185]: 2026/11/12 13:19:17 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 286.526456] niks3-server[1185]: 2026/11/12 13:19:17 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 286.526991] garage[834]: 2026-11-12T13:19:17.124981Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 286.589525] garage[834]: 2026-11-12T13:19:17.192464Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 286.591408] garage[834]: 2026-11-12T13:19:17.193176Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) GET /farm/fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 286.596667] garage[834]: 2026-11-12T13:19:17.199637Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 286.600429] garage[834]: 2026-11-12T13:19:17.202872Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) GET /farm/nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 288.560802] dhcpcd[661]: vetha09340a7: probing for an IPv4LL address machine # [ 293.695731] dhcpcd[661]: vetha09340a7: using IPv4LL address 169.254.199.252 machine # [ 293.696237] dhcpcd[661]: vetha09340a7: adding route to 169.254.0.0/16 machine # [ 297.001802] dhcpcd[661]: vetha09340a7: no IPv6 Routers available machine # [ 310.325543] postgres[714]: [714] LOG: checkpoint starting: time machine # [ 311.307487] garage[834]: 2026-11-12T13:19:41.909514Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 311.308550] garage[834]: 2026-11-12T13:19:41.910383Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 311.316937] garage[834]: 2026-11-12T13:19:41.919816Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 311.317845] garage[834]: 2026-11-12T13:19:41.920452Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 311.490496] niks3-server[1185]: 2026/11/12 13:19:42 INFO Received push request method=POST path=/api/pushes machine # [ 311.500077] garage[834]: 2026-11-12T13:19:42.102979Z INFO garage_api_common::generic_server: 10.42.0.6:34672 PUT /farm/nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131942Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aca65b1e7649ce348db6367d01b6ada0c2eef6037a0b5e9cc99156de217550bc machine # [ 311.507579] garage[834]: 2026-11-12T13:19:42.106131Z INFO garage_api_common::generic_server: 10.42.0.6:34682 PUT /farm/gpvd12kzis7szd8w51klc50y5fsyav70.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131942Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e143a4b60272ac76f6cc323b64c1b829a5ffb7eac32c9052c77fe8b26f52d5da machine # [ 311.514521] garage[834]: 2026-11-12T13:19:42.107255Z INFO garage_api_common::generic_server: 10.42.0.6:34672 PUT /farm/log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131942Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=459fc5686d145d837ef9757d42c7bbb3e995f49f195417503ecd9a50c49d40f0 machine # [ 311.529770] garage[834]: 2026-11-12T13:19:42.108234Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 311.534082] garage[834]: 2026-11-12T13:19:42.114759Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 311.537772] garage[834]: 2026-11-12T13:19:42.116723Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 311.541751] garage[834]: 2026-11-12T13:19:42.118200Z INFO garage_api_common::generic_server: 10.42.0.6:34682 PUT /farm/gpvd12kzis7szd8w51klc50y5fsyav70.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T131942Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f9f8c9661191d160bd59ddc17a7fd487bdc7b301b626375329316fdb10001fa3 machine # [ 311.549581] garage[834]: 2026-11-12T13:19:42.136689Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 311.553872] niks3-server[1185]: 2026/11/12 13:19:42 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 311.556470] niks3-server[1185]: 2026/11/12 13:19:42 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 311.558871] niks3-server[1185]: 2026/11/12 13:19:42 INFO Signed narinfos id=10 count=1 machine # [ 311.560449] niks3-server[1185]: 2026/11/12 13:19:42 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 311.562775] niks3-server[1185]: 2026/11/12 13:19:42 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 311.564908] niks3-server[1185]: 2026/11/12 13:19:42 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 311.565269] niks3-server[1185]: 2026/11/12 13:19:42 INFO Completed push id=10 objects=4 duration=3.734833ms machine # [ 311.566250] garage[834]: 2026-11-12T13:19:42.137574Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) GET /farm/1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 311.567112] garage[834]: 2026-11-12T13:19:42.140619Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 311.567735] garage[834]: 2026-11-12T13:19:42.141438Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) GET /farm/nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 335.992544] garage[834]: 2026-11-12T13:20:06.594722Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 335.993188] garage[834]: 2026-11-12T13:20:06.595333Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 335.995952] garage[834]: 2026-11-12T13:20:06.598856Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 335.997975] garage[834]: 2026-11-12T13:20:06.599306Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 336.273338] niks3-server[1185]: 2026/11/12 13:20:06 INFO Received push request method=POST path=/api/pushes machine # [ 336.278983] garage[834]: 2026-11-12T13:20:06.881611Z INFO garage_api_common::generic_server: 10.42.0.6:34684 PUT /farm/log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132006Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=934b10ec13d37825be61a06d2ba6c00049581c16448dcb5166d0a8670576a878 machine # [ 336.291555] garage[834]: 2026-11-12T13:20:06.881768Z INFO garage_api_common::generic_server: 10.42.0.6:34682 PUT /farm/nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132006Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0e6ce572b9b07c7872868a6e9da88ed25ad66447be9b28ba97b4ee95ecce6f0d machine # [ 336.304271] garage[834]: 2026-11-12T13:20:06.881932Z INFO garage_api_common::generic_server: 10.42.0.6:34672 PUT /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132006Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d0fdf84690aec35297012a3ff319733ad7abbb797e22bcbe61e15bfdcd167204 machine # [ 336.316238] garage[834]: 2026-11-12T13:20:06.885264Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 336.321385] garage[834]: 2026-11-12T13:20:06.886695Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 336.326713] garage[834]: 2026-11-12T13:20:06.886986Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 336.331453] garage[834]: 2026-11-12T13:20:06.888374Z INFO garage_api_common::generic_server: 10.42.0.6:34682 PUT /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132006Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=be574f7e6f25c1f8ad4d0730f2c615c069fbfedec206bdb0f8d4d6bea0f9bdd4 machine # [ 336.339185] garage[834]: 2026-11-12T13:20:06.893483Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 336.341988] niks3-server[1185]: 2026/11/12 13:20:06 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 336.343864] niks3-server[1185]: 2026/11/12 13:20:06 INFO Signed narinfos id=11 count=1 machine # [ 336.345017] niks3-server[1185]: 2026/11/12 13:20:06 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 336.346686] niks3-server[1185]: 2026/11/12 13:20:06 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 336.348219] niks3-server[1185]: 2026/11/12 13:20:06 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 336.349908] niks3-server[1185]: 2026/11/12 13:20:06 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 336.351871] niks3-server[1185]: 2026/11/12 13:20:06 INFO Completed push id=11 objects=8 duration=5.368838ms machine # [ 336.353158] niks3-server[1185]: 2026/11/12 13:20:06 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 336.354927] garage[834]: 2026-11-12T13:20:06.925901Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 336.357679] garage[834]: 2026-11-12T13:20:06.926956Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) GET /farm/rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 336.360486] garage[834]: 2026-11-12T13:20:06.931506Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 336.363484] garage[834]: 2026-11-12T13:20:06.932130Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) GET /farm/nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 360.953507] garage[834]: 2026-11-12T13:20:31.555602Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 360.954473] garage[834]: 2026-11-12T13:20:31.556236Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 360.964825] garage[834]: 2026-11-12T13:20:31.567718Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 360.970513] garage[834]: 2026-11-12T13:20:31.568305Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 361.235082] niks3-server[1185]: 2026/11/12 13:20:31 INFO Received push request method=POST path=/api/pushes machine # [ 361.253096] garage[834]: 2026-11-12T13:20:31.855890Z INFO garage_api_common::generic_server: 10.42.0.6:34682 PUT /farm/nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132031Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5c5cc6365d9d6350fbcb8d8f4ab035685ca859cd0b62caa5cdef6a9b43a76b06 machine # [ 361.254393] garage[834]: 2026-11-12T13:20:31.856908Z INFO garage_api_common::generic_server: 10.42.0.6:34672 PUT /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132031Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=39187dd688b2f3146dbe54975790495b002e0c23c1b5fd2a77c9b496d165ae64 machine # [ 361.257487] garage[834]: 2026-11-12T13:20:31.860390Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 361.258946] garage[834]: 2026-11-12T13:20:31.861884Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 361.261157] niks3-server[1185]: 2026/11/12 13:20:31 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 361.262886] niks3-server[1185]: 2026/11/12 13:20:31 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 361.273924] garage[834]: 2026-11-12T13:20:31.876794Z INFO garage_api_common::generic_server: 10.42.0.6:34672 PUT /farm/log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132031Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=43e8fa5d3a1b820e6bb525bee939b17f736b88494287c7af8d9d4f152011fe79 machine # [ 361.276980] niks3-server[1185]: 2026/11/12 13:20:31 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 361.277904] niks3-server[1185]: 2026/11/12 13:20:31 INFO Signed narinfos id=12 count=1 machine # [ 361.278770] garage[834]: 2026-11-12T13:20:31.880014Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 361.280105] garage[834]: 2026-11-12T13:20:31.882203Z INFO garage_api_common::generic_server: 10.42.0.6:34672 PUT /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132031Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0b6c54fe6027caabca2ea9bb6389dda4d898dd3ef04906f239e90eb897ff6f0f machine # [ 361.281083] niks3-server[1185]: 2026/11/12 13:20:31 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 361.282503] niks3-server[1185]: 2026/11/12 13:20:31 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 361.286419] garage[834]: 2026-11-12T13:20:31.889315Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 361.287506] niks3-server[1185]: 2026/11/12 13:20:31 INFO Completed push id=12 objects=12 duration=4.657296ms machine # [ 361.288868] niks3-server[1185]: 2026/11/12 13:20:31 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 362.700633] garage[834]: 2026-11-12T13:20:33.303171Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nix-cache-info machine # [ 362.701324] garage[834]: 2026-11-12T13:20:33.303868Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) GET /farm/nix-cache-info machine # [ 362.706542] garage[834]: 2026-11-12T13:20:33.309513Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/2lbawlnbs2fgyvz7jsy103fsyj61iwv6.narinfo machine # [ 362.707109] garage[834]: 2026-11-12T13:20:33.309692Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 362.791193] garage[834]: 2026-11-12T13:20:33.394112Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 362.791815] garage[834]: 2026-11-12T13:20:33.394411Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 363.871912] garage[834]: 2026-11-12T13:20:34.474204Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 363.872661] garage[834]: 2026-11-12T13:20:34.474721Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 363.878380] garage[834]: 2026-11-12T13:20:34.481269Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 363.878991] garage[834]: 2026-11-12T13:20:34.481706Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 363.885121] garage[834]: 2026-11-12T13:20:34.487994Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 363.887947] garage[834]: 2026-11-12T13:20:34.490886Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 363.894088] garage[834]: 2026-11-12T13:20:34.496948Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 363.894770] garage[834]: 2026-11-12T13:20:34.497150Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 363.961223] niks3-server[1185]: 2026/11/12 13:20:34 INFO Received push request method=POST path=/api/pushes machine # [ 363.973098] garage[834]: 2026-11-12T13:20:34.575977Z INFO garage_api_common::generic_server: 10.42.0.7:54926 PUT /farm/nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132034Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f77d26da757462e04c30ffed22cb52cec0bc8f711a541fd370751d3326f3da7f machine # [ 363.983702] garage[834]: 2026-11-12T13:20:34.576424Z INFO garage_api_common::generic_server: 10.42.0.7:54916 PUT /farm/fm28nk4zj5837pwx4c8iv6ds8919r62h.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132034Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a319b106aa34f5f32ecafc027ee1f032a45d5c03a643684a84f3bc1dbe296167 machine # [ 363.992210] garage[834]: 2026-11-12T13:20:34.578089Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 363.995516] garage[834]: 2026-11-12T13:20:34.578972Z INFO garage_api_common::generic_server: 10.42.0.7:54916 PUT /farm/fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132034Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31e68b7ad8a200baeeb3841d66f160ee671c17b7260c67903916e0435364956e machine # [ 364.000967] garage[834]: 2026-11-12T13:20:34.580144Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 364.003641] garage[834]: 2026-11-12T13:20:34.583146Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 364.006435] niks3-server[1185]: 2026/11/12 13:20:34 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 364.008073] niks3-server[1185]: 2026/11/12 13:20:34 INFO Signed narinfos id=13 count=1 machine # [ 364.009221] niks3-server[1185]: 2026/11/12 13:20:34 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 364.010846] niks3-server[1185]: 2026/11/12 13:20:34 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 364.012598] niks3-server[1185]: 2026/11/12 13:20:34 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 364.014830] niks3-server[1185]: 2026/11/12 13:20:34 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 364.016769] niks3-server[1185]: 2026/11/12 13:20:34 INFO Completed push id=13 objects=3 duration=5.062934ms machine # [ 389.119443] garage[834]: 2026-11-12T13:20:59.721558Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 389.122170] garage[834]: 2026-11-12T13:20:59.722308Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 389.135084] garage[834]: 2026-11-12T13:20:59.737913Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 389.142521] garage[834]: 2026-11-12T13:20:59.738547Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 389.307921] niks3-server[1185]: 2026/11/12 13:20:59 INFO Received push request method=POST path=/api/pushes machine # [ 389.319487] garage[834]: 2026-11-12T13:20:59.922453Z INFO garage_api_common::generic_server: 10.42.0.7:54916 PUT /farm/nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132059Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f5978ea0febff499cd68a85c57a899ced0d5cc2bc051b2b5c2b06bdd1b863d5e machine # [ 389.322353] garage[834]: 2026-11-12T13:20:59.924646Z INFO garage_api_common::generic_server: 10.42.0.7:54926 PUT /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132059Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a9fec9f427b3767989ed4113c94d5392662031fbe74e6634d5a164f7b6fc0fb7 machine # [ 389.322874] garage[834]: 2026-11-12T13:20:59.925292Z INFO garage_api_common::generic_server: 10.42.0.7:57802 PUT /farm/log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132059Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=02044b433e723e023db02ebccc06de1f51f4dfeff0c98b2ce91d0670c3af6928 machine # [ 389.326487] niks3-server[1185]: 2026/11/12 13:20:59 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 389.327549] garage[834]: 2026-11-12T13:20:59.930238Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 389.328659] garage[834]: 2026-11-12T13:20:59.930940Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 389.334304] garage[834]: 2026-11-12T13:20:59.933747Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 389.335084] niks3-server[1185]: 2026/11/12 13:20:59 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 389.335921] niks3-server[1185]: 2026/11/12 13:20:59 INFO Signed narinfos id=14 count=1 machine # [ 389.338124] niks3-server[1185]: 2026/11/12 13:20:59 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 389.340252] niks3-server[1185]: 2026/11/12 13:20:59 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 389.361738] garage[834]: 2026-11-12T13:20:59.964472Z INFO garage_api_common::generic_server: 10.42.0.7:54926 PUT /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132059Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d03c7fc62d2ac5cd691914c088d4dd70bf90d3c7d039b76d10c380d87769b484 machine # [ 389.363634] niks3-server[1185]: 2026/11/12 13:20:59 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 389.365946] garage[834]: 2026-11-12T13:20:59.968875Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 389.368146] niks3-server[1185]: 2026/11/12 13:20:59 INFO Completed push id=14 objects=4 duration=4.126222ms machine # [ 389.368858] niks3-server[1185]: 2026/11/12 13:20:59 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 390.576806] systemd[1]: cri-containerd-0baf5233090b47cb519987f174219a30c264c907033ac80a35a023bee5c10975.scope: Deactivated successfully. machine # [ 390.578666] systemd[1]: cri-containerd-0baf5233090b47cb519987f174219a30c264c907033ac80a35a023bee5c10975.scope: Consumed 949ms CPU time over 1min 45.482s wall clock time, 127.3M memory peak, 62.3M read from disk, 428K written to disk, 19.5K incoming IP traffic, 38.5K outgoing IP traffic. machine # [ 390.615805] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-0baf5233090b47cb519987f174219a30c264c907033ac80a35a023bee5c10975-rootfs.mount: Deactivated successfully. machine # [ 392.054663] systemd[1]: cri-containerd-35e18fa9540dc6e2de22a291318753ca5571d075f583539bd97b442c8a1ed1ae.scope: Deactivated successfully. machine # [ 392.092501] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-35e18fa9540dc6e2de22a291318753ca5571d075f583539bd97b442c8a1ed1ae-rootfs.mount: Deactivated successfully. machine # [ 392.133499] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-35e18fa9540dc6e2de22a291318753ca5571d075f583539bd97b442c8a1ed1ae-shm.mount: Deactivated successfully. machine # [ 392.317965] cni0: port 2(vetha09340a7) entered disabled state machine # [ 392.169755] dhcpcd[661]: vetha09340a7: carrier lost machine # [ 392.320594] vetha09340a7 (unregistering): left allmulticast mode machine # [ 392.321454] vetha09340a7 (unregistering): left promiscuous mode machine # [ 392.322286] cni0: port 2(vetha09340a7) entered disabled state machine # [ 392.192663] systemd[1]: run-netns-cni\x2d71622d6f\x2d5e75\x2d346a\x2d1ab4\x2db2f67a071076.mount: Deactivated successfully. machine # [ 392.193214] dhcpcd[661]: vetha09340a7: deleting address fe80::ac26:bfff:fed6:8341 machine # [ 392.196158] dhcpcd[661]: vetha09340a7: deleting route to 169.254.0.0/16 machine # [ 392.249289] dhcpcd[661]: vetha09340a7: removing interface machine # [ 392.284410] k3s[836]: I1112 13:21:02.887013 836 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65969460-b34a-4409-81d1-27d82a911771-kube-api-access-bb7zd\" (UniqueName: \"kubernetes.io/projected/65969460-b34a-4409-81d1-27d82a911771-kube-api-access-bb7zd\") pod \"65969460-b34a-4409-81d1-27d82a911771\" (UID: \"65969460-b34a-4409-81d1-27d82a911771\") " machine # [ 392.288883] k3s[836]: I1112 13:21:02.887093 836 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/65969460-b34a-4409-81d1-27d82a911771-job\" (UniqueName: \"kubernetes.io/configmap/65969460-b34a-4409-81d1-27d82a911771-job\") pod \"65969460-b34a-4409-81d1-27d82a911771\" (UID: \"65969460-b34a-4409-81d1-27d82a911771\") " machine # [ 392.292705] k3s[836]: I1112 13:21:02.887120 836 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65969460-b34a-4409-81d1-27d82a911771-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/65969460-b34a-4409-81d1-27d82a911771-nix-grpc-farm\") pod \"65969460-b34a-4409-81d1-27d82a911771\" (UID: \"65969460-b34a-4409-81d1-27d82a911771\") " machine # [ 392.296683] k3s[836]: I1112 13:21:02.887584 836 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65969460-b34a-4409-81d1-27d82a911771-job" pod "65969460-b34a-4409-81d1-27d82a911771" (UID: "65969460-b34a-4409-81d1-27d82a911771"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 392.300376] k3s[836]: I1112 13:21:02.892150 836 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65969460-b34a-4409-81d1-27d82a911771-kube-api-access-bb7zd" pod "65969460-b34a-4409-81d1-27d82a911771" (UID: "65969460-b34a-4409-81d1-27d82a911771"). InnerVolumeSpecName "kube-api-access-bb7zd". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 392.304402] k3s[836]: I1112 13:21:02.892268 836 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65969460-b34a-4409-81d1-27d82a911771-nix-grpc-farm" pod "65969460-b34a-4409-81d1-27d82a911771" (UID: "65969460-b34a-4409-81d1-27d82a911771"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 392.308269] systemd[1]: var-lib-kubelet-pods-65969460\x2db34a\x2d4409\x2d81d1\x2d27d82a911771-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 392.310219] systemd[1]: var-lib-kubelet-pods-65969460\x2db34a\x2d4409\x2d81d1\x2d27d82a911771-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dbb7zd.mount: Deactivated successfully. machine # [ 392.385197] k3s[836]: I1112 13:21:02.988117 836 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bb7zd\" (UniqueName: \"kubernetes.io/projected/65969460-b34a-4409-81d1-27d82a911771-kube-api-access-bb7zd\") on node \"machine\" DevicePath \"\"" machine # [ 392.385551] k3s[836]: I1112 13:21:02.988152 836 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/65969460-b34a-4409-81d1-27d82a911771-job\") on node \"machine\" DevicePath \"\"" machine # [ 392.385932] k3s[836]: I1112 13:21:02.988167 836 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/65969460-b34a-4409-81d1-27d82a911771-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 392.608996] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod65969460_b34a_4409_81d1_27d82a911771.slice. machine # [ 392.609335] systemd[1]: kubepods-besteffort-pod65969460_b34a_4409_81d1_27d82a911771.slice: Consumed 978ms CPU time over 1min 49.896s wall clock time, 127.5M memory peak, 62.3M read from disk, 632K written to disk, 19.5K incoming IP traffic, 38.5K outgoing IP traffic. machine # [ 393.040806] k3s[836]: I1112 13:21:03.643689 836 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35e18fa9540dc6e2de22a291318753ca5571d075f583539bd97b442c8a1ed1ae" machine # [ 393.046330] k3s[836]: E1112 13:21:03.643782 836 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65969460_b34a_4409_81d1_27d82a911771.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65969460_b34a_4409_81d1_27d82a911771.slice/memory.max: no such file or directory" podName="ci-8nm4k" machine # [ 393.057960] k3s[836]: E1112 13:21:03.643868 836 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65969460_b34a_4409_81d1_27d82a911771.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65969460_b34a_4409_81d1_27d82a911771.slice/cpu.max: no such file or directory" podName="ci-8nm4k" [395.11s] machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 111.42 seconds) [395.11s] machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 [395.23s] machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.12 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 3 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmptr4vdbi4/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (27s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty [395.39s] machine: must succeed: nix eval --raw -f /nix/store/zbdavbwghh5fi44cpdq7rn5xz10ifqfn-job.nix --argstr tag ci outPath [395.49s] machine: (finished: must succeed: nix eval --raw -f /nix/store/zbdavbwghh5fi44cpdq7rn5xz10ifqfn-job.nix --argstr tag ci outPath, in 0.10 seconds) [395.49s] machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine # [ 394.531457] garage[834]: 2026-11-12T13:21:05.134121Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 394.533973] garage[834]: 2026-11-12T13:21:05.134880Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) GET /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo [395.53s] machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.04 seconds) [395.53s] (finished: subtest: a Job with the client image builds through the farm with its service account, in 112.28 seconds) [395.53s] subtest: a renewed balancer certificate is served without a rollout [395.53s] machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/lb-renewed.crt --key=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. [395.77s] machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/lb-renewed.crt --key=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.24 seconds) [395.77s] machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' [395.88s] machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.11 seconds) [395.88s] machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5b4c784fd-pkvkn -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 395.048509] k3s[836]: E1112 13:21:05.650716 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:58474: use of closed network connection" machine # [ 396.275166] k3s[836]: E1112 13:21:06.877791 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:58488: use of closed network connection" machine # [ 397.522109] k3s[836]: E1112 13:21:08.123756 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:58498: use of closed network connection" machine # [ 398.747274] k3s[836]: E1112 13:21:09.349524 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:58504: use of closed network connection" machine # [ 399.973888] k3s[836]: E1112 13:21:10.576053 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:58508: use of closed network connection" machine # [ 401.214566] k3s[836]: E1112 13:21:11.816677 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:58514: use of closed network connection" machine # [ 402.475964] k3s[836]: E1112 13:21:13.078600 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:58516: use of closed network connection" machine # [ 403.754353] k3s[836]: E1112 13:21:14.356951 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46700: use of closed network connection" machine # [ 405.015391] k3s[836]: E1112 13:21:15.617904 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46704: use of closed network connection" machine # [ 406.273297] k3s[836]: E1112 13:21:16.875884 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46720: use of closed network connection" machine # [ 407.492134] k3s[836]: E1112 13:21:18.094754 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46734: use of closed network connection" machine # [ 408.760261] k3s[836]: E1112 13:21:19.362870 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46740: use of closed network connection" machine # [ 409.965937] k3s[836]: E1112 13:21:20.568572 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46742: use of closed network connection" machine # [ 411.270563] k3s[836]: E1112 13:21:21.873163 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46756: use of closed network connection" machine # [ 412.534401] k3s[836]: E1112 13:21:23.136668 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46762: use of closed network connection" machine # [ 413.761834] k3s[836]: E1112 13:21:24.364418 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36984: use of closed network connection" machine # [ 414.964907] k3s[836]: E1112 13:21:25.567469 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36986: use of closed network connection" machine # [ 415.085381] postgres[714]: [714] LOG: checkpoint complete: wrote 1046 buffers (6.4%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=104.688 s, sync=0.038 s, total=104.761 s; sync files=368, longest=0.003 s, average=0.001 s; distance=5041 kB, estimate=5041 kB; lsn=0/1C7A750, redo lsn=0/1C52868 machine # [ 416.203140] k3s[836]: E1112 13:21:26.805355 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36996: use of closed network connection" machine # [ 417.468568] k3s[836]: E1112 13:21:28.070244 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37004: use of closed network connection" machine # [ 418.733987] k3s[836]: E1112 13:21:29.336612 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37016: use of closed network connection" machine # [ 419.957839] k3s[836]: E1112 13:21:30.560404 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37030: use of closed network connection" machine # [ 421.166120] k3s[836]: E1112 13:21:31.768757 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37042: use of closed network connection" machine # [ 422.359476] k3s[836]: E1112 13:21:32.961953 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37056: use of closed network connection" machine # [ 423.616527] k3s[836]: E1112 13:21:34.218670 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52628: use of closed network connection" machine # [ 424.848188] k3s[836]: E1112 13:21:35.450814 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52638: use of closed network connection" machine # [ 426.169305] k3s[836]: E1112 13:21:36.771921 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52654: use of closed network connection" machine # [ 427.453609] k3s[836]: E1112 13:21:38.055420 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52662: use of closed network connection" machine # [ 428.728194] k3s[836]: E1112 13:21:39.330821 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52670: use of closed network connection" machine # [ 429.959531] k3s[836]: E1112 13:21:40.562110 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52686: use of closed network connection" machine # [ 431.222889] k3s[836]: E1112 13:21:41.825474 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52694: use of closed network connection" machine # [ 432.458606] k3s[836]: E1112 13:21:43.060932 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52710: use of closed network connection" machine # [ 433.723101] k3s[836]: E1112 13:21:44.325717 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51536: use of closed network connection" machine # [ 434.961554] k3s[836]: E1112 13:21:45.564162 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51542: use of closed network connection" machine # [ 436.210432] k3s[836]: E1112 13:21:46.813065 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51552: use of closed network connection" machine # [ 437.500358] k3s[836]: E1112 13:21:48.102549 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51566: use of closed network connection" machine # [ 438.778116] k3s[836]: E1112 13:21:49.380752 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51576: use of closed network connection" machine # [ 439.991641] k3s[836]: E1112 13:21:50.594071 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51582: use of closed network connection" machine # [ 441.255136] k3s[836]: E1112 13:21:51.857779 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51594: use of closed network connection" machine # [ 442.578418] k3s[836]: E1112 13:21:53.180577 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51598: use of closed network connection" machine # [ 443.836665] k3s[836]: E1112 13:21:54.438884 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59928: use of closed network connection" machine # [ 445.136075] k3s[836]: E1112 13:21:55.738712 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59942: use of closed network connection" machine # [ 446.405328] k3s[836]: E1112 13:21:57.007920 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59956: use of closed network connection" [447.42s] machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5b4c784fd-pkvkn -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 51.53 seconds) [447.42s] machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example [447.46s] machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) [447.46s] machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zbdavbwghh5fi44cpdq7rn5xz10ifqfn-job.nix --argstr tag t-renewed 2>&1 machine # [ 446.606091] garage[834]: 2026-11-12T13:21:57.208004Z INFO garage_api_common::generic_server: 192.168.1.1:54598 (key GK0123456789abcdef01234567) HEAD /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 446.606457] garage[834]: 2026-11-12T13:21:57.208609Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 446.607984] garage[834]: 2026-11-12T13:21:57.208854Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 446.609127] garage[834]: 2026-11-12T13:21:57.209383Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 446.626589] garage[834]: 2026-11-12T13:21:57.229565Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine # [ 446.626991] garage[834]: 2026-11-12T13:21:57.229965Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 446.644281] garage[834]: 2026-11-12T13:21:57.247178Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine # [ 446.644984] garage[834]: 2026-11-12T13:21:57.247561Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 446.647674] garage[834]: 2026-11-12T13:21:57.250140Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine # [ 446.649620] garage[834]: 2026-11-12T13:21:57.250516Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 446.654698] garage[834]: 2026-11-12T13:21:57.257602Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 446.656571] garage[834]: 2026-11-12T13:21:57.257977Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 446.658318] garage[834]: 2026-11-12T13:21:57.260817Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 446.660072] garage[834]: 2026-11-12T13:21:57.261213Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 446.665365] garage[834]: 2026-11-12T13:21:57.268245Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 446.667094] garage[834]: 2026-11-12T13:21:57.268617Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 446.667859] garage[834]: 2026-11-12T13:21:57.270618Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 446.669113] garage[834]: 2026-11-12T13:21:57.270805Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 446.673444] garage[834]: 2026-11-12T13:21:57.276374Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 446.675096] garage[834]: 2026-11-12T13:21:57.276573Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 446.675897] garage[834]: 2026-11-12T13:21:57.277603Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 446.676823] garage[834]: 2026-11-12T13:21:57.277967Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 446.678156] garage[834]: 2026-11-12T13:21:57.278096Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 446.679606] garage[834]: 2026-11-12T13:21:57.278237Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 446.746886] niks3-server[1185]: 2026/11/12 13:21:57 INFO Received push request method=POST path=/api/pushes machine # [ 446.752064] garage[834]: 2026-11-12T13:21:57.354300Z INFO garage_api_common::generic_server: 10.42.0.6:34672 PUT /farm/nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132157Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9a1620079675005af15b32fe0e1cc4517c191e369cd4858b0239dfd5339a93c8 machine # [ 446.752417] garage[834]: 2026-11-12T13:21:57.354771Z INFO garage_api_common::generic_server: 10.42.0.6:34682 PUT /farm/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132157Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8863ed87be110ee85d4b7d2b3071b7e8bf1fb99591b400eec70ca87ace7e60eb machine # [ 446.752897] garage[834]: 2026-11-12T13:21:57.355833Z INFO garage_api_common::generic_server: 10.42.0.6:41370 PUT /farm/nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132157Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ff776d013c946a75fd7ba4a0ec423a53230962c10afc83a7ac2684a05e3c6bab machine # [ 446.753629] garage[834]: 2026-11-12T13:21:57.356374Z INFO garage_api_common::generic_server: 10.42.0.6:41376 PUT /farm/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132157Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=36b045186328ebd5a5921c932bb42cb2f214880f2b897e02afea00d260158177 machine # [ 446.755231] garage[834]: 2026-11-12T13:21:57.358201Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 446.756561] garage[834]: 2026-11-12T13:21:57.359547Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 446.757743] niks3-server[1185]: 2026/11/12 13:21:57 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 446.759113] niks3-server[1185]: 2026/11/12 13:21:57 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 446.769938] garage[834]: 2026-11-12T13:21:57.372641Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 446.773076] niks3-server[1185]: 2026/11/12 13:21:57 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 446.787109] garage[834]: 2026-11-12T13:21:57.389870Z INFO garage_api_common::generic_server: 10.42.0.6:41374 PUT /farm/nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132157Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f8fef9f5c8e72772c34ded6d66c9928ec62a2d42d57f15aee22b1e693d497679 machine # [ 446.793262] garage[834]: 2026-11-12T13:21:57.395769Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 446.793749] garage[834]: 2026-11-12T13:21:57.395845Z INFO garage_api_common::generic_server: 10.42.0.6:41376 PUT /farm/jz7biafi8rj5r3r392blyazw5mdpvy0d.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132157Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1d2187c60b3a8d70661f9b140c2ed212bdc7a98e34f682ec0b55419ce143aff3 machine # [ 446.794611] garage[834]: 2026-11-12T13:21:57.397311Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 446.795188] niks3-server[1185]: 2026/11/12 13:21:57 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 446.796113] niks3-server[1185]: 2026/11/12 13:21:57 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 446.796751] niks3-server[1185]: 2026/11/12 13:21:57 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 446.797476] niks3-server[1185]: 2026/11/12 13:21:57 INFO Signed narinfos id=15 count=3 machine # [ 446.798021] garage[834]: 2026-11-12T13:21:57.400503Z INFO garage_api_common::generic_server: 10.42.0.6:41376 PUT /farm/jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132157Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bf0da6a4b83ef641a2372097b080a5d82549fe8d95cd604db8a172346c02b2e8 machine # [ 446.798566] garage[834]: 2026-11-12T13:21:57.401217Z INFO garage_api_common::generic_server: 10.42.0.6:41374 PUT /farm/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132157Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dc7d5833297edf3ae007cc8904a27817831739433695d868afc12fe747e06bf1 machine # [ 446.799079] garage[834]: 2026-11-12T13:21:57.401258Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 446.799354] garage[834]: 2026-11-12T13:21:57.402312Z INFO garage_api_common::generic_server: 10.42.0.6:41376 PUT /farm/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132157Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=08eb8381c78fb5941239ce6a5a0539f90971da3864fe071edc742ded0e851fd1 machine # [ 446.802585] garage[834]: 2026-11-12T13:21:57.404518Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 446.803506] garage[834]: 2026-11-12T13:21:57.404916Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 446.804040] niks3-server[1185]: 2026/11/12 13:21:57 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 446.804599] niks3-server[1185]: 2026/11/12 13:21:57 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 446.805173] garage[834]: 2026-11-12T13:21:57.408156Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 446.806229] niks3-server[1185]: 2026/11/12 13:21:57 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 446.807330] niks3-server[1185]: 2026/11/12 13:21:57 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 446.808608] niks3-server[1185]: 2026/11/12 13:21:57 INFO Completed push id=15 objects=9 duration=6.228445ms machine # [ 446.809653] niks3-server[1185]: 2026/11/12 13:21:57 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 471.269286] garage[834]: 2026-11-12T13:22:21.871470Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 471.269881] garage[834]: 2026-11-12T13:22:21.872111Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 471.272785] garage[834]: 2026-11-12T13:22:21.875639Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 471.275140] garage[834]: 2026-11-12T13:22:21.876099Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 471.559653] niks3-server[1185]: 2026/11/12 13:22:22 INFO Received push request method=POST path=/api/pushes machine # [ 471.641879] garage[834]: 2026-11-12T13:22:22.244722Z INFO garage_api_common::generic_server: 10.42.0.6:41376 PUT /farm/nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132222Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d9d0bf3c002ee0bd79274b27e581308777936d49f24ecea54b7f0542522238c3 machine # [ 471.643141] garage[834]: 2026-11-12T13:22:22.245607Z INFO garage_api_common::generic_server: 10.42.0.6:41370 PUT /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132222Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2149876d4e7ca1b3c722584ace55d3a3362105df0b7f15d31d9d123581398a63 machine # [ 471.644210] garage[834]: 2026-11-12T13:22:22.246636Z INFO garage_api_common::generic_server: 10.42.0.6:41374 PUT /farm/log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132222Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4afd08419feb25ae56bf680994fc754bb2b0af8548df1e661b668b2a8f08d65c machine # [ 471.647938] niks3-server[1185]: 2026/11/12 13:22:22 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 471.650110] garage[834]: 2026-11-12T13:22:22.252546Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 471.653434] niks3-server[1185]: 2026/11/12 13:22:22 INFO Signed narinfos id=16 count=1 machine # [ 471.688288] niks3-server[1185]: 2026/11/12 13:22:22 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 471.689309] garage[834]: 2026-11-12T13:22:22.291137Z INFO garage_api_common::generic_server: 10.42.0.6:41374 PUT /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132222Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=20a0a9392d855588383f53cf169cfb5ca9cd200064e0d9405c8a296f7361d7df machine # [ 471.690594] garage[834]: 2026-11-12T13:22:22.291771Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 471.691908] garage[834]: 2026-11-12T13:22:22.294155Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 471.693210] niks3-server[1185]: 2026/11/12 13:22:22 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 471.700472] niks3-server[1185]: 2026/11/12 13:22:22 INFO Completed push id=16 objects=4 duration=11.010897ms machine # [ 471.710738] niks3-server[1185]: 2026/11/12 13:22:22 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 471.712578] garage[834]: 2026-11-12T13:22:22.313782Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 471.713804] niks3-server[1185]: 2026/11/12 13:22:22 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 471.715607] niks3-server[1185]: 2026/11/12 13:22:22 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 496.390696] garage[834]: 2026-11-12T13:22:46.992879Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 496.391583] garage[834]: 2026-11-12T13:22:46.993451Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 496.403883] garage[834]: 2026-11-12T13:22:47.006794Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 496.404644] garage[834]: 2026-11-12T13:22:47.007272Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 496.632891] niks3-server[1185]: 2026/11/12 13:22:47 INFO Received push request method=POST path=/api/pushes machine # [ 496.642751] garage[834]: 2026-11-12T13:22:47.245644Z INFO garage_api_common::generic_server: 10.42.0.6:41374 PUT /farm/nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132247Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ef05ff18e7454ce9c2768e7df47444d61bd239d2360cf5bc570564cba9f6cd1e machine # [ 496.643239] garage[834]: 2026-11-12T13:22:47.246195Z INFO garage_api_common::generic_server: 10.42.0.6:41376 PUT /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132247Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2d04b9d3fb2bb01dce471d9188fd2ab0607e9f1ac239e868f6659d63cf46b038 machine # [ 496.644126] garage[834]: 2026-11-12T13:22:47.247098Z INFO garage_api_common::generic_server: 10.42.0.6:41370 PUT /farm/log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132247Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ec42a48233df9b93c994e0cb0362626f3eb1f37151bd1266fbf47d52134c75 machine # [ 496.647986] garage[834]: 2026-11-12T13:22:47.250363Z INFO garage_api_common::generic_server: 192.168.1.1:55570 (key GK0123456789abcdef01234567) HEAD /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 496.650057] garage[834]: 2026-11-12T13:22:47.252452Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 496.653114] niks3-server[1185]: 2026/11/12 13:22:47 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 496.655346] niks3-server[1185]: 2026/11/12 13:22:47 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 496.694478] niks3-server[1185]: 2026/11/12 13:22:47 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 496.695501] niks3-server[1185]: 2026/11/12 13:22:47 INFO Signed narinfos id=17 count=1 machine # [ 496.696397] garage[834]: 2026-11-12T13:22:47.297988Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 496.697889] garage[834]: 2026-11-12T13:22:47.299254Z INFO garage_api_common::generic_server: 10.42.0.6:41374 PUT /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132247Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9012456edc5efab0fa2e4293f11dac0773b6a27b002390698cc5395780cbd56d machine # [ 496.698947] niks3-server[1185]: 2026/11/12 13:22:47 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 496.699756] garage[834]: 2026-11-12T13:22:47.302694Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 496.701086] niks3-server[1185]: 2026/11/12 13:22:47 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 496.702351] niks3-server[1185]: 2026/11/12 13:22:47 INFO Completed push id=17 objects=8 duration=4.391899ms machine # [ 496.703942] niks3-server[1185]: 2026/11/12 13:22:47 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 521.028268] garage[834]: 2026-11-12T13:23:11.630475Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine # [ 521.029272] garage[834]: 2026-11-12T13:23:11.631007Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 521.042105] garage[834]: 2026-11-12T13:23:11.644952Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine # [ 521.042486] garage[834]: 2026-11-12T13:23:11.645423Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 521.227840] niks3-server[1185]: 2026/11/12 13:23:11 INFO Received push request method=POST path=/api/pushes machine # [ 521.233611] garage[834]: 2026-11-12T13:23:11.836488Z INFO garage_api_common::generic_server: 10.42.0.6:41370 PUT /farm/nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132311Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a72ffd65f27f29e3ce1fee854073801b8b75839f25a32a993f4b263d038b9bb9 machine # [ 521.246390] garage[834]: 2026-11-12T13:23:11.836544Z INFO garage_api_common::generic_server: 10.42.0.6:41374 PUT /farm/log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132311Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=93468bf8210d717e7521bbb95d94f1b8fc2d1dc84aa799ddd67990ade50d653b machine # [ 521.259151] garage[834]: 2026-11-12T13:23:11.836961Z INFO garage_api_common::generic_server: 10.42.0.6:41376 PUT /farm/a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132311Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9f37cf5420acabcb785b55af7fc7ff82d78493585a532dc55b7930590e4d4619 machine # [ 521.270997] garage[834]: 2026-11-12T13:23:11.854906Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 521.276185] garage[834]: 2026-11-12T13:23:11.856433Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 521.282391] niks3-server[1185]: 2026/11/12 13:23:11 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 521.285261] niks3-server[1185]: 2026/11/12 13:23:11 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 521.288231] niks3-server[1185]: 2026/11/12 13:23:11 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 521.290787] niks3-server[1185]: 2026/11/12 13:23:11 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 521.292554] niks3-server[1185]: 2026/11/12 13:23:11 INFO Signed narinfos id=18 count=1 machine # [ 521.297799] niks3-server[1185]: 2026/11/12 13:23:11 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 521.298638] niks3-server[1185]: 2026/11/12 13:23:11 INFO Completed push id=18 objects=12 duration=2.588877ms machine # [ 521.299595] niks3-server[1185]: 2026/11/12 13:23:11 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine # [ 521.300666] garage[834]: 2026-11-12T13:23:11.862862Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 521.301702] garage[834]: 2026-11-12T13:23:11.873354Z INFO garage_api_common::generic_server: 10.42.0.6:41370 PUT /farm/a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132311Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1efc656c27eda142779d59ec851940df260e938efbaaa6db6d2d2bb577323eb7 machine # [ 521.302568] garage[834]: 2026-11-12T13:23:11.876076Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo [522.33s] machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zbdavbwghh5fi44cpdq7rn5xz10ifqfn-job.nix --argstr tag t-renewed 2>&1, in 74.87 seconds) [522.33s] (finished: subtest: a renewed balancer certificate is served without a rollout, in 126.80 seconds) [522.33s] subtest: metrics carry build_info [522.33s] machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -o jsonpath='{.items[0].status.podIP}{.status.podIP}' [522.51s] machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.18 seconds) [522.51s] machine: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c"' [522.55s] machine: (finished: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c"', in 0.04 seconds) [522.55s] (finished: subtest: metrics carry build_info, in 0.22 seconds) [522.55s] subtest: harmonia-gc frees space and the worker stays Ready [522.55s] machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 521.749585] k3s[836]: E1112 13:23:12.352143 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50540: use of closed network connection" [522.75s] machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.20 seconds) [522.75s] machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 521.988019] k3s[836]: E1112 13:23:12.590930 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50556: use of closed network connection" [522.99s] machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.24 seconds) [522.99s] machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -c gc -- sh -c 'fallocate -l 11419545600 /nix/fill' machine # [ 522.161549] k3s[836]: E1112 13:23:12.764348 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50568: use of closed network connection" [523.16s] machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -c gc -- sh -c 'fallocate -l 11419545600 /nix/fill', in 0.17 seconds) [523.16s] machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -c gc --since=30s | grep -q 'store paths deleted' [526.89s] machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -c gc --since=30s | grep -q 'store paths deleted', in 3.73 seconds) [526.89s] machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -c gc -- sh -c 'rm /nix/fill' machine # [ 526.147301] k3s[836]: E1112 13:23:16.749940 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38178: use of closed network connection" [527.15s] machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -c gc -- sh -c 'rm /nix/fill', in 0.26 seconds) [527.15s] machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' [527.28s] machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.13 seconds) [527.28s] machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 526.426232] k3s[836]: E1112 13:23:17.029114 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38186: use of closed network connection" [527.43s] machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.15 seconds) [527.43s] (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 4.88 seconds) [527.43s] subtest: losing the balancer mid-build: the client reconnects and the build succeeds [527.43s] machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/hlrhbx6b21x6yc6nyl8n6vhivh3jzkbm-slow.nix --argstr tag lb1 machine # [ 526.448218] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/hlrhbx6b21x6yc6nyl8n6vhivh3jzkbm-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: efe3d86b8f244ac48ec2c68456f527a9 [527.45s] machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/hlrhbx6b21x6yc6nyl8n6vhivh3jzkbm-slow.nix --argstr tag lb1, in 0.02 seconds) [527.45s] machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 526.564126] nix[15401]: don't know how to build these paths: machine # [ 526.565938] nix[15401]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 526.571578] garage[834]: 2026-11-12T13:23:17.173896Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 526.572611] garage[834]: 2026-11-12T13:23:17.174410Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 526.582927] garage[834]: 2026-11-12T13:23:17.185859Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 526.588187] garage[834]: 2026-11-12T13:23:17.191099Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 526.591200] garage[834]: 2026-11-12T13:23:17.193245Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 526.591715] garage[834]: 2026-11-12T13:23:17.193648Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 526.599927] garage[834]: 2026-11-12T13:23:17.202839Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 526.600559] garage[834]: 2026-11-12T13:23:17.203313Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 526.602335] nix[15401]: copying 1 paths to '127.0.0.1:30051'... machine # [ 526.603230] nix[15401]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 526.658857] niks3-server[1185]: 2026/11/12 13:23:17 INFO Received push request method=POST path=/api/pushes machine # [ 526.663317] garage[834]: 2026-11-12T13:23:17.266270Z INFO garage_api_common::generic_server: 10.42.0.7:48332 PUT /farm/d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132317Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a90004c5dc4217cb44b87e26ff1a2e886e9c39f5bb4614ff4af5219cb5ff8b2d machine # [ 526.664623] garage[834]: 2026-11-12T13:23:17.267585Z INFO garage_api_common::generic_server: 10.42.0.7:48324 PUT /farm/nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132317Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7bc7206840c2c1b5c711b721616365f9653c6fb55643dfcc77e33f09b575f597 machine # [ 526.666397] garage[834]: 2026-11-12T13:23:17.268884Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 526.667848] niks3-server[1185]: 2026/11/12 13:23:17 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 526.669362] niks3-server[1185]: 2026/11/12 13:23:17 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 526.669784] niks3-server[1185]: 2026/11/12 13:23:17 INFO Signed narinfos id=19 count=1 machine # [ 526.670973] garage[834]: 2026-11-12T13:23:17.273929Z INFO garage_api_common::generic_server: 10.42.0.7:48324 PUT /farm/d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132317Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3ec34b67c59d9ffd44cb27d3f52eff9ef6ada0545c38f84725324b30228b9fdd machine # [ 526.672320] garage[834]: 2026-11-12T13:23:17.274997Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 526.674260] niks3-server[1185]: 2026/11/12 13:23:17 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 526.675819] niks3-server[1185]: 2026/11/12 13:23:17 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 526.677147] garage[834]: 2026-11-12T13:23:17.278540Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 526.677963] niks3-server[1185]: 2026/11/12 13:23:17 INFO Completed push id=19 objects=3 duration=3.147328ms machine # [ 526.678872] niks3-server[1185]: 2026/11/12 13:23:17 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 526.708992] nix[15401]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 526.709376] nix[15401]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv [528.50s] machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.05 seconds) [528.50s] machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false [528.73s] machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.22 seconds) [528.73s] machine: waiting for success: ! systemctl is-active vialb machine # [ 527.744832] nix[15401]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 527.745053] nix[15401]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 527.761895] systemd[1]: cri-containerd-0ad3614c336ff2681ec410bb03d0f2e505f0ac86c63e405351cd080bef97ca9f.scope: Deactivated successfully. machine # [ 527.763692] systemd[1]: cri-containerd-0ad3614c336ff2681ec410bb03d0f2e505f0ac86c63e405351cd080bef97ca9f.scope: Consumed 5.107s CPU time over 8min 9.711s wall clock time, 24M memory peak, 2.1M incoming IP traffic, 3.8M outgoing IP traffic. machine # [ 527.787327] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-0ad3614c336ff2681ec410bb03d0f2e505f0ac86c63e405351cd080bef97ca9f-rootfs.mount: Deactivated successfully. machine # [ 527.816783] systemd[1]: cri-containerd-78de720d2bf7006a39ea1e2af92eb0af9f8039315b1b89f9899a587e3c6a5b77.scope: Deactivated successfully. machine # [ 527.837136] k3s[836]: E1112 13:23:18.439770 836 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5b4c784fd\" failed with read version: 792 is not as new as written version: 808 for group resource replicasets.apps" logger="UnhandledError" machine # [ 527.851494] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-78de720d2bf7006a39ea1e2af92eb0af9f8039315b1b89f9899a587e3c6a5b77-rootfs.mount: Deactivated successfully. machine # [ 527.858885] systemd[1]: Created slice libcontainer container kubepods-besteffort-podf3e19a69_576a_43d7_9e8e_4be0d97d59ee.slice. machine # [ 527.878148] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-78de720d2bf7006a39ea1e2af92eb0af9f8039315b1b89f9899a587e3c6a5b77-shm.mount: Deactivated successfully. machine # [ 528.056407] cni0: port 4(vethd2c025bf) entered disabled state machine # [ 527.909192] dhcpcd[661]: vethd2c025bf: carrier lost machine # [ 528.059016] vethd2c025bf (unregistering): left allmulticast mode machine # [ 528.060199] vethd2c025bf (unregistering): left promiscuous mode machine # [ 528.061416] cni0: port 4(vethd2c025bf) entered disabled state machine # [ 527.926947] systemd[1]: run-netns-cni\x2dfd2a72a2\x2dc8f9\x2d0fc1\x2d274d\x2d9fc882741b2f.mount: Deactivated successfully. machine # [ 527.933483] k3s[836]: I1112 13:23:18.536450 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/f3e19a69-576a-43d7-9e8e-4be0d97d59ee-tls-lb\") pod \"nix-grpc-farm-lb-5b4c784fd-hvmp9\" (UID: \"f3e19a69-576a-43d7-9e8e-4be0d97d59ee\") " pod="farm/nix-grpc-farm-lb-5b4c784fd-hvmp9" machine # [ 527.934109] k3s[836]: I1112 13:23:18.536868 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3e19a69-576a-43d7-9e8e-4be0d97d59ee-tmp\") pod \"nix-grpc-farm-lb-5b4c784fd-hvmp9\" (UID: \"f3e19a69-576a-43d7-9e8e-4be0d97d59ee\") " pod="farm/nix-grpc-farm-lb-5b4c784fd-hvmp9" machine # [ 527.934797] k3s[836]: I1112 13:23:18.536963 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/f3e19a69-576a-43d7-9e8e-4be0d97d59ee-tls-ca\") pod \"nix-grpc-farm-lb-5b4c784fd-hvmp9\" (UID: \"f3e19a69-576a-43d7-9e8e-4be0d97d59ee\") " pod="farm/nix-grpc-farm-lb-5b4c784fd-hvmp9" machine # [ 527.935754] k3s[836]: I1112 13:23:18.538714 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3e19a69-576a-43d7-9e8e-4be0d97d59ee-config\") pod \"nix-grpc-farm-lb-5b4c784fd-hvmp9\" (UID: \"f3e19a69-576a-43d7-9e8e-4be0d97d59ee\") " pod="farm/nix-grpc-farm-lb-5b4c784fd-hvmp9" machine # [ 527.956174] dhcpcd[661]: vethd2c025bf: deleting address fe80::78c7:4cff:fe61:b5a9 machine # [ 527.959390] dhcpcd[661]: vethd2c025bf: deleting route to 169.254.0.0/16 machine # [ 528.016358] dhcpcd[661]: vethd2c025bf: removing interface machine # [ 528.036222] k3s[836]: I1112 13:23:18.639169 836 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a316198e-7639-4476-a07f-dd00baffe7de-config\" (UniqueName: \"kubernetes.io/configmap/a316198e-7639-4476-a07f-dd00baffe7de-config\") pod \"a316198e-7639-4476-a07f-dd00baffe7de\" (UID: \"a316198e-7639-4476-a07f-dd00baffe7de\") " machine # [ 528.036538] k3s[836]: I1112 13:23:18.639232 836 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a316198e-7639-4476-a07f-dd00baffe7de-tmp\" (UniqueName: \"kubernetes.io/empty-dir/a316198e-7639-4476-a07f-dd00baffe7de-tmp\") pod \"a316198e-7639-4476-a07f-dd00baffe7de\" (UID: \"a316198e-7639-4476-a07f-dd00baffe7de\") " machine # [ 528.036944] k3s[836]: I1112 13:23:18.639261 836 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a316198e-7639-4476-a07f-dd00baffe7de-tls-lb\" (UniqueName: \"kubernetes.io/secret/a316198e-7639-4476-a07f-dd00baffe7de-tls-lb\") pod \"a316198e-7639-4476-a07f-dd00baffe7de\" (UID: \"a316198e-7639-4476-a07f-dd00baffe7de\") " machine # [ 528.037662] k3s[836]: I1112 13:23:18.639296 836 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a316198e-7639-4476-a07f-dd00baffe7de-tls-ca\" (UniqueName: \"kubernetes.io/secret/a316198e-7639-4476-a07f-dd00baffe7de-tls-ca\") pod \"a316198e-7639-4476-a07f-dd00baffe7de\" (UID: \"a316198e-7639-4476-a07f-dd00baffe7de\") " machine # [ 528.040238] systemd[1]: var-lib-kubelet-pods-a316198e\x2d7639\x2d4476\x2da07f\x2ddd00baffe7de-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 528.056121] k3s[836]: I1112 13:23:18.659073 836 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a316198e-7639-4476-a07f-dd00baffe7de-tmp" pod "a316198e-7639-4476-a07f-dd00baffe7de" (UID: "a316198e-7639-4476-a07f-dd00baffe7de"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 528.056646] k3s[836]: I1112 13:23:18.659179 836 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a316198e-7639-4476-a07f-dd00baffe7de-tls-ca" pod "a316198e-7639-4476-a07f-dd00baffe7de" (UID: "a316198e-7639-4476-a07f-dd00baffe7de"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 528.066289] k3s[836]: I1112 13:23:18.669228 836 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a316198e-7639-4476-a07f-dd00baffe7de-tls-lb" pod "a316198e-7639-4476-a07f-dd00baffe7de" (UID: "a316198e-7639-4476-a07f-dd00baffe7de"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 528.076867] k3s[836]: I1112 13:23:18.679833 836 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a316198e-7639-4476-a07f-dd00baffe7de-config" pod "a316198e-7639-4476-a07f-dd00baffe7de" (UID: "a316198e-7639-4476-a07f-dd00baffe7de"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 528.136853] k3s[836]: I1112 13:23:18.739787 836 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a316198e-7639-4476-a07f-dd00baffe7de-config\") on node \"machine\" DevicePath \"\"" machine # [ 528.139939] k3s[836]: I1112 13:23:18.739812 836 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a316198e-7639-4476-a07f-dd00baffe7de-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 528.140629] k3s[836]: I1112 13:23:18.739824 836 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/a316198e-7639-4476-a07f-dd00baffe7de-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 528.141675] k3s[836]: I1112 13:23:18.739836 836 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/a316198e-7639-4476-a07f-dd00baffe7de-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 528.336587] cni0: port 2(veth05859ff2) entered blocking state machine # [ 528.337630] cni0: port 2(veth05859ff2) entered disabled state machine # [ 528.338490] veth05859ff2: entered allmulticast mode machine # [ 528.339758] veth05859ff2: entered promiscuous mode machine # [ 528.192303] (udev-worker)[15597]: Network interface NamePolicy= disabled on kernel command line. machine # [ 528.348458] cni0: port 2(veth05859ff2) entered blocking state machine # [ 528.349337] cni0: port 2(veth05859ff2) entered forwarding state machine # [ 528.217920] dhcpcd[661]: veth05859ff2: IAID 27:a9:29:b8 machine # [ 528.218330] dhcpcd[661]: veth05859ff2: adding address fe80::fc6c:27ff:fea9:29b8 machine # [ 528.274492] systemd[1]: Started libcontainer container f6a77869a18a64474494bb1fb5903059defdc8d2af8faefdea82cd39c178f685. machine # [ 528.396304] systemd[1]: Started libcontainer container 9548946d92b12df4f2d33c2dfc0f08ad1b456b700fe4b84ce7f6ddcc82cc4a31. machine # [ 528.570178] k3s[836]: I1112 13:23:19.172066 836 scope.go:122] "RemoveContainer" containerID="0ad3614c336ff2681ec410bb03d0f2e505f0ac86c63e405351cd080bef97ca9f" machine # [ 528.577798] systemd[1]: Removed slice libcontainer container kubepods-besteffort-poda316198e_7639_4476_a07f_dd00baffe7de.slice. machine # [ 528.579616] systemd[1]: kubepods-besteffort-poda316198e_7639_4476_a07f_dd00baffe7de.slice: Consumed 5.141s CPU time over 8min 12.603s wall clock time, 24.2M memory peak, 2.1M incoming IP traffic, 3.8M outgoing IP traffic. machine # [ 528.585379] k3s[836]: I1112 13:23:19.188224 836 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5b4c784fd-hvmp9" podStartSLOduration=1.187905526 podStartE2EDuration="1.187905526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-12 13:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-12 13:23:19.067691085 +0000 UTC m=+511.148406234" watchObservedRunningTime="2026-11-12 13:23:19.187905526 +0000 UTC m=+511.268620675" machine # [ 528.592883] k3s[836]: I1112 13:23:19.195828 836 scope.go:122] "RemoveContainer" containerID="0ad3614c336ff2681ec410bb03d0f2e505f0ac86c63e405351cd080bef97ca9f" machine # [ 528.595054] k3s[836]: E1112 13:23:19.197022 836 remote_runtime.go:569] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"0ad3614c336ff2681ec410bb03d0f2e505f0ac86c63e405351cd080bef97ca9f\": not found" containerID="0ad3614c336ff2681ec410bb03d0f2e505f0ac86c63e405351cd080bef97ca9f" machine # [ 528.599403] k3s[836]: I1112 13:23:19.197077 836 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"0ad3614c336ff2681ec410bb03d0f2e505f0ac86c63e405351cd080bef97ca9f"} err="failed to get container status \"0ad3614c336ff2681ec410bb03d0f2e505f0ac86c63e405351cd080bef97ca9f\": rpc error: code = NotFound desc = an error occurred when try to find container \"0ad3614c336ff2681ec410bb03d0f2e505f0ac86c63e405351cd080bef97ca9f\": not found" machine # [ 528.793122] systemd[1]: var-lib-kubelet-pods-a316198e\x2d7639\x2d4476\x2da07f\x2ddd00baffe7de-volume\x2dsubpaths-config-envoy-3.mount: Deactivated successfully. machine # [ 528.793375] systemd[1]: var-lib-kubelet-pods-a316198e\x2d7639\x2d4476\x2da07f\x2ddd00baffe7de-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 528.793863] systemd[1]: var-lib-kubelet-pods-a316198e\x2d7639\x2d4476\x2da07f\x2ddd00baffe7de-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 528.794594] systemd[1]: var-lib-kubelet-pods-a316198e\x2d7639\x2d4476\x2da07f\x2ddd00baffe7de-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 528.795107] systemd[1]: var-lib-kubelet-pods-a316198e\x2d7639\x2d4476\x2da07f\x2ddd00baffe7de-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 528.795621] systemd[1]: var-lib-kubelet-pods-a316198e\x2d7639\x2d4476\x2da07f\x2ddd00baffe7de-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 529.950539] dhcpcd[661]: veth05859ff2: soliciting a DHCP lease machine # [ 530.247471] nix[15401]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 530.440930] dhcpcd[661]: veth05859ff2: soliciting an IPv6 router machine # [ 530.598381] k3s[836]: I1112 13:23:21.200405 836 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a316198e-7639-4476-a07f-dd00baffe7de" path="/var/lib/kubelet/pods/a316198e-7639-4476-a07f-dd00baffe7de/volumes" machine # [ 531.276839] garage[834]: 2026-11-12T13:23:21.879132Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 531.283647] garage[834]: 2026-11-12T13:23:21.886522Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) GET /farm/d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 531.293346] garage[834]: 2026-11-12T13:23:21.896246Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 531.294711] garage[834]: 2026-11-12T13:23:21.897621Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) GET /farm/nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 531.321940] nix[15401]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 531.323071] nix[15401]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-86f859bf44-95c8c: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 534.951768] dhcpcd[661]: veth05859ff2: probing for an IPv4LL address machine # [ 539.328535] dhcpcd[661]: veth05859ff2: using IPv4LL address 169.254.151.128 machine # [ 539.329452] dhcpcd[661]: veth05859ff2: adding route to 169.254.0.0/16 machine # [ 542.445160] dhcpcd[661]: veth05859ff2: no IPv6 Routers available machine # [ 555.844988] garage[834]: 2026-11-12T13:23:46.447097Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 555.845519] garage[834]: 2026-11-12T13:23:46.447633Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 555.848153] garage[834]: 2026-11-12T13:23:46.451029Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 555.850113] garage[834]: 2026-11-12T13:23:46.451624Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 576.063070] niks3-server[1185]: 2026/11/12 13:24:06 INFO Received push request method=POST path=/api/pushes machine # [ 576.069593] garage[834]: 2026-11-12T13:24:06.671766Z INFO garage_api_common::generic_server: 10.42.0.6:41370 PUT /farm/2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132406Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=848a8f02a27314f94b38f07751244d1879be613be5161e67f37f3050413204f2 machine # [ 576.082102] garage[834]: 2026-11-12T13:24:06.674864Z INFO garage_api_common::generic_server: 10.42.0.6:41370 PUT /farm/log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132406Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fc12a895aad813fab2bca351ae40fa8e12b6564d016f2dc8f8c56332e199ee37 machine # [ 576.094551] garage[834]: 2026-11-12T13:24:06.675390Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 576.100516] garage[834]: 2026-11-12T13:24:06.682530Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 576.106893] niks3-server[1185]: 2026/11/12 13:24:06 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 576.110225] niks3-server[1185]: 2026/11/12 13:24:06 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 576.113181] niks3-server[1185]: 2026/11/12 13:24:06 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 576.116443] niks3-server[1185]: 2026/11/12 13:24:06 INFO Signed narinfos id=20 count=1 machine # [ 576.118559] niks3-server[1185]: 2026/11/12 13:24:06 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 576.121567] niks3-server[1185]: 2026/11/12 13:24:06 INFO Completed push id=20 objects=4 duration=4.440788ms machine # [ 576.124100] niks3-server[1185]: 2026/11/12 13:24:06 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 576.127279] garage[834]: 2026-11-12T13:24:06.686875Z INFO garage_api_common::generic_server: 10.42.0.6:41370 PUT /farm/2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132406Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ff7b44ea474369bb8407835b9fe9aa695301abb8f5d7fc9b81b4bc3f2769bcac machine # [ 576.133902] garage[834]: 2026-11-12T13:24:06.690685Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 576.136916] systemd[1]: vialb.service: Deactivated successfully. machine # [ 576.137933] systemd[1]: vialb.service: Consumed 153ms CPU time over 49.679s wall clock time, 36M memory peak, 4K written to disk, 10.8K incoming IP traffic, 18.3K outgoing IP traffic. [577.46s] machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.73 seconds) [577.46s] machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } [577.49s] machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds) [577.49s] machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s [577.69s] machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.20 seconds) [577.69s] (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.27 seconds) [577.69s] subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes [577.70s] machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/hlrhbx6b21x6yc6nyl8n6vhivh3jzkbm-slow.nix --argstr tag s1 machine # [ 576.713897] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/hlrhbx6b21x6yc6nyl8n6vhivh3jzkbm-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: dba5d4b9547a4f8cb54dcb8c4a824f3c [577.72s] machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/xgq8r9famb27sk2gfm3jmp3n340f1sjq-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/hlrhbx6b21x6yc6nyl8n6vhivh3jzkbm-slow.nix --argstr tag s1, in 0.03 seconds) machine # [ 576.835976] nix[16945]: don't know how to build these paths: machine # [ 576.836425] nix[16945]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 576.837667] garage[834]: 2026-11-12T13:24:07.440564Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 576.838217] garage[834]: 2026-11-12T13:24:07.440841Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 576.840802] garage[834]: 2026-11-12T13:24:07.443768Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 576.841667] garage[834]: 2026-11-12T13:24:07.443957Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 576.842171] garage[834]: 2026-11-12T13:24:07.445082Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 576.842699] garage[834]: 2026-11-12T13:24:07.445249Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 576.849027] garage[834]: 2026-11-12T13:24:07.451972Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 576.849781] garage[834]: 2026-11-12T13:24:07.452182Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 576.850666] nix[16945]: copying 1 paths to '127.0.0.1:30051'... machine # [ 576.851316] nix[16945]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 576.888351] niks3-server[1185]: 2026/11/12 13:24:07 INFO Received push request method=POST path=/api/pushes machine # [ 576.892704] garage[834]: 2026-11-12T13:24:07.495648Z INFO garage_api_common::generic_server: 10.42.0.6:41370 PUT /farm/nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132407Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4021cc0bab171c1cd15d715aab4870e0e6f8f8d285ebfd7bc395c2738be6d3c7 machine # [ 576.894211] garage[834]: 2026-11-12T13:24:07.497004Z INFO garage_api_common::generic_server: 10.42.0.6:41376 PUT /farm/zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132407Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9c45eea620910dd0f1cc827bd313b16c7ca2daf17a9412e611e4d182957b069d machine # [ 576.895878] garage[834]: 2026-11-12T13:24:07.498856Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 576.897899] niks3-server[1185]: 2026/11/12 13:24:07 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 576.898669] niks3-server[1185]: 2026/11/12 13:24:07 INFO Signed narinfos id=21 count=1 machine # [ 576.899196] garage[834]: 2026-11-12T13:24:07.501935Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 576.900123] garage[834]: 2026-11-12T13:24:07.503090Z INFO garage_api_common::generic_server: 10.42.0.6:41376 PUT /farm/zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132407Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1508dfe0d031bbe117821f2774fa54036fb07440045d090e285cbc1406a1a288 machine # [ 576.900801] niks3-server[1185]: 2026/11/12 13:24:07 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 576.901663] niks3-server[1185]: 2026/11/12 13:24:07 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 576.902996] niks3-server[1185]: 2026/11/12 13:24:07 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 576.903666] garage[834]: 2026-11-12T13:24:07.506429Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 576.904190] niks3-server[1185]: 2026/11/12 13:24:07 INFO Completed push id=21 objects=3 duration=2.236038ms machine # [ 576.904905] niks3-server[1185]: 2026/11/12 13:24:07 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 576.936741] garage[834]: 2026-11-12T13:24:07.539701Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 576.937636] garage[834]: 2026-11-12T13:24:07.540386Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) GET /farm/zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 576.943580] garage[834]: 2026-11-12T13:24:07.546566Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 576.944967] garage[834]: 2026-11-12T13:24:07.547680Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) GET /farm/nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 576.955978] nix[16945]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 576.956508] nix[16945]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 576.967389] k3s[836]: E1112 13:24:07.569721 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:58974: use of closed network connection" machine # command terminated with exit code 1 machine # [ 577.136605] k3s[836]: E1112 13:24:07.739518 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:58990: use of closed network connection" machine # command terminated with exit code 1 machine # [ 578.427342] k3s[836]: E1112 13:24:09.029546 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59002: use of closed network connection" machine # command terminated with exit code 1 machine # [ 578.604240] k3s[836]: E1112 13:24:09.207153 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59010: use of closed network connection" machine # command terminated with exit code 1 machine # [ 579.812515] k3s[836]: E1112 13:24:10.415145 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59012: use of closed network connection" machine # command terminated with exit code 1 machine # [ 579.973517] k3s[836]: E1112 13:24:10.576437 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59016: use of closed network connection" machine # command terminated with exit code 1 machine # [ 581.253537] k3s[836]: E1112 13:24:11.856154 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59032: use of closed network connection" machine # command terminated with exit code 1 machine # [ 581.416665] k3s[836]: E1112 13:24:12.019576 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59048: use of closed network connection" machine # command terminated with exit code 1 machine # [ 582.732770] k3s[836]: E1112 13:24:13.335420 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59060: use of closed network connection" machine # command terminated with exit code 1 machine # [ 582.925177] k3s[836]: E1112 13:24:13.527971 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59066: use of closed network connection" machine # command terminated with exit code 1 machine # [ 584.162821] k3s[836]: E1112 13:24:14.765397 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35212: use of closed network connection" machine # command terminated with exit code 1 machine # [ 584.325762] k3s[836]: E1112 13:24:14.928681 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35226: use of closed network connection" machine # command terminated with exit code 1 machine # [ 585.569486] k3s[836]: E1112 13:24:16.172027 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35242: use of closed network connection" machine # command terminated with exit code 1 machine # [ 585.752281] k3s[836]: E1112 13:24:16.355196 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35248: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 587.064408] k3s[836]: E1112 13:24:17.666396 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35252: use of closed network connection" machine # [ 587.252420] k3s[836]: E1112 13:24:17.855299 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35260: use of closed network connection" machine # command terminated with exit code 1 machine # [ 588.543987] k3s[836]: E1112 13:24:19.146645 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35274: use of closed network connection" machine # command terminated with exit code 1 machine # [ 588.742357] k3s[836]: E1112 13:24:19.345252 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35282: use of closed network connection" machine # command terminated with exit code 1 machine # [ 589.945917] k3s[836]: E1112 13:24:20.548568 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35284: use of closed network connection" machine # command terminated with exit code 1 machine # [ 590.110259] k3s[836]: E1112 13:24:20.713170 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35290: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 591.393882] k3s[836]: E1112 13:24:21.995635 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35298: use of closed network connection" machine # [ 591.620069] k3s[836]: E1112 13:24:22.222960 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35304: use of closed network connection" machine # command terminated with exit code 1 machine # [ 592.915706] k3s[836]: E1112 13:24:23.518353 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35312: use of closed network connection" machine # command terminated with exit code 1 machine # [ 593.141672] k3s[836]: E1112 13:24:23.744600 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59098: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 594.399120] k3s[836]: E1112 13:24:25.001197 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59114: use of closed network connection" machine # [ 594.586143] k3s[836]: E1112 13:24:25.189075 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59120: use of closed network connection" machine # command terminated with exit code 1 machine # [ 595.858810] k3s[836]: E1112 13:24:26.461165 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59124: use of closed network connection" machine # command terminated with exit code 1 machine # [ 596.050189] k3s[836]: E1112 13:24:26.653121 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59136: use of closed network connection" machine # command terminated with exit code 1 machine # [ 597.312528] k3s[836]: E1112 13:24:27.914976 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59150: use of closed network connection" machine # command terminated with exit code 1 machine # [ 597.511875] k3s[836]: E1112 13:24:28.114780 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59160: use of closed network connection" machine # command terminated with exit code 1 machine # [ 598.786057] k3s[836]: E1112 13:24:29.388666 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59176: use of closed network connection" machine # command terminated with exit code 1 machine # [ 598.983127] k3s[836]: E1112 13:24:29.586053 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59182: use of closed network connection" machine # command terminated with exit code 1 machine # [ 600.233312] k3s[836]: E1112 13:24:30.835783 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59196: use of closed network connection" machine # command terminated with exit code 1 machine # [ 600.411757] k3s[836]: E1112 13:24:31.014321 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59210: use of closed network connection" machine # command terminated with exit code 1 machine # [ 601.074402] garage[834]: 2026-11-12T13:24:31.676597Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 601.074776] garage[834]: 2026-11-12T13:24:31.677220Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 601.087896] garage[834]: 2026-11-12T13:24:31.690799Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 601.088651] garage[834]: 2026-11-12T13:24:31.691251Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found machine # [ 601.657483] k3s[836]: E1112 13:24:32.259874 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59214: use of closed network connection" machine # command terminated with exit code 1 machine # [ 601.832044] k3s[836]: E1112 13:24:32.434902 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59218: use of closed network connection" machine # [ 601.996050] k3s[836]: E1112 13:24:32.598954 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59222: use of closed network connection" machine # command terminated with exit code 1 machine # [ 602.161628] k3s[836]: E1112 13:24:32.764550 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59236: use of closed network connection" [603.17s] machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j --wait=false [603.30s] machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-86f859bf44-mr67j --wait=false, in 0.14 seconds) [603.30s] machine: must succeed: sleep 5.0 machine # [ 602.362957] systemd[1]: Created slice libcontainer container kubepods-besteffort-podd28d9046_a7a1_4c50_99ad_f5fdefbeef46.slice. machine # [ 602.369301] systemd[1]: cri-containerd-bd81b2f15ff3393c9180d21743568ac35ccf8451b6bfb419e9542b497526e54f.scope: Deactivated successfully. machine # [ 602.369640] systemd[1]: cri-containerd-bd81b2f15ff3393c9180d21743568ac35ccf8451b6bfb419e9542b497526e54f.scope: Consumed 514ms CPU time over 9min 17.120s wall clock time, 12.3M memory peak, 5.2M read from disk. machine # [ 602.402968] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-bd81b2f15ff3393c9180d21743568ac35ccf8451b6bfb419e9542b497526e54f-rootfs.mount: Deactivated successfully. machine # [ 602.447982] k3s[836]: I1112 13:24:33.050811 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/d28d9046-a7a1-4c50-99ad-f5fdefbeef46-build\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc\" (UID: \"d28d9046-a7a1-4c50-99ad-f5fdefbeef46\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc" machine # [ 602.448260] k3s[836]: I1112 13:24:33.050852 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/d28d9046-a7a1-4c50-99ad-f5fdefbeef46-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc\" (UID: \"d28d9046-a7a1-4c50-99ad-f5fdefbeef46\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc" machine # [ 602.449112] k3s[836]: I1112 13:24:33.050885 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/d28d9046-a7a1-4c50-99ad-f5fdefbeef46-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc\" (UID: \"d28d9046-a7a1-4c50-99ad-f5fdefbeef46\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc" machine # [ 602.449256] k3s[836]: I1112 13:24:33.050911 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/d28d9046-a7a1-4c50-99ad-f5fdefbeef46-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc\" (UID: \"d28d9046-a7a1-4c50-99ad-f5fdefbeef46\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc" machine # [ 602.449973] k3s[836]: I1112 13:24:33.050984 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d28d9046-a7a1-4c50-99ad-f5fdefbeef46-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc\" (UID: \"d28d9046-a7a1-4c50-99ad-f5fdefbeef46\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc" machine # [ 602.450646] k3s[836]: I1112 13:24:33.051062 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/d28d9046-a7a1-4c50-99ad-f5fdefbeef46-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc\" (UID: \"d28d9046-a7a1-4c50-99ad-f5fdefbeef46\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc" machine # [ 602.474900] k3s[836]: I1112 13:24:33.077839 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dkh8\" (UniqueName: \"kubernetes.io/projected/d28d9046-a7a1-4c50-99ad-f5fdefbeef46-kube-api-access-8dkh8\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc\" (UID: \"d28d9046-a7a1-4c50-99ad-f5fdefbeef46\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc" machine # [ 602.479965] k3s[836]: I1112 13:24:33.082941 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/d28d9046-a7a1-4c50-99ad-f5fdefbeef46-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc\" (UID: \"d28d9046-a7a1-4c50-99ad-f5fdefbeef46\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc" machine # [ 602.480447] k3s[836]: I1112 13:24:33.082986 836 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/d28d9046-a7a1-4c50-99ad-f5fdefbeef46-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc\" (UID: \"d28d9046-a7a1-4c50-99ad-f5fdefbeef46\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc" machine # [ 602.889888] cni0: port 4(vethcb523e92) entered blocking state machine # [ 602.892399] cni0: port 4(vethcb523e92) entered disabled state machine # [ 602.894754] vethcb523e92: entered allmulticast mode machine # [ 602.896949] vethcb523e92: entered promiscuous mode machine # [ 602.909077] cni0: port 4(vethcb523e92) entered blocking state machine # [ 602.911022] cni0: port 4(vethcb523e92) entered forwarding state machine # [ 602.804609] (udev-worker)[18850]: Network interface NamePolicy= disabled on kernel command line. machine # [ 602.831084] dhcpcd[661]: vethcb523e92: IAID ac:38:dc:a2 machine # [ 602.831649] dhcpcd[661]: vethcb523e92: adding address fe80::1495:acff:fe38:dca2 machine # [ 602.863432] systemd[1]: Started libcontainer container 5b0bdc7a2dd148364386ebdf27d7b13394c7e8cc7eb9c573eeb58a91e8c0e03c. machine # [ 603.058363] systemd[1]: Started libcontainer container 0ba4103e228f0ebce4a2fc5ad576ffc98a64a657fa749558da5705d243e695e5. machine # [ 604.178792] systemd[1]: cri-containerd-0ba4103e228f0ebce4a2fc5ad576ffc98a64a657fa749558da5705d243e695e5.scope: Deactivated successfully. machine # [ 604.180647] systemd[1]: cri-containerd-0ba4103e228f0ebce4a2fc5ad576ffc98a64a657fa749558da5705d243e695e5.scope: Consumed 572ms CPU time over 1.119s wall clock time, 448.2M memory peak, 164.2M read from disk, 13.5M written to disk. machine # [ 604.242288] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-0ba4103e228f0ebce4a2fc5ad576ffc98a64a657fa749558da5705d243e695e5-rootfs.mount: Deactivated successfully. machine # [ 604.268231] dhcpcd[661]: vethcb523e92: soliciting an IPv6 router machine # [ 604.341045] dhcpcd[661]: vethcb523e92: soliciting a DHCP lease machine # [ 604.682827] k3s[836]: E1112 13:24:35.285362 836 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="cc28b3ac505028f706219af10b40712a94b379335841bf99fe2f0a05b7cb5520" cmd=["nix","store","info","--store","daemon"] machine # [ 604.683128] k3s[836]: E1112 13:24:35.285589 836 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="cc28b3ac505028f706219af10b40712a94b379335841bf99fe2f0a05b7cb5520" cmd=["nix","store","info","--store","daemon"] machine # [ 604.684178] k3s[836]: E1112 13:24:35.285711 836 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="cc28b3ac505028f706219af10b40712a94b379335841bf99fe2f0a05b7cb5520" cmd=["nix","store","info","--store","daemon"] machine # [ 605.069384] systemd[1]: tmp-ovl\x2didmapped2088277647.mount: Deactivated successfully. machine # [ 605.087338] systemd[1]: Started libcontainer container 7ddbf20101db4bb26e15fe3f6f4f0ff2ea41e4cd78399ef34e8f3df165ccadb2. machine # [ 605.286538] systemd[1]: Started libcontainer container e1393b1466d4dfdff9dabc738778687fa270262c7064581a70e8e308bd6e9570. machine # [ 605.462349] systemd[1]: Started libcontainer container 029fe9ec52a78f108cb338d5fdeb7c12df0ee49697596d613e2c1cf3dde7afb0. machine # [ 605.909536] systemd[1]: tmp-ovl\x2didmapped176214474.mount: Deactivated successfully. [608.33s] machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # command terminated with exit code 1 machine # [ 607.702390] k3s[836]: I1112 13:24:38.304897 836 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-86f859bf44-9kxzc" podStartSLOduration=5.213503463 podStartE2EDuration="6.30487569s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.091372227s" isStatefulPod=false podCreationTimestamp="2026-11-12 13:24:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-12 13:24:36.128974843 +0000 UTC m=+588.209690271" watchObservedRunningTime="2026-11-12 13:24:38.30487569 +0000 UTC m=+590.385591119" machine # [ 607.741762] k3s[836]: E1112 13:24:38.344692 836 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:58584: use of closed network connection" [608.75s] machine: waiting for success: ! systemctl is-active slow machine # [ 609.342290] dhcpcd[661]: vethcb523e92: probing for an IPv4LL address machine # [ 609.683757] k3s[836]: E1112 13:24:40.285741 836 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="cc28b3ac505028f706219af10b40712a94b379335841bf99fe2f0a05b7cb5520" cmd=["nix","store","info","--store","daemon"] machine # [ 609.684547] k3s[836]: E1112 13:24:40.285954 836 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="cc28b3ac505028f706219af10b40712a94b379335841bf99fe2f0a05b7cb5520" cmd=["nix","store","info","--store","daemon"] machine # [ 609.686168] k3s[836]: E1112 13:24:40.286139 836 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="cc28b3ac505028f706219af10b40712a94b379335841bf99fe2f0a05b7cb5520" cmd=["nix","store","info","--store","daemon"] machine # [ 610.163897] postgres[714]: [714] LOG: checkpoint starting: time machine # [ 612.702336] postgres[714]: [714] LOG: checkpoint complete: wrote 25 buffers (0.2%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.514 s, sync=0.009 s, total=2.539 s; sync files=24, longest=0.003 s, average=0.001 s; distance=236 kB, estimate=4561 kB; lsn=0/1C8D988, redo lsn=0/1C8D930 machine # [ 614.675523] dhcpcd[661]: vethcb523e92: using IPv4LL address 169.254.22.122 machine # [ 614.676062] dhcpcd[661]: vethcb523e92: adding route to 169.254.0.0/16 machine # [ 614.685181] k3s[836]: E1112 13:24:45.285862 836 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="cc28b3ac505028f706219af10b40712a94b379335841bf99fe2f0a05b7cb5520" cmd=["nix","store","info","--store","daemon"] machine # [ 614.686761] k3s[836]: E1112 13:24:45.286127 836 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="cc28b3ac505028f706219af10b40712a94b379335841bf99fe2f0a05b7cb5520" cmd=["nix","store","info","--store","daemon"] machine # [ 614.688258] k3s[836]: E1112 13:24:45.286260 836 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="cc28b3ac505028f706219af10b40712a94b379335841bf99fe2f0a05b7cb5520" cmd=["nix","store","info","--store","daemon"] machine # [ 615.887768] garage[834]: 2026-11-12T13:24:46.489942Z INFO garage_table::sync: bucket_v2: Adding full sync for ack layout version 1 machine # [ 615.888189] garage[834]: 2026-11-12T13:24:46.490014Z INFO garage_table::sync: bucket_alias: Adding full sync for ack layout version 1 machine # [ 615.889230] garage[834]: 2026-11-12T13:24:46.490100Z INFO garage_table::sync: key: Adding full sync for ack layout version 1 machine # [ 615.890896] garage[834]: 2026-11-12T13:24:46.490147Z INFO garage_table::sync: bucket_v2: Completed full sync for ack layout version 1 machine # [ 615.892366] garage[834]: 2026-11-12T13:24:46.490174Z INFO garage_table::sync: bucket_alias: Completed full sync for ack layout version 1 machine # [ 615.893569] garage[834]: 2026-11-12T13:24:46.490196Z INFO garage_table::sync: key: Completed full sync for ack layout version 1 machine # [ 615.913533] garage[834]: 2026-11-12T13:24:46.516435Z INFO garage_table::sync: object: Adding full sync for ack layout version 1 machine # [ 615.914219] garage[834]: 2026-11-12T13:24:46.516528Z INFO garage_table::sync: bucket_object_counter: Adding full sync for ack layout version 1 machine # [ 615.915642] garage[834]: 2026-11-12T13:24:46.516595Z INFO garage_table::sync: multipart_upload: Adding full sync for ack layout version 1 machine # [ 615.917344] garage[834]: 2026-11-12T13:24:46.516662Z INFO garage_table::sync: bucket_mpu_counter: Adding full sync for ack layout version 1 machine # [ 615.918895] garage[834]: 2026-11-12T13:24:46.516791Z INFO garage_table::sync: version: Adding full sync for ack layout version 1 machine # [ 615.921312] garage[834]: 2026-11-12T13:24:46.519449Z INFO garage_table::sync: object: Completed full sync for ack layout version 1 machine # [ 615.922489] garage[834]: 2026-11-12T13:24:46.519475Z INFO garage_table::sync: bucket_object_counter: Completed full sync for ack layout version 1 machine # [ 615.923982] garage[834]: 2026-11-12T13:24:46.519494Z INFO garage_table::sync: multipart_upload: Completed full sync for ack layout version 1 machine # [ 615.925176] garage[834]: 2026-11-12T13:24:46.519513Z INFO garage_table::sync: bucket_mpu_counter: Completed full sync for ack layout version 1 machine # [ 615.926423] garage[834]: 2026-11-12T13:24:46.519532Z INFO garage_table::sync: version: Completed full sync for ack layout version 1 machine # [ 615.927944] garage[834]: 2026-11-12T13:24:46.519650Z INFO garage_table::sync: block_ref: Adding full sync for ack layout version 1 machine # [ 615.929566] garage[834]: 2026-11-12T13:24:46.519716Z INFO garage_table::sync: k2v_item: Adding full sync for ack layout version 1 machine # [ 615.930382] garage[834]: 2026-11-12T13:24:46.519781Z INFO garage_table::sync: k2v_index_counter_v2: Adding full sync for ack layout version 1 machine # [ 615.932325] garage[834]: 2026-11-12T13:24:46.521339Z INFO garage_table::sync: block_ref: Completed full sync for ack layout version 1 machine # [ 615.933556] garage[834]: 2026-11-12T13:24:46.521365Z INFO garage_table::sync: k2v_item: Completed full sync for ack layout version 1 machine # [ 615.935110] garage[834]: 2026-11-12T13:24:46.521383Z INFO garage_table::sync: k2v_index_counter_v2: Completed full sync for ack layout version 1 machine # [ 616.272115] dhcpcd[661]: vethcb523e92: no IPv6 Routers available machine # [ 619.683540] k3s[836]: E1112 13:24:50.285724 836 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="cc28b3ac505028f706219af10b40712a94b379335841bf99fe2f0a05b7cb5520" cmd=["nix","store","info","--store","daemon"] machine # [ 619.683987] k3s[836]: E1112 13:24:50.285945 836 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="cc28b3ac505028f706219af10b40712a94b379335841bf99fe2f0a05b7cb5520" cmd=["nix","store","info","--store","daemon"] machine # [ 619.685773] k3s[836]: E1112 13:24:50.286118 836 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="cc28b3ac505028f706219af10b40712a94b379335841bf99fe2f0a05b7cb5520" cmd=["nix","store","info","--store","daemon"] machine # [ 620.529859] k3s[836]: I1112 13:24:51.132456 836 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 621.294196] niks3-server[1185]: 2026/11/12 13:24:51 INFO Received push request method=POST path=/api/pushes machine # [ 621.300190] garage[834]: 2026-11-12T13:24:51.902436Z INFO garage_api_common::generic_server: 10.42.0.7:45774 PUT /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132451Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5eb15ac93dde541665724541e7fb17e632531eaafcba04d8403dc9eb41bf03ce machine # [ 621.312632] garage[834]: 2026-11-12T13:24:51.903171Z INFO garage_api_common::generic_server: 10.42.0.7:45780 PUT /farm/log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132451Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=84f6f288800a354c286dcf3f6b5dcedc389197e58f1584b7658db7a914dd5478 machine # [ 621.322618] garage[834]: 2026-11-12T13:24:51.906714Z INFO garage_api_common::generic_server: 192.168.1.1:40440 (key GK0123456789abcdef01234567) HEAD /farm/log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 621.327556] garage[834]: 2026-11-12T13:24:51.907467Z INFO garage_api_common::generic_server: 192.168.1.1:45870 (key GK0123456789abcdef01234567) HEAD /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 621.332238] garage[834]: 2026-11-12T13:24:51.907726Z INFO garage_api_common::generic_server: 10.42.0.7:45780 PUT /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T132451Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=98a6af23e549d44003884dc68b5aef0f2f272960890e9f94a917713cf8f931d1 machine # [ 621.337679] garage[834]: 2026-11-12T13:24:51.909526Z INFO garage_api_common::generic_server: 192.168.1.1:45870 (key GK0123456789abcdef01234567) HEAD /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 621.340385] niks3-server[1185]: 2026/11/12 13:24:51 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 621.341901] niks3-server[1185]: 2026/11/12 13:24:51 INFO Signed narinfos id=22 count=1 machine # [ 621.343066] niks3-server[1185]: 2026/11/12 13:24:51 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 621.344680] niks3-server[1185]: 2026/11/12 13:24:51 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 621.346516] niks3-server[1185]: 2026/11/12 13:24:51 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 621.348135] niks3-server[1185]: 2026/11/12 13:24:51 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 621.349825] niks3-server[1185]: 2026/11/12 13:24:51 INFO Completed push id=22 objects=4 duration=4.476267ms machine # [ 621.351540] systemd[1]: slow.service: Deactivated successfully. machine # [ 621.352555] systemd[1]: slow.service: Consumed 133ms CPU time over 44.629s wall clock time, 35.8M memory peak, 4K written to disk, 6.5K incoming IP traffic, 12.5K outgoing IP traffic. [623.34s] machine: (finished: waiting for success: ! systemctl is-active slow, in 14.59 seconds) [623.34s] machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } [623.37s] machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.03 seconds) [623.37s] machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' [623.40s] machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) [623.40s] machine: must succeed: nix eval --raw -f /nix/store/hlrhbx6b21x6yc6nyl8n6vhivh3jzkbm-slow.nix --argstr tag s1 outPath [623.54s] machine: (finished: must succeed: nix eval --raw -f /nix/store/hlrhbx6b21x6yc6nyl8n6vhivh3jzkbm-slow.nix --argstr tag s1 outPath, in 0.15 seconds) [623.54s] machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine # [ 622.583475] garage[834]: 2026-11-12T13:24:53.185812Z INFO garage_api_common::generic_server: 192.168.1.1:45870 (key GK0123456789abcdef01234567) HEAD /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 622.588557] garage[834]: 2026-11-12T13:24:53.187107Z INFO garage_api_common::generic_server: 192.168.1.1:45870 (key GK0123456789abcdef01234567) GET /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo [623.59s] machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.05 seconds) [623.59s] (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 45.90 seconds) [623.59s] (finished: run the VM test script, in 623.59 seconds) [623.64s] test script finished in 623.64s [623.64s] cleanup [623.64s] kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/xahxrjs30p3mw0a42bqg9ikgkikskw8m-python3-3.14.8/bin/python3.14) machine # [2026-11-12T13:24:53Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-11-12T13:24:53Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-11-12T13:24:53Z INFO virtiofsd] Client disconnected, shutting down [624.69s] (finished: cleanup, in 1.05 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh