tribuchet: building on eliza [0.00s] Machine state will be reset. To keep it, pass --keep-machine-state [0.01s] start all VLans [2.71s] (finished: start all VLans, in 2.70 seconds) [2.71s] start vhost-device-vsock [2.72s] (finished: start vhost-device-vsock, in 0.00 seconds) [2.72s] Test will time out and terminate in 1800.0 seconds [2.72s] run the VM test script [2.72s] start all VMs [2.72s] client: starting vm [4.35s] lb: starting vm [4.36s] worker1: starting vm [4.36s] worker2: starting vm lb # Disk image does not exist, creating the virtualisation disk image... [45.17s] lb: QEMU running (pid 54) lb # Formatting '/build/vm-state-lb/tmp.dNTtQDRbj1', fmt=raw size=2147483648 lb # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/524288 done lb # Creating filesystem with 524288 4k blocks and 131072 inodes lb # Filesystem UUID: a85cf1fb-224b-4095-82f3-8010ee0bd486 lb # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376, 294912 lb # lb # Allocating group tables: 0/16 done lb # Writing inode tables: 0/16 done lb # Creating journal (16384 blocks): done lb # Writing superblocks and filesystem accounting information: 0/16 done lb # lb # Virtualisation disk image created. lb # Starting virtiofs daemons... lb # [2026-11-12T09:17:46Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-11-12T09:17:46Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-11-12T09:17:46Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-11-12T09:17:46Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-11-12T09:17:46Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-11-12T09:17:46Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-11-12T09:17:46Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-11-12T09:17:46Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-11-12T09:17:46Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-11-12T09:17:47Z INFO virtiofsd] Client connected, servicing requests lb # [2026-11-12T09:17:47Z INFO virtiofsd] Client connected, servicing requests lb # [2026-11-12T09:17:47Z INFO virtiofsd] Client connected, servicing requests lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] Linux version 6.18.60 (nixbld@localhost) (gcc (GCC) 16.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT @1793362001 lb # [ 0.000000] KASLR enabled lb # [ 0.000000] random: crng init done lb # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] efi: UEFI not found. lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] Zone ranges: lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] DMA32 empty lb # [ 0.000000] Normal empty lb # [ 0.000000] Device empty lb # [ 0.000000] Movable zone start for each node lb # [ 0.000000] Early memory node ranges lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] percpu: Embedded 76 pages/cpu s187672 r8192 d115432 u311296 lb # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/fn162mvn6rkqz600ashkpyjdnns9kvr5-nixos-system-lb-test/init regInfo=/nix/.ro-store/vs1aayyq6wgpkz6jk4c7vryw0z2jb3am-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/.ro-store/vs1aayyq6wgpkz6jk4c7vryw0z2jb3am-closure-info/registration", will be passed to user space. lb # [ 0.000000] printk: log buffer data + meta data: 1048576 + 3670016 = 4718592 bytes lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000000] Policy zone: DMA lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] ftrace: allocating 75323 entries in 296 pages lb # [ 0.000000] ftrace: allocated 296 pages with 3 groups lb # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] rcu: RCU event tracing is enabled. lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=1. lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] Rude variant of Tasks RCU enabled. lb # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @44de0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44df0000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.000000] GICv3: using LPI property table @0x0000000044e10000 lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044e20000 lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.000033] arm-pv: using stolen time PV lb # [ 0.000378] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.000562] Console: colour dummy device 80x25 lb # [ 0.000570] printk: legacy console [tty0] enabled lb # [ 0.000768] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.000777] pid_max: default: 32768 minimum: 301 lb # [ 0.000956] LSM: initializing lsm=lockdown,capability,landlock,yama,bpf,ima lb # [ 0.001115] landlock: Up and running. lb # [ 0.001119] Yama: becoming mindful. lb # [ 0.001602] LSM support for eBPF active lb # [ 0.001753] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.001793] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.004232] rcu: Hierarchical SRCU implementation. lb # [ 0.004239] rcu: Max phase no-delay instances is 1000. lb # [ 0.007244] fsl-mc MSI: its@8080000 domain created lb # [ 0.007365] EFI services will not be available. lb # [ 0.007452] smp: Bringing up secondary CPUs ... lb # [ 0.007463] smp: Brought up 1 node, 1 CPU lb # [ 0.007467] SMP: Total of 1 processors activated. lb # [ 0.007469] CPU: All CPU(s) started at EL1 lb # [ 0.007482] CPU features: detected: Branch Target Identification lb # [ 0.007486] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.007489] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.007497] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.007502] CPU features: detected: Common not Private translations lb # [ 0.007505] CPU features: detected: CRC32 instructions lb # [ 0.007508] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.007511] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.007514] CPU features: detected: Data independent timing control (DIT) lb # [ 0.007517] CPU features: detected: E0PD lb # [ 0.007519] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.007523] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.007526] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.007529] CPU features: detected: Fine Grained Traps lb # [ 0.007532] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.007537] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.007540] CPU features: detected: LSE atomic instructions lb # [ 0.007543] CPU features: detected: Privileged Access Never lb # [ 0.007546] CPU features: detected: PMUv3 lb # [ 0.007549] CPU features: detected: RAS Extension Support lb # [ 0.007552] CPU features: detected: RASv1p1 Extension Support lb # [ 0.007557] CPU features: detected: Random Number Generator lb # [ 0.007559] CPU features: detected: Speculation barrier (SB) lb # [ 0.007562] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.007565] CPU features: detected: TLB range maintenance instructions lb # [ 0.007570] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.007615] alternatives: applying system-wide alternatives lb # [ 0.010674] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.010843] Memory: 1399720K/1572864K available (24640K kernel code, 10246K rwdata, 26664K rodata, 7808K init, 2086K bss, 130576K reserved, 32768K cma-reserved) lb # [ 0.011321] devtmpfs: initialized lb # [ 0.013561] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.013585] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.013768] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.013778] 0 pages in range for non-PLT usage lb # [ 0.013779] 506368 pages in range for PLT usage lb # [ 0.013880] pinctrl core: initialized pinctrl subsystem lb # [ 0.015918] DMI not present or invalid. lb # [ 0.019845] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.022229] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.022499] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.022723] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.022752] audit: initializing netlink subsys (disabled) lb # [ 0.022911] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.023416] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.023419] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.023422] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.023425] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.023428] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.023463] cpuidle: using governor ladder lb # [ 0.023472] cpuidle: using governor menu lb # [ 0.023673] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.023693] ASID allocator initialised with 65536 entries lb # [ 0.026267] Serial: AMBA PL011 UART driver lb # [ 0.032306] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.032419] printk: console [ttyAMA0] enabled lb # [ 0.160976] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.160985] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.160989] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.160992] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.160994] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.160997] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.161000] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.161002] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.162249] fbcon: Taking over console lb # [ 0.162258] ACPI: Interpreter disabled. lb # [ 0.171417] iommu: Default domain type: Translated lb # [ 0.171424] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.183104] SCSI subsystem initialized lb # [ 0.183346] usbcore: registered new interface driver usbfs lb # [ 0.183371] usbcore: registered new interface driver hub lb # [ 0.183401] usbcore: registered new device driver usb lb # [ 0.183706] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.183710] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.183719] PTP clock support registered lb # [ 0.183761] EDAC MC: Ver: 3.0.0 lb # [ 0.183957] scmi_core: SCMI protocol bus registered lb # [ 0.184340] FPGA manager framework lb # [ 0.184896] vgaarb: loaded lb # [ 0.193384] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.194026] VFS: Disk quotas dquot_6.6.0 lb # [ 0.194058] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.194420] netfs: FS-Cache loaded lb # [ 0.194538] pnp: PnP ACPI: disabled lb # [ 0.203537] NET: Registered PF_INET protocol family lb # [ 0.203872] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.240902] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.240950] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.240981] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.241071] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.241213] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.241306] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.241345] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.241381] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.242142] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.242178] NET: Registered PF_XDP protocol family lb # [ 0.242199] PCI: CLS 0 bytes, default 64 lb # [ 0.242565] Trying to unpack rootfs image as initramfs... lb # [ 0.260261] kvm [1]: HYP mode not available lb # [ 0.390187] Initialise system trusted keyrings lb # [ 0.390248] Key type blacklist registered lb # [ 0.390418] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.390788] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.395052] 9p: Installing v9fs 9p2000 file system support lb # [ 0.395673] integrity: Platform Keyring initialized lb # [ 0.395685] integrity: Machine keyring initialized lb # [ 0.417447] Key type asymmetric registered lb # [ 0.417463] Asymmetric key parser 'x509' registered lb # [ 0.418100] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.428447] io scheduler mq-deadline registered lb # [ 0.428461] io scheduler kyber registered lb # [ 0.440494] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.441201] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.441610] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.441628] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.441652] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.441658] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.441679] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.441703] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.441779] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.441787] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.441790] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] lb # [ 0.441794] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.441797] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.443120] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.443609] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.443812] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.443824] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.443853] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.443865] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.468624] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.468827] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.468840] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.468866] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.469730] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.469912] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.469923] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.469948] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.470505] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.470689] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.470700] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.470726] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.470737] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.471196] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.471392] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.471418] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.471877] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.472064] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.472089] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.487695] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.487877] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.490676] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.490863] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.490888] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.491353] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.491543] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.491568] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.492022] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.492208] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.498856] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.499783] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.500068] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.500079] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.500105] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.512918] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.513121] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.513134] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.513159] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.513629] pci 0000:00:0d.0: [1af4:1053] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.513815] pci 0000:00:0d.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.513839] pci 0000:00:0d.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.514472] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.514479] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.514483] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.514534] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned lb # [ 0.514577] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.514622] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.514666] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.514710] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.514754] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.514799] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.514842] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.514887] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.515008] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.515052] pci 0000:00:0d.0: BAR 4 [mem 0x800002c000-0x800002ffff 64bit pref]: assigned lb # [ 0.515094] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.515112] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.515128] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.515146] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.515163] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.515181] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.515199] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.515218] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.515236] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.515254] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned lb # [ 0.515272] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.515290] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.515308] pci 0000:00:0d.0: BAR 1 [mem 0x1008c000-0x1008cfff]: assigned lb # [ 0.515325] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.515342] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.515359] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned lb # [ 0.515376] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned lb # [ 0.515393] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.515410] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.515433] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.515438] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.515441] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.551946] pci 0000:00:07.0: enabling device (0000 -> 0002) lb # [ 0.586259] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # Disk image does not exist, creating the virtualisation disk image... client # Disk image does not exist, creating the virtualisation disk image... worker1 # Formatting '/build/vm-state-worker1/tmp.EIAKCfsSFo', fmt=raw size=1073741824 [46.43s] worker1: QEMU running (pid 56) [46.43s] client: QEMU running (pid 48) client # Formatting '/build/vm-state-client/tmp.1MI6tniwQK', fmt=raw size=1073741824 worker1 # mke2fs 1.47.4 (6-Mar-2025) client # mke2fs 1.47.4 (6-Mar-2025) worker1 # Discarding device blocks: 0/262144 done client # Discarding device blocks: 0/262144 done worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes client # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Filesystem UUID: 1134b3c9-0e9d-4fd8-a9a4-21a46f792f70 client # Filesystem UUID: 6ac5a89d-e5b4-4fde-a5ae-ec83ad6e0c8e worker1 # Superblock backups stored on blocks: client # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 client # 32768, 98304, 163840, 229376 worker1 # client # worker1 # Allocating group tables: 0/8 done client # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done client # Writing inode tables: 0/8 done worker1 # Creating journal (8192 blocks): done client # Creating journal (8192 blocks): done worker1 # Writing superblocks and filesystem accounting information: 0/8 done client # Writing superblocks and filesystem accounting information: 0/8 done worker1 # client # worker1 # Virtualisation disk image created. client # Virtualisation disk image created. worker1 # Starting virtiofs daemons... client # Starting virtiofs daemons... worker1 # [2026-11-12T09:17:44Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-11-12T09:17:46Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-11-12T09:17:44Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-11-12T09:17:46Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-11-12T09:17:44Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-11-12T09:17:46Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-11-12T09:17:44Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-11-12T09:17:46Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-11-12T09:17:44Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-11-12T09:17:46Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-11-12T09:17:44Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-11-12T09:17:46Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-11-12T09:17:44Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-11-12T09:17:46Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-11-12T09:17:44Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-11-12T09:17:46Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-11-12T09:17:44Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-11-12T09:17:46Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-11-12T09:17:48Z INFO virtiofsd] Client connected, servicing requests client # [2026-11-12T09:17:50Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-11-12T09:17:48Z INFO virtiofsd] Client connected, servicing requests client # [2026-11-12T09:17:50Z INFO virtiofsd] Client connected, servicing requests client # [2026-11-12T09:17:50Z INFO virtiofsd] Client connected, servicing requests client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] Linux version 6.18.60 (nixbld@localhost) (gcc (GCC) 16.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT @1793362001 worker1 # [2026-11-12T09:17:48Z INFO virtiofsd] Client connected, servicing requests client # [ 0.000000] KASLR enabled worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] random: crng init done worker1 # [ 0.000000] Linux version 6.18.60 (nixbld@localhost) (gcc (GCC) 16.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT @1793362001 client # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] KASLR enabled client # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] random: crng init done client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] Machine model: linux,dummy-virt client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] efi: UEFI not found. client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] Zone ranges: worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] DMA32 empty worker1 # [ 0.000000] Zone ranges: client # [ 0.000000] Normal empty client # [ 0.000000] Device empty client # [ 0.000000] Movable zone start for each node client # [ 0.000000] Early memory node ranges client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.000000] DMA32 empty client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] Normal empty client # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] Device empty client # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] Movable zone start for each node client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000000] Early memory node ranges client # [ 0.000000] percpu: Embedded 76 pages/cpu s187672 r8192 d115432 u311296 worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/65qxpij1lpr90li04q3cg5lk7x3rhgwh-nixos-system-client-test/init regInfo=/nix/.ro-store/s8fhq47wlmppj5ghn8xsfppl3vvblryq-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s187672 r8192 d115432 u311296 client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/.ro-store/s8fhq47wlmppj5ghn8xsfppl3vvblryq-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] printk: log buffer data + meta data: 1048576 + 3670016 = 4718592 bytes worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/azn573qs4x78nhd0q14gh5h6ykm8hpri-nixos-system-worker1-test/init regInfo=/nix/.ro-store/vrl93xld93vp5l4d27ff5lli42di845y-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/.ro-store/vrl93xld93vp5l4d27ff5lli42di845y-closure-info/registration", will be passed to user space. client # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] printk: log buffer data + meta data: 1048576 + 3670016 = 4718592 bytes client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] ftrace: allocating 75323 entries in 296 pages worker1 # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] ftrace: allocated 296 pages with 3 groups worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB client # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=1. worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 client # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] Policy zone: DMA client # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] ftrace: allocating 75323 entries in 296 pages client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] ftrace: allocated 296 pages with 3 groups client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=1. client # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @44df0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44e00000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.000000] GICv3: using LPI property table @0x0000000044e10000 worker1 # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044e20000 worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000033] arm-pv: using stolen time PV worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @44df0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000522] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44e00000 (flat, esz 8, psz 64K, shr 1) client # [ 0.001556] Console: colour dummy device 80x25 worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044e10000 client # [ 0.001564] printk: legacy console [tty0] enabled worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044e20000 client # [ 0.001771] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.001778] pid_max: default: 32768 minimum: 301 worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.001858] LSM: initializing lsm=lockdown,capability,landlock,yama,bpf,ima worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.001990] landlock: Up and running. worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.001994] Yama: becoming mindful. worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.002440] LSM support for eBPF active worker1 # [ 0.000034] arm-pv: using stolen time PV client # [ 0.002584] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.000400] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.002619] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.002086] Console: colour dummy device 80x25 client # [ 0.005477] rcu: Hierarchical SRCU implementation. worker1 # [ 0.002095] printk: legacy console [tty0] enabled client # [ 0.005484] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.002305] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.006791] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.002313] pid_max: default: 32768 minimum: 301 client # [ 0.006918] EFI services will not be available. worker1 # [ 0.002392] LSM: initializing lsm=lockdown,capability,landlock,yama,bpf,ima client # [ 0.007000] smp: Bringing up secondary CPUs ... worker1 # [ 0.002526] landlock: Up and running. client # [ 0.007010] smp: Brought up 1 node, 1 CPU worker1 # [ 0.002529] Yama: becoming mindful. client # [ 0.007014] SMP: Total of 1 processors activated. worker1 # [ 0.003096] LSM support for eBPF active client # [ 0.007016] CPU: All CPU(s) started at EL1 worker1 # [ 0.003252] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.007028] CPU features: detected: Branch Target Identification worker1 # [ 0.003285] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.007033] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.005474] rcu: Hierarchical SRCU implementation. client # [ 0.007036] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.005480] rcu: Max phase no-delay instances is 1000. client # [ 0.007044] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.006758] fsl-mc MSI: its@8080000 domain created client # [ 0.007048] CPU features: detected: Common not Private translations worker1 # [ 0.006884] EFI services will not be available. client # [ 0.007051] CPU features: detected: CRC32 instructions worker1 # [ 0.006992] smp: Bringing up secondary CPUs ... client # [ 0.007054] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.007002] smp: Brought up 1 node, 1 CPU client # [ 0.007057] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.007005] SMP: Total of 1 processors activated. client # [ 0.007061] CPU features: detected: Data independent timing control (DIT) worker1 # [ 0.007008] CPU: All CPU(s) started at EL1 client # [ 0.007064] CPU features: detected: E0PD worker1 # [ 0.007019] CPU features: detected: Branch Target Identification client # [ 0.007066] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.007023] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.007070] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.007027] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.007073] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.007035] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.007076] CPU features: detected: Fine Grained Traps worker1 # [ 0.007039] CPU features: detected: Common not Private translations client # [ 0.007080] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.007042] CPU features: detected: CRC32 instructions client # [ 0.007085] CPU features: detected: RCpc load-acquire (LDAPR) worker1 # [ 0.007045] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.007088] CPU features: detected: LSE atomic instructions worker1 # [ 0.007048] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.007091] CPU features: detected: Privileged Access Never worker1 # [ 0.007051] CPU features: detected: Data independent timing control (DIT) client # [ 0.007093] CPU features: detected: PMUv3 worker1 # [ 0.007054] CPU features: detected: E0PD client # [ 0.007096] CPU features: detected: RAS Extension Support worker1 # [ 0.007057] CPU features: detected: Enhanced Counter Virtualization client # [ 0.007099] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.007060] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.007105] CPU features: detected: Random Number Generator worker1 # [ 0.007063] CPU features: detected: Enhanced Virtualization Traps client # [ 0.007108] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.007066] CPU features: detected: Fine Grained Traps client # [ 0.007110] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.007069] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.007113] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.007074] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.007118] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.007077] CPU features: detected: LSE atomic instructions client # [ 0.007156] alternatives: applying system-wide alternatives worker1 # [ 0.007080] CPU features: detected: Privileged Access Never client # [ 0.010360] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.007083] CPU features: detected: PMUv3 client # [ 0.011110] Memory: 1399740K/1572864K available (24640K kernel code, 10246K rwdata, 26664K rodata, 7808K init, 2086K bss, 130572K reserved, 32768K cma-reserved) worker1 # [ 0.007086] CPU features: detected: RAS Extension Support client # [ 0.011546] devtmpfs: initialized worker1 # [ 0.007089] CPU features: detected: RASv1p1 Extension Support client # [ 0.013477] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.007094] CPU features: detected: Random Number Generator client # [ 0.013501] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.007097] CPU features: detected: Speculation barrier (SB) client # [ 0.013700] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.007099] CPU features: detected: Stage-2 Force Write-Back client # [ 0.013710] 0 pages in range for non-PLT usage worker1 # [ 0.007102] CPU features: detected: TLB range maintenance instructions client # [ 0.013712] 506368 pages in range for PLT usage worker1 # [ 0.007108] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.013811] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.007147] alternatives: applying system-wide alternatives client # [ 0.014662] DMI not present or invalid. worker1 # [ 0.010229] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.020113] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.010905] Memory: 1399948K/1572864K available (24640K kernel code, 10246K rwdata, 26664K rodata, 7808K init, 2086K bss, 130568K reserved, 32768K cma-reserved) client # [ 0.022451] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.011978] devtmpfs: initialized client # [ 0.022628] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.013880] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.022831] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.013904] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.022875] audit: initializing netlink subsys (disabled) worker1 # [ 0.014124] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.023569] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.014134] 0 pages in range for non-PLT usage client # [ 0.023571] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.014135] 506368 pages in range for PLT usage client # [ 0.023575] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.014309] pinctrl core: initialized pinctrl subsystem client # [ 0.023578] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.015204] DMI not present or invalid. client # [ 0.023581] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.020714] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.023608] audit: type=2000 audit(0.020:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.023060] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.023619] cpuidle: using governor ladder worker1 # [ 0.023238] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.023625] cpuidle: using governor menu worker1 # [ 0.023439] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.023816] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.023471] audit: initializing netlink subsys (disabled) client # [ 0.023835] ASID allocator initialised with 65536 entries worker1 # [ 0.024123] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.025226] Serial: AMBA PL011 UART driver worker1 # [ 0.024126] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.031665] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.024130] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.031760] printk: console [ttyAMA0] enabled worker1 # [ 0.024133] thermal_sys: Registered thermal governor 'user_space' client # [ 0.162930] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.024136] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.162947] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.024171] audit: type=2000 audit(0.020:1): state=initialized audit_enabled=0 res=1 client # [ 0.162951] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.024181] cpuidle: using governor ladder client # [ 0.162954] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.024188] cpuidle: using governor menu worker1 # [ 0.024370] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.162957] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.162960] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.162962] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.024388] ASID allocator initialised with 65536 entries client # [ 0.162965] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.025653] Serial: AMBA PL011 UART driver client # [ 0.165102] fbcon: Taking over console worker1 # [ 0.032215] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.165114] ACPI: Interpreter disabled. worker1 # [ 0.032304] printk: console [ttyAMA0] enabled client # [ 0.178962] iommu: Default domain type: Translated worker1 # [ 0.164555] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.178970] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.164565] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.179596] SCSI subsystem initialized worker1 # [ 0.164569] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.179808] usbcore: registered new interface driver usbfs worker1 # [ 0.164571] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.179832] usbcore: registered new interface driver hub worker1 # [ 0.164574] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.179856] usbcore: registered new device driver usb worker1 # [ 0.164577] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.180322] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.164580] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.180326] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.164583] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.180347] PTP clock support registered worker1 # [ 0.166402] fbcon: Taking over console client # [ 0.180389] EDAC MC: Ver: 3.0.0 worker1 # [ 0.166412] ACPI: Interpreter disabled. client # [ 0.180573] scmi_core: SCMI protocol bus registered worker1 # [ 0.181383] iommu: Default domain type: Translated client # [ 0.180959] FPGA manager framework worker1 # [ 0.181391] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.181521] vgaarb: loaded worker1 # [ 0.181769] SCSI subsystem initialized client # [ 0.181801] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.181989] usbcore: registered new interface driver usbfs client # [ 0.195348] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.182022] usbcore: registered new interface driver hub client # [ 0.195379] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.182036] usbcore: registered new device driver usb client # [ 0.197692] netfs: FS-Cache loaded worker1 # [ 0.182334] pps_core: LinuxPPS API ver. 1 registered client # [ 0.199603] pnp: PnP ACPI: disabled worker1 # [ 0.182338] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.204622] NET: Registered PF_INET protocol family worker1 # [ 0.182347] PTP clock support registered client # [ 0.204901] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.182398] EDAC MC: Ver: 3.0.0 client # [ 0.242512] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.182567] scmi_core: SCMI protocol bus registered client # [ 0.242562] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.183413] FPGA manager framework client # [ 0.242594] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.195934] vgaarb: loaded client # [ 0.242688] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.196923] clocksource: Switched to clocksource arch_sys_counter client # [ 0.242829] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.197584] VFS: Disk quotas dquot_6.6.0 client # [ 0.242923] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.197614] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.242963] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.197997] netfs: FS-Cache loaded client # [ 0.242999] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.198113] pnp: PnP ACPI: disabled client # [ 0.243090] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.207130] NET: Registered PF_INET protocol family client # [ 0.243118] NET: Registered PF_XDP protocol family worker1 # [ 0.209456] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.243134] PCI: CLS 0 bytes, default 64 worker1 # [ 0.245540] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.243366] Trying to unpack rootfs image as initramfs... worker1 # [ 0.245589] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.261840] kvm [1]: HYP mode not available worker1 # [ 0.245622] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.403151] Initialise system trusted keyrings worker1 # [ 0.245712] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.403205] Key type blacklist registered worker1 # [ 0.245854] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.403357] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.245947] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.403783] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.245986] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.403857] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.246023] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.403943] integrity: Platform Keyring initialized worker1 # [ 0.246112] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.403953] integrity: Machine keyring initialized worker1 # [ 0.246130] NET: Registered PF_XDP protocol family client # [ 0.444067] Key type asymmetric registered worker1 # [ 0.246149] PCI: CLS 0 bytes, default 64 client # [ 0.444086] Asymmetric key parser 'x509' registered worker1 # [ 0.246400] Trying to unpack rootfs image as initramfs... client # [ 0.444452] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.268642] kvm [1]: HYP mode not available client # [ 0.444638] io scheduler mq-deadline registered worker1 # [ 0.397243] Initialise system trusted keyrings client # [ 0.444643] io scheduler kyber registered worker1 # [ 0.397294] Key type blacklist registered client # [ 0.453779] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.397433] workingset: timestamp_bits=42 max_order=19 bucket_order=0 client # [ 0.455178] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.397824] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.455567] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.403160] 9p: Installing v9fs 9p2000 file system support client # [ 0.455585] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.403326] integrity: Platform Keyring initialized client # [ 0.455596] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.403337] integrity: Machine keyring initialized client # [ 0.455603] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.425251] Key type asymmetric registered client # [ 0.455933] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.425267] Asymmetric key parser 'x509' registered client # [ 0.455955] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker1 # [ 0.425932] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.456411] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.430641] io scheduler mq-deadline registered client # [ 0.456418] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.430651] io scheduler kyber registered client # [ 0.456423] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.444806] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.456426] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.449409] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.456429] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.449903] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.456881] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.449924] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.457340] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.449935] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.457528] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.449941] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.457540] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.449961] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.457566] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.449992] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.457578] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.450492] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 0.482229] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.450499] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.482438] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.450503] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.482450] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.450506] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.482476] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.482955] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 1.158902] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.483138] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] lb # [ 2.257780] Freeing initrd memory: 25272K client # [ 0.483150] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.450510] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.483176] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.451160] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.483643] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.451608] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.483829] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.451793] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] client # [ 0.483840] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.451804] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.483866] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.451829] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.483878] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.485164] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.451841] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.485353] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.452298] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.485379] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.486119] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.452480] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.486310] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.452492] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.486336] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.452517] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.486739] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.477128] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.486922] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] worker1 # [ 0.477330] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] client # [ 0.487205] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.477343] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.487393] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.477369] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.487419] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.477835] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.487887] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.478016] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.488075] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.478028] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.488101] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.478053] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.488681] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.478064] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.488869] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.479116] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.488895] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.479302] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.489367] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.479328] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.489687] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.479793] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.489702] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.479978] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.489728] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.480004] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.490344] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.480392] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.490531] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.480571] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.490543] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.494806] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.490570] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.495068] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.491260] pci 0000:00:0d.0: [1af4:1053] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.495094] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.491451] pci 0000:00:0d.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.495565] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.491477] pci 0000:00:0d.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.495755] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.492116] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.495780] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.492124] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.496243] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.492148] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.496432] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.492197] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.496458] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.492243] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.515266] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.492286] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.515574] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.492330] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.515588] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.492375] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.515617] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.492418] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.516093] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.492462] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.516275] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.492505] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker1 # [ 0.516287] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.492550] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.516312] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.492626] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.517216] pci 0000:00:0d.0: [1af4:1053] type 00 class 0x078000 conventional PCI endpoint client # [ 0.492672] pci 0000:00:0d.0: BAR 4 [mem 0x800002c000-0x800002ffff 64bit pref]: assigned worker1 # [ 0.517405] pci 0000:00:0d.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.492715] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.492732] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.492753] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.517431] pci 0000:00:0d.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.492770] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.518065] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.492788] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.518072] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.492807] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.518076] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.492825] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.518124] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.492843] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.518169] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.492861] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.518215] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.492881] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.518260] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.492900] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.518305] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.492918] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.518349] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.492936] pci 0000:00:0d.0: BAR 1 [mem 0x1008c000-0x1008cfff]: assigned worker1 # [ 0.518394] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.492954] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.518437] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.492971] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.518481] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.492989] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned worker1 # [ 0.518552] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.493006] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned worker1 # [ 0.518596] pci 0000:00:0d.0: BAR 4 [mem 0x800002c000-0x800002ffff 64bit pref]: assigned client # [ 0.493023] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.518637] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.493041] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.518655] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.493065] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.518672] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.493070] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.518690] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned client # [ 0.493073] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.518707] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned client # [ 0.566071] pci 0000:00:07.0: enabling device (0000 -> 0002) worker1 # [ 0.518725] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.593170] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.518742] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.518762] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.518780] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.518801] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.518819] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.518837] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.518855] pci 0000:00:0d.0: BAR 1 [mem 0x1008c000-0x1008cfff]: assigned worker1 # [ 0.518873] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.518890] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.518907] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned worker1 # [ 0.518924] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned worker1 # [ 0.518942] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.518971] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.518996] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.519001] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.519004] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.519856] pci 0000:00:07.0: enabling device (0000 -> 0002) worker1 # [ 0.594964] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) client # [ 1.071508] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 1.058297] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # Disk image does not exist, creating the virtualisation disk image... [46.83s] worker2: QEMU running (pid 57) worker2 # Formatting '/build/vm-state-worker2/tmp.V9LaHrIyRH', fmt=raw size=1073741824 worker2 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Discarding device blocks: 0/262144 done worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Filesystem UUID: 56ac7a23-24f9-4799-8723-cdc3c37178b3 worker2 # Superblock backups stored on blocks: worker2 # 32768, 98304, 163840, 229376 [46.84s] (finished: start all VMs, in 44.12 seconds) worker2 # [46.84s] client: waiting for unit network-addresses-eth1.service worker2 # Allocating group tables: 0/8 done [46.84s] client: waiting for the VM to finish booting worker2 # Writing inode tables: 0/8 done worker2 # Creating journal (8192 blocks): done worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # worker2 # Virtualisation disk image created. worker2 # Starting virtiofs daemons... worker2 # [2026-11-12T09:17:44Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-11-12T09:17:44Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-11-12T09:17:44Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-11-12T09:17:44Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-11-12T09:17:44Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-11-12T09:17:44Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-11-12T09:17:44Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-11-12T09:17:44Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-11-12T09:17:44Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-11-12T09:17:48Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-11-12T09:17:48Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-11-12T09:17:48Z INFO virtiofsd] Client connected, servicing requests worker1 # [ 1.278161] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] Linux version 6.18.60 (nixbld@localhost) (gcc (GCC) 16.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT @1793362001 worker2 # [ 0.000000] KASLR enabled worker2 # [ 0.000000] random: crng init done worker2 # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] Zone ranges: worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] DMA32 empty worker2 # [ 0.000000] Normal empty worker2 # [ 0.000000] Device empty worker2 # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s187672 r8192 d115432 u311296 worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2zx252myayv5qmkzz9lyhs30cskhf704-nixos-system-worker2-test/init regInfo=/nix/.ro-store/c1gc0dlgvi0qm0li5qcf6wfs0sl86qcl-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/.ro-store/c1gc0dlgvi0qm0li5qcf6wfs0sl86qcl-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] printk: log buffer data + meta data: 1048576 + 3670016 = 4718592 bytes worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker2 # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] Policy zone: DMA worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] ftrace: allocating 75323 entries in 296 pages worker2 # [ 0.000000] ftrace: allocated 296 pages with 3 groups worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=1. worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @44de0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44df0000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044e10000 worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044e20000 worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker2 # [ 0.000034] arm-pv: using stolen time PV worker2 # [ 0.000434] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000636] Console: colour dummy device 80x25 worker2 # [ 0.000645] printk: legacy console [tty0] enabled worker2 # [ 0.000851] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.000858] pid_max: default: 32768 minimum: 301 worker2 # [ 0.000938] LSM: initializing lsm=lockdown,capability,landlock,yama,bpf,ima worker2 # [ 0.001079] landlock: Up and running. worker2 # [ 0.001082] Yama: becoming mindful. worker2 # [ 0.001645] LSM support for eBPF active worker2 # [ 0.001799] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.001833] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.003858] rcu: Hierarchical SRCU implementation. worker2 # [ 0.003865] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.005220] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.005346] EFI services will not be available. worker2 # [ 0.005443] smp: Bringing up secondary CPUs ... worker2 # [ 0.005453] smp: Brought up 1 node, 1 CPU worker2 # [ 0.005456] SMP: Total of 1 processors activated. worker2 # [ 0.005459] CPU: All CPU(s) started at EL1 worker2 # [ 0.005470] CPU features: detected: Branch Target Identification worker2 # [ 0.005474] CPU features: detected: ARMv8.4 Translation Table Level worker2 # [ 0.005477] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.005486] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker2 # [ 0.005490] CPU features: detected: Common not Private translations worker2 # [ 0.005493] CPU features: detected: CRC32 instructions worker2 # [ 0.005496] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.005500] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.005503] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.005506] CPU features: detected: E0PD worker2 # [ 0.005508] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.005511] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.005515] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.005518] CPU features: detected: Fine Grained Traps worker2 # [ 0.005521] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.005525] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.005529] CPU features: detected: LSE atomic instructions worker2 # [ 0.005531] CPU features: detected: Privileged Access Never worker2 # [ 0.005534] CPU features: detected: PMUv3 worker2 # [ 0.005537] CPU features: detected: RAS Extension Support worker2 # [ 0.005539] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.005545] CPU features: detected: Random Number Generator worker2 # [ 0.005548] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.005550] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.005553] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.005558] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.005597] alternatives: applying system-wide alternatives worker2 # [ 0.008688] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.008953] Memory: 1399748K/1572864K available (24640K kernel code, 10246K rwdata, 26664K rodata, 7808K init, 2086K bss, 130568K reserved, 32768K cma-reserved) worker2 # [ 0.009367] devtmpfs: initialized worker2 # [ 0.011459] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.011484] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.011677] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.011687] 0 pages in range for non-PLT usage worker2 # [ 0.011688] 506368 pages in range for PLT usage worker2 # [ 0.011815] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.012606] DMI not present or invalid. worker2 # [ 0.016061] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.019427] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.019656] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.019872] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.019899] audit: initializing netlink subsys (disabled) worker2 # [ 0.020579] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.020582] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.020585] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.020588] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.020591] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.020619] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.020629] cpuidle: using governor ladder worker2 # [ 0.020635] cpuidle: using governor menu worker2 # [ 0.020840] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.020860] ASID allocator initialised with 65536 entries worker2 # [ 0.022141] Serial: AMBA PL011 UART driver worker2 # [ 0.030019] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.030087] printk: console [ttyAMA0] enabled worker2 # [ 0.166858] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.166870] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.166873] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker2 # [ 0.166876] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.166879] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.166882] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.166884] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.166887] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.168165] fbcon: Taking over console worker2 # [ 0.168176] ACPI: Interpreter disabled. worker2 # [ 0.178158] iommu: Default domain type: Translated worker2 # [ 0.178165] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.178594] SCSI subsystem initialized worker2 # [ 0.180723] usbcore: registered new interface driver usbfs worker2 # [ 0.180748] usbcore: registered new interface driver hub worker2 # [ 0.180777] usbcore: registered new device driver usb worker2 # [ 0.181089] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.181093] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.181101] PTP clock support registered worker2 # [ 0.181156] EDAC MC: Ver: 3.0.0 worker2 # [ 0.188023] scmi_core: SCMI protocol bus registered worker2 # [ 0.188503] FPGA manager framework worker2 # [ 0.189080] vgaarb: loaded worker2 # [ 0.192843] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.199676] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.199710] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.200132] netfs: FS-Cache loaded worker2 # [ 0.200257] pnp: PnP ACPI: disabled worker2 # [ 0.207845] NET: Registered PF_INET protocol family worker2 # [ 0.208130] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.242107] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.242159] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.242188] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.242274] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.242415] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.242513] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.242554] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.242590] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.242694] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.242713] NET: Registered PF_XDP protocol family worker2 # [ 0.242730] PCI: CLS 0 bytes, default 64 worker2 # [ 0.242963] Trying to unpack rootfs image as initramfs... worker2 # [ 0.260887] kvm [1]: HYP mode not available lb # [ 2.261033] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 2.263800] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 3.119480] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) worker2 # [ 0.397527] Initialise system trusted keyrings worker2 # [ 0.397588] Key type blacklist registered worker2 # [ 0.397733] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.398140] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.398196] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.398286] integrity: Platform Keyring initialized worker2 # [ 0.398294] integrity: Machine keyring initialized worker2 # [ 0.422952] Key type asymmetric registered worker2 # [ 0.422970] Asymmetric key parser 'x509' registered worker2 # [ 0.423057] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker2 # [ 0.432916] io scheduler mq-deadline registered worker2 # [ 0.432931] io scheduler kyber registered worker2 # [ 0.438968] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.440878] ledtrig-cpu: registered to indicate activity on CPUs worker2 # [ 0.441305] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.441324] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.441334] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.441340] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.441372] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.441419] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.441502] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.441509] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.441513] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.441516] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.441519] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.441607] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.442080] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.442276] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.442288] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.442315] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.442328] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.442808] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.442999] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.443011] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.443037] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.443505] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.443693] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.443705] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.443730] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.444205] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.444395] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.444407] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.444433] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.444445] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.444947] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.445139] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.445164] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.445646] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.445837] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.445863] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.446276] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.446467] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.493018] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.493230] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.493257] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.493833] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.494025] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.494053] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.494525] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.494714] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.494740] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.495230] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.495550] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.495562] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.495588] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.496073] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.496260] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.496271] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.496296] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.496762] pci 0000:00:0d.0: [1af4:1053] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.521068] pci 0000:00:0d.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.521106] pci 0000:00:0d.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.521827] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.521835] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.521838] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.521892] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.521939] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.521985] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker2 # [ 0.522031] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.522076] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker2 # [ 0.522121] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker2 # [ 0.522167] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.522212] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.522257] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.522381] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.522427] pci 0000:00:0d.0: BAR 4 [mem 0x800002c000-0x800002ffff 64bit pref]: assigned worker2 # [ 0.522469] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.522487] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.522504] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.522522] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.522539] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.522556] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.522574] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.522594] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.522612] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.522631] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.522649] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.522667] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.522686] pci 0000:00:0d.0: BAR 1 [mem 0x1008c000-0x1008cfff]: assigned worker2 # [ 0.522704] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.522721] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.522738] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned worker2 # [ 0.522755] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned worker2 # [ 0.522772] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.522789] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.522813] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.522818] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.522821] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.523694] pci 0000:00:07.0: enabling device (0000 -> 0002) lb # [ 3.124864] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) lb # [ 3.126735] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) lb # [ 4.245128] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 4.249598] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 4.252179] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 1.288889] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 2.986333] Freeing initrd memory: 25264K worker1 # [ 2.990016] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) worker1 # [ 2.993546] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) worker1 # [ 2.996206] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 1.259489] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 1.261785] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 2.998813] Freeing initrd memory: 25268K client # [ 3.002993] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) client # [ 3.006927] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) client # [ 3.008904] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 3.224844] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 3.227185] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 4.527637] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 3.235367] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 4.538375] virtio-pci 0000:00:0d.0: enabling device (0000 -> 0002) lb # [ 4.544784] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 4.546632] msm_serial: driver initialized lb # [ 4.546771] SuperH (H)SCI(F) driver initialized lb # [ 4.546829] STM32 USART driver initialized lb # [ 4.567724] loop: module loaded lb # [ 4.567912] virtio_blk virtio2: 1/0/0 default/read/poll queues lb # [ 4.570209] virtio_blk virtio2: [vda] 4194304 512-byte logical blocks (2.15 GB/2.00 GiB) lb # [ 4.574096] megasas: 07.734.00.00-rc1 lb # [ 4.575612] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 4.582807] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 4.582828] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.588135] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 1.827457] Freeing initrd memory: 25264K worker2 # [ 1.830096] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 3.232485] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 4.588380] Using buffer write method lb # [ 4.588429] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 4.590068] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 4.590086] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 1.984696] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker1 # [ 3.532826] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 3.531068] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 4.836652] Using buffer write method lb # [ 4.836713] Concatenating MTD devices: lb # [ 4.836716] (0): "0.flash" lb # [ 4.836719] (1): "0.flash" lb # [ 4.836721] into device "0.flash" lb # [ 4.846014] tun: Universal TUN/TAP device driver, 1.6 lb # [ 4.850669] thunder_xcv, ver 1.0 lb # [ 4.850698] thunder_bgx, ver 1.0 lb # [ 4.850718] nicpf, ver 1.0 lb # [ 4.851316] e1000: Intel(R) PRO/1000 Network Driver lb # [ 4.851323] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 4.851352] e1000e: Intel(R) PRO/1000 Network Driver lb # [ 4.851358] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 4.851385] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 4.851388] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 4.851444] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 4.851451] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 4.851596] sky2: driver version 1.30 lb # [ 4.861241] usbcore: registered new interface driver usb-storage lb # [ 4.861334] usbcore: registered new interface driver usbserial_generic lb # [ 4.861346] usbserial: USB Serial support registered for generic lb # [ 4.861968] hv_vmbus: registering driver hyperv_keyboard lb # [ 4.863385] ehci-pci 0000:00:07.0: EHCI Host Controller lb # [ 4.863413] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 lb # [ 4.863581] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 lb # [ 4.864126] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 4.864149] rtc-pl031 9010000.pl031: setting system clock to 2026-11-12T09:18:26 UTC (1794475106) lb # [ 4.871970] i2c_dev: i2c /dev entries driver lb # [ 4.872274] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 lb # [ 4.873468] hub 1-0:1.0: USB hub found lb # [ 4.873487] hub 1-0:1.0: 6 ports detected lb # [ 4.879328] sdhci: Secure Digital Host Controller Interface driver lb # [ 4.879334] sdhci: Copyright(c) Pierre Ossman lb # [ 4.879624] Synopsys Designware Multimedia Card Interface Driver lb # [ 4.880015] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 4.889696] hid: raw HID events driver (C) Jiri Kosina lb # [ 4.889987] usbcore: registered new interface driver usbhid lb # [ 4.889991] usbhid: USB HID core driver lb # [ 4.891289] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 4.895846] drop_monitor: Initializing network drop monitor service lb # [ 4.896068] NET: Registered PF_INET6 protocol family lb # [ 4.898406] Segment Routing with IPv6 lb # [ 4.898421] In-situ OAM (IOAM) with IPv6 lb # [ 4.898446] NET: Registered PF_PACKET protocol family lb # [ 4.898503] 9pnet: Installing 9P2000 support lb # [ 4.898550] Key type dns_resolver registered lb # [ 4.907431] registered taskstats version 1 lb # [ 4.907602] Loading compiled-in X.509 certificates lb # [ 4.916959] Demotion targets for Node 0: null lb # [ 4.917079] Key type .fscrypt registered lb # [ 4.917083] Key type fscrypt-provisioning registered lb # [ 4.917195] ima: No TPM chip found, activating TPM-bypass! lb # [ 4.917217] ima: Allocated hash algorithm: sha1 lb # [ 4.917240] ima: No architecture policies found worker1 # [ 3.537472] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) lb # [ 4.917987] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 2.074286] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 3.627437] virtio-pci 0000:00:0d.0: enabling device (0000 -> 0002) worker2 # [ 2.078685] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) worker1 # [ 3.634241] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 3.636169] msm_serial: driver initialized worker1 # [ 3.636318] SuperH (H)SCI(F) driver initialized worker1 # [ 3.636378] STM32 USART driver initialized lb # [ 4.943186] clk: Disabling unused clocks lb # [ 4.943205] PM: genpd: Disabling unused power domains lb # [ 4.949480] Freeing unused kernel memory: 7808K lb # [ 4.949670] Run /init as init process worker1 # [ 3.656366] loop: module loaded worker1 # [ 3.656547] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 3.658939] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 3.662491] megasas: 07.734.00.00-rc1 worker1 # [ 3.663379] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 4.971064] systemd[1]: Successfully made /usr/ read-only. lb # [ 5.120283] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 5.270898] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 3.670469] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 3.535198] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 3.670493] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 2.428613] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) worker1 # [ 3.978200] Using buffer write method worker1 # [ 3.978285] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 3.977653] virtio-pci 0000:00:0d.0: enabling device (0000 -> 0002) worker1 # [ 3.980557] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 3.980579] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 2.432769] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 2.436073] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) client # [ 3.983810] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 3.985648] msm_serial: driver initialized client # [ 3.985791] SuperH (H)SCI(F) driver initialized client # [ 3.988894] STM32 USART driver initialized client # [ 4.006481] loop: module loaded client # [ 4.006657] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 4.007449] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 5.305192] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 5.305218] systemd[1]: Detected virtualization qemu. lb # [ 5.305272] systemd[1]: Detected architecture arm64. lb # [ 5.305281] systemd[1]: Running in initrd. lb # [ 5.305863] systemd[1]: Initializing machine ID from random generator. lb # [ 5.306038] systemd[1]: Hostname set to . client # [ 4.015141] megasas: 07.734.00.00-rc1 client # [ 4.015895] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 5.364495] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 lb # [ 5.442409] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.484430] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 5.503876] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 5.514795] systemd[1]: Created slice Slice /system/modprobe. lb # [ 5.515003] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 5.515034] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 5.515059] systemd[1]: Reached target Path Units. lb # [ 5.515072] systemd[1]: Reached target Slice Units. lb # [ 5.515086] systemd[1]: Reached target Swaps. lb # [ 5.515100] systemd[1]: Reached target Timer Units. lb # [ 5.515248] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 5.515388] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 5.515499] systemd[1]: Listening on Journal Sockets. lb # [ 5.515568] systemd[1]: Listening on udev Kernel Socket. lb # [ 5.515749] systemd[1]: Listening on udev Varlink Socket. lb # [ 5.515764] systemd[1]: Reached target Socket Units. lb # [ 5.527510] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 5.527584] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 5.544390] systemd[1]: Mounting Kernel Configuration File System... lb # [ 5.559324] systemd[1]: Starting Journal Service... lb # [ 5.565637] systemd[1]: Starting Load Kernel Modules... lb # [ 5.565748] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.584546] systemd[1]: Starting Coldplug All udev Devices... lb # [ 5.592452] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 5.608608] systemd-journald[70]: Collecting audit messages is disabled. lb # [ 5.632418] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 5.639603] systemd[1]: Mounted Kernel Configuration File System. lb # [ 5.657523] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 5.657673] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 lb # [ 5.676506] dm_mod: module verification failed: signature and/or required key missing - tainting kernel lb # [ 5.678527] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 5.692780] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 5.693676] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 5.695270] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 5.717571] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 lb # [ 5.717813] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 5.717815] [drm] features: -context_init lb # [ 5.718594] [drm] number of scanouts: 1 lb # [ 5.718605] [drm] number of cap sets: 0 lb # [ 5.736677] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic lb # [ 5.736692] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 lb # [ 5.768495] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 5.768723] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 5.768747] systemd[1]: Reached target Local File Systems. lb # [ 5.771282] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 5.788613] Console: switching to colour frame buffer device 160x50 lb # [ 5.802475] systemd[1]: Started Journal Service. lb # [ 5.679949] systemd-modules-load[71]: Inserted module 'dm_mod' lb # [ 5.807843] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 5.689332] systemd-modules-load[71]: Module 'virtio_balloon' is built in lb # [ 5.702301] systemd-modules-load[71]: Module 'virtio_console' is built in lb # [ 5.712409] systemd-modules-load[71]: Inserted module 'virtio_gpu' lb # [ 5.837777] NET: Registered PF_VSOCK protocol family lb # [ 5.718331] systemd-modules-load[71]: Module 'virtio_rng' is built in lb # [ 5.721017] systemd[1]: Starting Create System Files and Directories... lb # [ 5.776683] systemd[1]: Finished Create System Files and Directories. lb # [ 5.785557] systemd-modules-load[71]: Inserted module 'vmw_vsock_virtio_transport' lb # [ 5.794450] systemd[1]: Finished Load Kernel Modules. lb # [ 5.797192] systemd-udevd[77]: Using default interface naming scheme 'v261'. lb # [ 5.811050] systemd[1]: Starting Apply Kernel Variables... lb # [ 5.851093] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 5.860998] systemd[1]: Finished Apply Kernel Variables. lb # [ 5.956180] systemd[1]: Starting Virtual Console Setup... lb # [ 6.041791] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 6.052160] systemd[1]: Finished Virtual Console Setup. lb # [ 6.731005] systemd[1]: Finished Coldplug All udev Devices. lb # [ 6.732072] systemd[1]: Reached target System Initialization. lb # [ 6.732938] systemd[1]: Reached target Basic System. lb # [ 6.923724] (udev-worker)[91]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 4.021086] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 4.021107] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 4.239471] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 5.789224] Using buffer write method client # [ 5.787752] Using buffer write method worker1 # [ 5.789290] Concatenating MTD devices: worker1 # [ 5.789293] (0): "0.flash" client # [ 5.787853] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 5.789296] (1): "0.flash" worker1 # [ 5.789298] into device "0.flash" client # [ 5.792125] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 6.973233] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 4.245042] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 4.248024] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 5.792147] Intel/Sharp Extended Query Table at 0x0031 client # [ 5.797662] Using buffer write method client # [ 5.797686] Concatenating MTD devices: client # [ 5.797689] (0): "0.flash" client # [ 5.797692] (1): "0.flash" client # [ 5.797694] into device "0.flash" worker1 # [ 5.799244] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 4.255975] virtio-pci 0000:00:0d.0: enabling device (0000 -> 0002) worker1 # [ 5.808943] thunder_xcv, ver 1.0 worker1 # [ 5.808976] thunder_bgx, ver 1.0 worker1 # [ 5.808997] nicpf, ver 1.0 worker2 # [ 4.262559] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 5.809588] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 4.264322] msm_serial: driver initialized client # [ 5.806212] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 5.809593] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 4.264666] SuperH (H)SCI(F) driver initialized worker1 # [ 5.809616] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 4.264727] STM32 USART driver initialized worker1 # [ 5.809629] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 5.809659] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 5.809663] igb: Copyright (c) 2007-2014 Intel Corporation. worker1 # [ 5.809685] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 5.809692] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 5.816359] thunder_xcv, ver 1.0 worker1 # [ 5.809832] sky2: driver version 1.30 client # [ 5.816398] thunder_bgx, ver 1.0 client # [ 5.816420] nicpf, ver 1.0 worker1 # [ 5.811696] usbcore: registered new interface driver usb-storage client # [ 5.817044] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 5.811789] usbcore: registered new interface driver usbserial_generic client # [ 5.817048] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 5.811801] usbserial: USB Serial support registered for generic client # [ 5.817077] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 5.812440] hv_vmbus: registering driver hyperv_keyboard client # [ 5.817084] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 5.813363] ehci-pci 0000:00:07.0: EHCI Host Controller client # [ 5.817115] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 5.813383] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 client # [ 5.817119] igb: Copyright (c) 2007-2014 Intel Corporation. worker1 # [ 5.813565] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 client # [ 5.817141] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 7.000850] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line. client # [ 5.817148] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 5.817290] sky2: driver version 1.30 worker1 # [ 5.826723] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 worker1 # [ 5.827547] hub 1-0:1.0: USB hub found worker1 # [ 5.827565] hub 1-0:1.0: 6 ports detected worker1 # [ 5.830621] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 5.826839] usbcore: registered new interface driver usb-storage client # [ 5.826965] usbcore: registered new interface driver usbserial_generic worker1 # [ 5.830648] rtc-pl031 9010000.pl031: setting system clock to 2026-11-12T09:18:29 UTC (1794475109) worker1 # [ 5.831017] i2c_dev: i2c /dev entries driver client # [ 5.826978] usbserial: USB Serial support registered for generic client # [ 5.827620] hv_vmbus: registering driver hyperv_keyboard client # [ 5.829369] ehci-pci 0000:00:07.0: EHCI Host Controller client # [ 5.829408] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 client # [ 5.829630] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 worker2 # [ 4.286606] loop: module loaded worker2 # [ 4.286794] virtio_blk virtio2: 1/0/0 default/read/poll queues worker2 # [ 4.287676] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 5.836963] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 5.836969] sdhci: Copyright(c) Pierre Ossman worker1 # [ 5.837257] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 5.837648] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 5.839286] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 5.839548] usbcore: registered new interface driver usbhid worker1 # [ 5.839552] usbhid: USB HID core driver client # [ 5.835985] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 5.836014] rtc-pl031 9010000.pl031: setting system clock to 2026-11-12T09:18:29 UTC (1794475109) client # [ 5.836503] i2c_dev: i2c /dev entries driver worker2 # [ 4.292995] megasas: 07.734.00.00-rc1 client # [ 5.839881] sdhci: Secure Digital Host Controller Interface driver client # [ 5.839887] sdhci: Copyright(c) Pierre Ossman worker2 # [ 4.293748] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 5.845486] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 5.840241] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 5.847252] drop_monitor: Initializing network drop monitor service worker1 # [ 5.847934] NET: Registered PF_INET6 protocol family client # [ 5.840639] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 5.848499] Segment Routing with IPv6 client # [ 5.841879] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 worker1 # [ 5.848511] In-situ OAM (IOAM) with IPv6 client # [ 5.842340] hub 1-0:1.0: USB hub found worker1 # [ 5.848540] NET: Registered PF_PACKET protocol family client # [ 5.842405] hub 1-0:1.0: 6 ports detected worker2 # [ 4.302157] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 4.302178] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 5.853039] 9pnet: Installing 9P2000 support client # [ 5.851060] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 4.304320] Using buffer write method worker1 # [ 5.853087] Key type dns_resolver registered client # [ 5.851361] usbcore: registered new interface driver usbhid worker2 # [ 4.304364] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 5.851365] usbhid: USB HID core driver client # [ 5.852944] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 4.311033] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 4.311064] Intel/Sharp Extended Query Table at 0x0031 client # [ 5.857974] drop_monitor: Initializing network drop monitor service worker2 # [ 4.312755] Using buffer write method client # [ 5.858178] NET: Registered PF_INET6 protocol family worker2 # [ 4.312774] Concatenating MTD devices: client # [ 5.858835] Segment Routing with IPv6 worker2 # [ 4.312776] (0): "0.flash" client # [ 5.858854] In-situ OAM (IOAM) with IPv6 worker2 # [ 4.312779] (1): "0.flash" client # [ 5.858886] NET: Registered PF_PACKET protocol family worker2 # [ 4.312781] into device "0.flash" worker1 # [ 5.861453] registered taskstats version 1 worker1 # [ 5.861597] Loading compiled-in X.509 certificates client # [ 5.858948] 9pnet: Installing 9P2000 support client # [ 5.858995] Key type dns_resolver registered worker1 # [ 5.872235] Demotion targets for Node 0: null worker1 # [ 5.872371] Key type .fscrypt registered worker1 # [ 5.872375] Key type fscrypt-provisioning registered worker1 # [ 5.872476] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 4.324512] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 5.872497] ima: Allocated hash algorithm: sha1 worker1 # [ 5.872519] ima: No architecture policies found client # [ 5.870555] registered taskstats version 1 client # [ 5.870718] Loading compiled-in X.509 certificates worker1 # [ 5.878155] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 5.879875] Demotion targets for Node 0: null client # [ 5.880030] Key type .fscrypt registered client # [ 5.880035] Key type fscrypt-provisioning registered worker2 # [ 4.335006] thunder_xcv, ver 1.0 client # [ 5.880248] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 4.335037] thunder_bgx, ver 1.0 worker2 # [ 4.335058] nicpf, ver 1.0 client # [ 5.880273] ima: Allocated hash algorithm: sha1 worker2 # [ 4.335650] e1000: Intel(R) PRO/1000 Network Driver client # [ 5.880301] ima: No architecture policies found worker2 # [ 4.335654] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 5.881176] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 4.335682] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 4.335688] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 4.335716] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 4.335720] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 4.335742] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 4.335750] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 4.335892] sky2: driver version 1.30 worker2 # [ 4.345564] usbcore: registered new interface driver usb-storage worker2 # [ 4.345733] usbcore: registered new interface driver usbserial_generic worker1 # [ 5.899000] clk: Disabling unused clocks worker1 # [ 5.899019] PM: genpd: Disabling unused power domains worker2 # [ 4.345746] usbserial: USB Serial support registered for generic worker2 # [ 4.346399] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 4.349604] ehci-pci 0000:00:07.0: EHCI Host Controller worker2 # [ 4.349629] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 worker2 # [ 4.349845] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 worker2 # [ 4.355753] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 4.355783] rtc-pl031 9010000.pl031: setting system clock to 2026-11-12T09:18:29 UTC (1794475109) worker2 # [ 4.356227] i2c_dev: i2c /dev entries driver worker1 # [ 5.905493] Freeing unused kernel memory: 7808K worker1 # [ 5.905689] Run /init as init process client # [ 5.906419] clk: Disabling unused clocks client # [ 5.906441] PM: genpd: Disabling unused power domains worker2 # [ 4.362530] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 4.362537] sdhci: Copyright(c) Pierre Ossman lb # [ 7.091039] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 4.362824] Synopsys Designware Multimedia Card Interface Driver lb # [ 7.093235] systemd[1]: Reached target Initrd Root Device. worker2 # [ 4.363248] sdhci-pltfm: SDHCI platform and OF driver helper client # [ 5.913040] Freeing unused kernel memory: 7808K worker2 # [ 4.367710] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 client # [ 5.913247] Run /init as init process worker2 # [ 4.368067] hub 1-0:1.0: USB hub found worker2 # [ 4.368084] hub 1-0:1.0: 6 ports detected worker2 # [ 4.368509] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 4.368792] usbcore: registered new interface driver usbhid worker2 # [ 4.368796] usbhid: USB HID core driver worker1 # [ 5.923393] systemd[1]: Successfully made /usr/ read-only. lb # [ 7.099704] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 4.373751] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 4.375376] drop_monitor: Initializing network drop monitor service worker2 # [ 4.375536] NET: Registered PF_INET6 protocol family worker2 # [ 4.376140] Segment Routing with IPv6 worker2 # [ 4.376158] In-situ OAM (IOAM) with IPv6 worker2 # [ 4.376200] NET: Registered PF_PACKET protocol family worker2 # [ 4.376266] 9pnet: Installing 9P2000 support worker2 # [ 4.376326] Key type dns_resolver registered client # [ 5.932659] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 4.388358] registered taskstats version 1 worker2 # [ 4.388513] Loading compiled-in X.509 certificates worker2 # [ 4.397998] Demotion targets for Node 0: null worker2 # [ 4.398135] Key type .fscrypt registered worker2 # [ 4.398139] Key type fscrypt-provisioning registered worker2 # [ 4.398259] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 4.398284] ima: Allocated hash algorithm: sha1 worker2 # [ 4.398305] ima: No architecture policies found worker2 # [ 4.399120] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 4.424694] clk: Disabling unused clocks worker2 # [ 4.424715] PM: genpd: Disabling unused power domains lb # [ 7.155020] systemd-fsck[110]: nixos: clean, 12/131072 files, 26284/524288 blocks worker2 # [ 4.431288] Freeing unused kernel memory: 7808K worker2 # [ 4.431521] Run /init as init process lb # [ 7.163385] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 4.443476] systemd[1]: Successfully made /usr/ read-only. lb # [ 7.172303] systemd[1]: Mounting /sysroot... lb # [ 7.341493] EXT4-fs (vda): mounted filesystem a85cf1fb-224b-4095-82f3-8010ee0bd486 r/w with ordered data mode. Quota mode: none. lb # [ 7.227163] systemd[1]: Mounted /sysroot. lb # [ 7.229254] systemd[1]: Reached target Initrd Root File System. lb # [ 7.234885] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 6.072676] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 7.268382] systemd-sysroot-fstab-check[118]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 6.089871] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 7.276137] systemd[1]: Reload requested from client PID 118 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 7.279962] systemd[1]: Reloading... worker2 # [ 4.612913] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 6.225105] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 6.241704] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 6.257437] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.257466] systemd[1]: Detected virtualization qemu. worker1 # [ 6.257518] systemd[1]: Detected architecture arm64. worker1 # [ 6.257527] systemd[1]: Running in initrd. worker1 # [ 6.258119] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.258294] systemd[1]: Hostname set to . client # [ 6.266687] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 6.266715] systemd[1]: Detected virtualization qemu. client # [ 6.266766] systemd[1]: Detected architecture arm64. client # [ 6.266775] systemd[1]: Running in initrd. client # [ 6.267373] systemd[1]: Initializing machine ID from random generator. client # [ 6.267537] systemd[1]: Hostname set to . lb # [ 7.488115] systemd[1]: Reloading finished in 212 ms. worker2 # [ 4.764598] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 6.324840] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 worker2 # [ 4.777661] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 4.777685] systemd[1]: Detected virtualization qemu. worker2 # [ 4.777732] systemd[1]: Detected architecture arm64. worker2 # [ 4.777742] systemd[1]: Running in initrd. worker2 # [ 4.778456] systemd[1]: Initializing machine ID from random generator. worker2 # [ 4.778702] systemd[1]: Hostname set to . client # [ 6.334054] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 lb # [ 7.518699] systemd-sysroot-fstab-check[118]: Requesting initrd-fs.target/start/replace... lb # [ 7.528636] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 7.545680] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 7.559410] systemd[1]: Mounting /sysroot/run... worker1 # [ 6.395578] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 7.578070] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 6.404325] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 4.853091] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 worker1 # [ 6.444664] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 6.456182] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 6.453910] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 6.466777] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 6.467083] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 6.463137] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 4.919326] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 6.467114] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 6.467139] systemd[1]: Reached target Path Units. worker1 # [ 6.467152] systemd[1]: Reached target Slice Units. worker1 # [ 6.467166] systemd[1]: Reached target Swaps. client # [ 6.468988] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 6.467180] systemd[1]: Reached target Timer Units. client # [ 6.469174] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 6.467317] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 6.469202] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 6.467470] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 6.469223] systemd[1]: Reached target Path Units. worker1 # [ 6.467585] systemd[1]: Listening on Journal Sockets. client # [ 6.469237] systemd[1]: Reached target Slice Units. worker1 # [ 6.467658] systemd[1]: Listening on udev Kernel Socket. client # [ 6.469252] systemd[1]: Reached target Swaps. worker1 # [ 6.467856] systemd[1]: Listening on udev Varlink Socket. client # [ 6.469266] systemd[1]: Reached target Timer Units. worker1 # [ 6.467873] systemd[1]: Reached target Socket Units. client # [ 6.469395] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 6.469534] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 6.469666] systemd[1]: Listening on Journal Sockets. client # [ 6.469736] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 6.479229] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 6.479348] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 7.658643] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 6.478310] systemd[1]: Listening on udev Varlink Socket. client # [ 6.478347] systemd[1]: Reached target Socket Units. client # [ 6.479881] systemd[1]: Starting Create List of Static Device Nodes... client # [ 6.479941] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 6.488369] systemd[1]: Mounting Kernel Configuration File System... lb # [ 7.668142] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 6.490034] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.499430] systemd[1]: Starting Journal Service... worker1 # [ 6.504810] systemd[1]: Starting Journal Service... worker1 # [ 6.509734] systemd[1]: Starting Load Kernel Modules... lb # [ 7.687512] systemd-sysroot-fstab-check[118]: Requesting swap.target/start/replace... worker1 # [ 6.509849] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.818957] fuse: init (API version 7.45) client # [ 6.514245] systemd[1]: Starting Load Kernel Modules... client # [ 6.514356] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.823831] virtiofs virtio6: discovered new tag: nix-store worker2 # [ 4.972914] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 4.979001] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 4.984102] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 4.984321] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.984355] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 6.535366] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 4.984382] systemd[1]: Reached target Path Units. worker2 # [ 4.984398] systemd[1]: Reached target Slice Units. worker2 # [ 4.984414] systemd[1]: Reached target Swaps. worker2 # [ 4.984428] systemd[1]: Reached target Timer Units. worker2 # [ 4.984581] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 4.984725] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 7.715820] systemd[1]: Mounted /sysroot/run.[ 7.836987] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # worker2 # [ 4.991915] systemd[1]: Listening on Journal Sockets. worker2 # [ 4.992041] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 4.992231] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 4.992251] systemd[1]: Reached target Socket Units. worker2 # [ 4.996671] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 4.996746] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 6.545717] systemd[1]: Finished Create List of Static Device Nodes. client # [ 6.553044] systemd-journald[70]: Collecting audit messages is disabled. worker2 # [ 5.008353] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.554096] systemd[1]: Starting Coldplug All udev Devices... client # [ 6.557237] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 6.569368] systemd-journald[70]: Collecting audit messages is disabled. worker1 # [ 6.572834] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 6.573463] systemd[1]: Mounted Kernel Configuration File System. lb # [ 7.751608] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 7.754181] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 7.758887] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 5.033174] systemd[1]: Starting Journal Service... worker1 # [ 6.587275] dm_mod: module verification failed: signature and/or required key missing - tainting kernel client # [ 6.588663] dm_mod: module verification failed: signature and/or required key missing - tainting kernel lb # [ 7.766359] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.[ 7.889411] virtiofs virtio7: discovered new tag: shared lb # [ 7.890281] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker2 # [ 5.041070] systemd[1]: Starting Load Kernel Modules... worker2 # [ 5.041202] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.048463] systemd[1]: Starting Coldplug All udev Devices... lb # [ 7.898691] virtiofs virtio8: discovered new tag: xchg lb # [ 7.899516] virtiofs virtio8: virtio_fs_setup_dax: No cache capability lb # client # [ 6.598182] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.599534] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 6.613377] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 6.610651] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 6.618379] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 6.616363] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 6.619970] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker1 # [ 6.620160] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 client # [ 6.619778] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 5.069058] systemd[1]: Finished Create List of Static Device Nodes. client # [ 6.619989] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 worker2 # [ 5.070291] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 5.079353] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 7.807540] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 7.810465] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 6.635147] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 lb # [ 7.816275] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 6.635407] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 6.635413] [drm] features: -context_init client # [ 6.636279] [drm] number of scanouts: 1 client # [ 6.636293] [drm] number of cap sets: 0 worker1 # [ 6.639637] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 worker1 # [ 6.639887] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 6.639893] [drm] features: -context_init lb # [ 7.825125] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 7.828865] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 7.833714] systemd[1]: Mounting /sysroot/nix/store... client # [ 6.654633] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 6.657369] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 6.661791] [drm] number of scanouts: 1 worker1 # [ 6.661808] [drm] number of cap sets: 0 client # [ 6.659245] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 6.662596] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic worker1 # [ 6.662604] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 worker1 # [ 6.667650] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 6.663324] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic client # [ 6.663337] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 worker2 # [ 5.128520] dm_mod: module verification failed: signature and/or required key missing - tainting kernel worker2 # [ 5.139935] systemd-journald[70]: Collecting audit messages is disabled. worker2 # [ 5.145949] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 6.693352] Console: switching to colour frame buffer device 160x50 worker2 # [ 5.150642] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 5.152990] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 5.153167] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 client # [ 6.698353] Console: switching to colour frame buffer device 160x50 worker2 # [ 5.160274] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 7.897749] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 5.171934] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 6.721293] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 6.718529] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 7.900152] systemd[1]: Reached target Initrd File Systems. lb # [ 7.902441] systemd[1]: Starting Find NixOS closure... worker2 # [ 5.179838] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 worker2 # [ 5.180096] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 5.180098] [drm] features: -context_init lb # [ 7.919433] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 6.745566] NET: Registered PF_VSOCK protocol family client # [ 6.742555] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 6.742793] systemd[1]: Reached target Preparation for Local File Systems. client # [ 6.742823] systemd[1]: Reached target Local File Systems. client # [ 6.744718] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 6.750826] systemd[1]: Started Journal Service. worker1 # [ 6.632241] systemd-modules-load[71]: Inserted module 'dm_mod' worker1 # [ 6.633472] systemd-modules-load[71]: Module 'virtio_balloon' is built in worker2 # [ 5.205032] [drm] number of scanouts: 1 worker2 # [ 5.205052] [drm] number of cap sets: 0 worker1 # [ 6.634650] systemd-modules-load[71]: Module 'virtio_console' is built in worker2 # [ 5.206908] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic worker1 # [ 6.635800] systemd-modules-load[71]: Inserted module 'virtio_gpu' worker2 # [ 5.206917] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 client # [ 6.756860] systemd[1]: Started Journal Service. client # [ 6.758174] NET: Registered PF_VSOCK protocol family client # [ 6.648673] systemd-modules-load[72]: Inserted module 'dm_mod' client # [ 6.650106] systemd-modules-load[72]: Module 'virtio_balloon' is built in client # [ 6.651307] systemd-modules-load[72]: Module 'virtio_console' is built in worker1 # [ 6.656560] systemd-modules-load[71]: Module 'virtio_rng' is built in worker1 # [ 6.657647] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 7.957490] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 6.658759] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 6.659851] systemd[1]: Reached target Local File Systems. client # [ 6.656377] systemd-modules-load[72]: Inserted module 'virtio_gpu' client # [ 6.657441] systemd-modules-load[72]: Module 'virtio_rng' is built in worker2 # [ 5.233660] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 5.233898] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 5.233925] systemd[1]: Reached target Local File Systems. lb # [ 7.967913] systemd[1]: Finished Find NixOS closure. worker1 # [ 6.668396] systemd[1]: Starting Create System Files and Directories... worker1 # [ 6.669403] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 5.239599] Console: switching to colour frame buffer device 160x50 lb # [ 7.971170] systemd[1]: Reached target Initrd Default Target. client # [ 6.668169] systemd[1]: Starting Create System Files and Directories... worker2 # [ 5.247153] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 6.670807] systemd-modules-load[72]: Inserted module 'vmw_vsock_virtio_transport' worker1 # [ 6.676127] systemd-modules-load[71]: Inserted module 'vmw_vsock_virtio_transport' lb # [ 7.977599] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 6.680274] systemd[1]: Finished Load Kernel Modules. client # [ 6.678155] systemd[1]: Finished Load Kernel Modules. worker2 # [ 5.265540] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 6.704390] systemd[1]: Starting Apply Kernel Variables... client # [ 6.705054] systemd[1]: Starting Apply Kernel Variables... lb # [ 8.011760] systemd[1]: Stopped target Initrd Default Target. lb # [ 8.016429] systemd[1]: Stopped target Basic System. lb # [ 8.017560] systemd[1]: Stopped target Initrd Root Device. lb # [ 8.020180] systemd[1]: Stopped target Path Units. worker2 # [ 5.293053] NET: Registered PF_VSOCK protocol family lb # [ 8.021904] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 8.025660] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 6.729468] systemd[1]: Finished Create System Files and Directories. lb # [ 8.030185] systemd[1]: Stopped target Slice Units. lb # [ 8.036375] systemd[1]: Stopped target Socket Units. client # [ 6.732859] systemd[1]: Finished Create System Files and Directories. lb # [ 8.038499] systemd[1]: Stopped target System Initialization. lb # [ 8.039395] systemd[1]: Stopped target Swaps. lb # [ 8.040144] systemd[1]: Stopped target Timer Units. lb # [ 8.043167] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 8.045759] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 6.749509] systemd[1]: Finished Apply Kernel Variables. lb # [ 8.051102] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 8.053552] systemd[1]: Stopped Find NixOS closure. client # [ 6.752931] systemd[1]: Finished Apply Kernel Variables. lb # [ 8.057661] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 8.060136] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 8.063672] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 5.215361] systemd-modules-load[71]: Inserted module 'dm_mod' worker2 # [ 5.341806] systemd[1]: Finished Load Kernel Modules. lb # [ 8.070201] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 8.071416] systemd[1]: Stopped Load Kernel Modules. client # [ 6.769863] systemd-udevd[77]: Using default interface naming scheme 'v261'. worker2 # [ 5.224437] systemd-modules-load[71]: Module 'virtio_balloon' is built in lb # [ 8.078954] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 5.226433] systemd-modules-load[71]: Module 'virtio_console' is built in worker2 # [ 5.227598] systemd-modules-load[71]: Inserted module 'virtio_gpu' lb # [ 8.084295] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 6.785188] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker2 # [ 5.357886] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 5.358212] systemd[1]: Started Journal Service. lb # [ 8.088836] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 8.093533] systemd[1]: Stopped Create System Files and Directories. lb # [ 8.094636] systemd[1]: Stopped target Local File Systems. lb # [ 8.096244] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 5.244565] systemd-modules-load[71]: Module 'virtio_rng' is built in worker2 # [ 5.245730] systemd-modules-load[71]: Inserted module 'vmw_vsock_virtio_transport' lb # [ 8.100229] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 8.101309] systemd[1]: Stopped Coldplug All udev Devices. client # [ 6.797997] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 8.102099] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 8.104769] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.108359] systemd[1]: Stopped Virtual Console Setup. lb # [ 8.109196] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 8.112339] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 5.261311] systemd-udevd[77]: Using default interface naming scheme 'v261'. lb # [ 8.115361] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 6.816081] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 8.116573] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 5.268929] systemd[1]: Starting Create System Files and Directories... lb # [ 8.126302] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 8.127412] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 8.129490] systemd[1]: systemd-udevd.service: Consumed 1.035s CPU time over 2.476s wall clock time, 17.5M memory peak. lb # [ 8.132617] systemd[1]: systemd-udevd-varlink.socket: Deactivated successfully. lb # [ 8.136134] systemd[1]: Closed udev Varlink Socket. lb # [ 8.136976] systemd[1]: Starting Cleanup udev Database... lb # [ 8.138905] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 8.140386] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 8.141334] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 8.142518] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 8.143527] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 8.144622] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.309156] systemd[1]: Finished Apply Kernel Variables. lb # [ 8.175438] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 8.177923] systemd[1]: Finished Cleanup udev Database. worker2 # [ 5.324899] systemd[1]: Finished Create System Files and Directories. lb # [ 8.180557] systemd[1]: Reached target Switch Root. lb # [ 8.182118] systemd[1]: Starting NixOS Activation... worker2 # [ 5.329955] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 6.891398] systemd[1]: Starting Virtual Console Setup... worker1 # [ 6.926573] systemd[1]: Starting Virtual Console Setup... worker2 # [ 5.424137] systemd[1]: Starting Virtual Console Setup... client # [ 6.981722] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 6.984855] systemd[1]: Finished Virtual Console Setup. worker1 # [ 7.005141] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 7.009720] systemd[1]: Finished Virtual Console Setup. lb # [ 8.328320] initrd-nixos-activation-start[170]: booting system configuration /nix/store/fn162mvn6rkqz600ashkpyjdnns9kvr5-nixos-system-lb-test worker2 # [ 5.509727] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 5.512766] systemd[1]: Finished Virtual Console Setup. lb # [ 8.368822] initrd-nixos-activation-start[170]: running activation script... lb # [ 8.837874] initrd-nixos-activation-start[193]: setting up /etc... worker1 # [ 7.661608] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 7.662631] systemd[1]: Reached target System Initialization. worker1 # [ 7.663483] systemd[1]: Reached target Basic System. client # [ 7.662475] systemd[1]: Finished Coldplug All udev Devices. client # [ 7.663497] systemd[1]: Reached target System Initialization. client # [ 7.668219] systemd[1]: Reached target Basic System. lb # [ 8.985219] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 8.988211] systemd[1]: Finished NixOS Activation. lb # [ 8.989672] systemd[1]: Starting Switch Root... lb # [ 9.012777] systemd[1]: Switching root. worker2 # [ 6.211912] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 6.213037] systemd[1]: Reached target System Initialization. worker2 # [ 6.213925] systemd[1]: Reached target Basic System. worker1 # [ 7.810897] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.816074] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 7.819944] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.846118] (udev-worker)[99]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 7.850870] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.867287] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line. lb # [ 9.308304] systemd-journald[70]: Received SIGTERM from PID 1 (systemd). worker2 # [ 6.347846] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.923389] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 7.927496] systemd[1]: Reached target Initrd Root Device. client # [ 7.933450] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 6.416476] (udev-worker)[99]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 6.425445] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.982671] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 7.985518] systemd[1]: Reached target Initrd Root Device. worker1 # [ 7.987538] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 7.996440] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 8.006967] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 8.009969] systemd[1]: Mounting /sysroot... worker1 # [ 8.037021] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 8.045629] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 6.492596] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 8.048005] systemd[1]: Mounting /sysroot... worker2 # [ 6.496286] systemd[1]: Reached target Initrd Root Device. worker2 # [ 6.502069] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 8.179452] EXT4-fs (vda): mounted filesystem 6ac5a89d-e5b4-4fde-a5ae-ec83ad6e0c8e r/w with ordered data mode. Quota mode: none. client # [ 8.058696] systemd[1]: Mounted /sysroot. client # [ 8.061425] systemd[1]: Reached target Initrd Root File System. client # [ 8.067671] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 8.218276] EXT4-fs (vda): mounted filesystem 1134b3c9-0e9d-4fd8-a9a4-21a46f792f70 r/w with ordered data mode. Quota mode: none. worker1 # [ 8.098605] systemd[1]: Mounted /sysroot. worker1 # [ 8.100935] systemd[1]: Reached target Initrd Root File System. client # [ 8.100304] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 8.106651] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 8.108266] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 8.112631] systemd[1]: Reloading... worker2 # [ 6.563331] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 6.572227] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 6.584152] systemd[1]: Mounting /sysroot... worker1 # [ 8.145184] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 8.152139] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 8.156530] systemd[1]: Reloading... worker2 # [ 6.748061] EXT4-fs (vda): mounted filesystem 56ac7a23-24f9-4799-8723-cdc3c37178b3 r/w with ordered data mode. Quota mode: none. worker2 # [ 6.625090] systemd[1]: Mounted /sysroot. worker2 # [ 6.629020] systemd[1]: Reached target Initrd Root File System. worker2 # [ 6.635557] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 6.715379] systemd-sysroot-fstab-check[118]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 6.719949] systemd[1]: Reload requested from client PID 118 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 6.727035] systemd[1]: Reloading... client # [ 8.332132] systemd[1]: Reloading finished in 216 ms. worker1 # [ 8.366544] systemd[1]: Reloading finished in 216 ms. client # [ 8.366530] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace... client # [ 8.375481] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace... client # [ 8.383346] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 8.386050] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 8.392212] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 8.398528] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace... worker1 # [ 8.406825] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace... worker1 # [ 8.414915] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 8.418522] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 8.420482] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 8.430072] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 8.434614] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 8.441998] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 8.445876] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 8.464268] systemd[1]: Mounting /sysroot/run... client # [ 8.460275] systemd[1]: Mounting /sysroot/run... client # [ 8.480577] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 9.903179] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 8.486706] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 9.903247] systemd[1]: Detected virtualization qemu. lb # [ 9.903310] systemd[1]: Detected architecture arm64. lb # [ 9.903437] systemd[1]: Detected first boot. lb # [ 9.915759] systemd[1]: Initializing machine ID from random generator. client # [ 8.499320] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 8.506646] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 6.967439] systemd[1]: Reloading finished in 243 ms. worker2 # [ 7.001513] systemd-sysroot-fstab-check[118]: Requesting initrd-fs.target/start/replace... worker2 # [ 7.006429] systemd-sysroot-fstab-check[118]: Requesting swap.target/start/replace... worker1 # [ 8.692050] fuse: init (API version 7.45) worker2 # [ 7.023823] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 8.703615] fuse: init (API version 7.45) client # [ 8.581246] systemd[1]: Mounted /sysroot/run. worker1 # [ 8.706082] virtiofs virtio6: discovered new tag: nix-store worker1 # [ 8.707048] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 7.036331] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 8.592777] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 8.713678] virtiofs virtio6: discovered new tag: nix-store worker1 # [ 8.728284] virtiofs virtio7: discovered new tag: shared client # [ 8.598370] systemd[1]: Mounted /sysroot/nix/.rw-store.[ 8.721985] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 8.615123] systemd[1]: Mounted /sysroot/run. client # worker2 # [ 7.068355] systemd[1]: Mounting /sysroot/run... worker1 # [ 8.746031] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 8.753775] virtiofs virtio8: discovered new tag: xchg worker1 # [ 8.754607] virtiofs virtio8: virtio_fs_setup_dax: No cache capability client # [ 8.769009] virtiofs virtio7: discovered new tag: shared worker2 # [ 7.095665] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 8.773392] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 8.651666] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 10.076346] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 8.658810] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 8.663706] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 8.785198] virtiofs virtio8: discovered new tag: xchg worker1 # [ 8.665373] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 7.112217] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 8.666762] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 7.115478] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 8.791733] virtiofs virtio8: virtio_fs_setup_dax: No cache capability worker2 # [ 7.136145] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 8.692622] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 7.140223] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 8.691036] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 8.696145] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 8.694052] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 8.698193] systemd[1]: Mounting /sysroot/nix/store... client # [ 8.695246] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 8.697651] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 8.701059] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 8.709602] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 7.303434] fuse: init (API version 7.45) worker2 # [ 7.310629] virtiofs virtio6: discovered new tag: nix-store worker2 # [ 7.311935] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 8.749327] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 8.751621] systemd[1]: Reached target Initrd File Systems. worker1 # [ 8.754513] systemd[1]: Starting Find NixOS closure... worker2 # [ 7.330966] virtiofs virtio7: discovered new tag: shared worker2 # [ 7.331800] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker2 # [ 7.215732] systemd[1]: Mounted /sysroot/run. worker1 # [ 8.771244] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 8.769279] systemd[1]: Mounted /sysroot/nix/store. client # [ 8.770192] systemd[1]: Reached target Initrd File Systems. client # [ 8.772381] systemd[1]: Starting Find NixOS closure... worker2 # [ 7.349649] virtiofs virtio8: discovered new tag: xchg worker2 # [ 7.350468] virtiofs virtio8: virtio_fs_setup_dax: No cache capability client # [ 8.779696] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 7.239231] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 7.247218] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 8.806704] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 7.258230] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 7.265792] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 8.823473] systemd[1]: Finished Find NixOS closure. worker1 # [ 8.827594] systemd[1]: Reached target Initrd Default Target. client # [ 8.826209] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 8.833813] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 7.284400] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 8.847764] systemd[1]: Finished Find NixOS closure. client # [ 8.850079] systemd[1]: Reached target Initrd Default Target. client # [ 8.860167] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 7.310554] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 7.312221] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 8.867036] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 8.870801] systemd[1]: Stopped target Basic System. worker1 # [ 8.872144] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 8.877590] systemd[1]: Stopped target Path Units. worker1 # [ 8.879599] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 8.881636] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 8.888831] systemd[1]: Stopped target Slice Units. worker1 # [ 8.889699] systemd[1]: Stopped target Socket Units. worker1 # [ 8.891542] systemd[1]: Stopped target System Initialization. client # [ 8.887935] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 8.893704] systemd[1]: Stopped target Swaps. client # [ 8.891551] systemd[1]: Stopped target Basic System. worker1 # [ 8.896603] systemd[1]: Stopped target Timer Units. worker1 # [ 8.898904] systemd[1]: dbus.socket: Deactivated successfully. client # [ 8.896140] systemd[1]: Stopped target Initrd Root Device. client # [ 8.899347] systemd[1]: Stopped target Path Units. worker1 # [ 8.903606] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 8.900230] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 8.905788] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 8.902901] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 8.909153] systemd[1]: Stopped Find NixOS closure. client # [ 8.908647] systemd[1]: Stopped target Slice Units. worker1 # [ 8.913214] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 8.911100] systemd[1]: Stopped target Socket Units. client # [ 8.911939] systemd[1]: Stopped target System Initialization. worker1 # [ 8.916953] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 8.915183] systemd[1]: Stopped target Swaps. worker1 # [ 8.920151] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 8.921219] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 8.919140] systemd[1]: Stopped target Timer Units. client # [ 8.920913] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 8.923606] systemd[1]: Stopped Load Kernel Modules. client # [ 8.925727] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 8.927090] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 8.931865] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 8.930877] systemd[1]: Stopped Find NixOS closure. worker1 # [ 8.934481] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 8.939634] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 8.936205] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 8.940557] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 8.941678] systemd[1]: Stopped Apply Kernel Variables. client # [ 8.944151] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 8.948501] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 8.949561] systemd[1]: Stopped target Local File Systems. worker1 # [ 8.950403] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 8.946563] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 8.951392] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 8.956322] systemd[1]: Stopped Coldplug All udev Devices. client # [ 8.952256] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 8.958861] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 8.955609] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 8.960262] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.963615] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.964730] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 8.968165] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 8.964692] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 8.969223] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 8.965879] systemd[1]: Stopped Create System Files and Directories. client # [ 8.966829] systemd[1]: Stopped target Local File Systems. worker1 # [ 8.970913] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 8.967653] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 8.972267] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 8.973604] systemd[1]: Stopped Coldplug All udev Devices. client # [ 8.974548] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 8.979534] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 8.975622] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.976830] systemd[1]: Stopped Virtual Console Setup. client # [ 8.977597] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 8.978598] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 8.982625] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 8.979561] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 8.984004] systemd[1]: systemd-udevd-varlink.socket: Deactivated successfully. worker1 # [ 8.988483] systemd[1]: Closed udev Varlink Socket. worker1 # [ 8.989320] systemd[1]: Starting Cleanup udev Database... worker1 # [ 8.990125] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 8.987158] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 8.993826] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 8.994955] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 8.992426] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 8.996258] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 8.993537] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 8.997867] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 8.998907] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 8.994723] systemd[1]: systemd-udevd-varlink.socket: Deactivated successfully. client # [ 8.995761] systemd[1]: Closed udev Varlink Socket. client # [ 8.997213] systemd[1]: Starting Cleanup udev Database... client # [ 8.998060] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 8.999313] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 9.000521] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 9.001699] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 9.002758] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 9.003713] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 10.439371] systemd[1]: Applying preset policy. worker1 # [ 9.026864] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 9.029340] systemd[1]: Finished Cleanup udev Database. worker1 # [ 9.032405] systemd[1]: Reached target Switch Root. worker1 # [ 9.034195] systemd[1]: Starting NixOS Activation... client # [ 9.033602] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 9.036647] systemd[1]: Finished Cleanup udev Database. client # [ 9.040180] systemd[1]: Reached target Switch Root. client # [ 9.041050] systemd[1]: Starting NixOS Activation... client # [ 9.154662] initrd-nixos-activation-start[171]: booting system configuration /nix/store/65qxpij1lpr90li04q3cg5lk7x3rhgwh-nixos-system-client-test worker1 # [ 9.161784] initrd-nixos-activation-start[169]: booting system configuration /nix/store/azn573qs4x78nhd0q14gh5h6ykm8hpri-nixos-system-worker1-test client # [ 9.194104] initrd-nixos-activation-start[171]: running activation script... worker1 # [ 9.200581] initrd-nixos-activation-start[169]: running activation script... lb # [ 10.872940] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 8.005535] systemd[1]: Mounting /sysroot/nix/store... client # [ 9.598294] initrd-nixos-activation-start[194]: setting up /etc... worker1 # [ 9.603688] initrd-nixos-activation-start[192]: setting up /etc... worker2 # [ 8.060103] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 8.061049] systemd[1]: Reached target Initrd File Systems. worker2 # [ 8.063092] systemd[1]: Starting Find NixOS closure... worker2 # [ 8.074605] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 8.116873] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 8.121423] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 8.128427] (udev-worker)[90]: mtd0ro: Failed to find and pin callout binary "/nix/store/rzzrvlm7r31iq3im3h66nhxc2zh996l9-systemd-262/lib/udev/mtd_probe": No such file or directory worker2 # [ 8.140270] (udev-worker)[90]: mtd0ro: /etc/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker2 # [ 8.151164] systemd[1]: Finished Find NixOS closure. lb # [ 11.127076] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 11.127546] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 8.155504] systemd[1]: Reached target Initrd Default Target. lb # [ 11.133145] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 11.135106] systemd[1]: Created slice Slice /system/getty. worker2 # [ 8.161492] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 11.138466] systemd[1]: Created slice User and Session Slice. lb # [ 11.139045] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 11.139801] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 11.143818] systemd[1]: Expecting device /dev/hvc0... lb # [ 11.145632] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 11.146040] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 11.146838] systemd[1]: Stopped target initrd-fs.target. lb # [ 11.147442] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 11.148051] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 11.152899] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 11.153349] systemd[1]: Reached target Path Units. lb # [ 11.154027] systemd[1]: Reached target Remote File Systems. client # [ 9.729648] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 11.154679] systemd[1]: Reached target Slice Units. lb # [ 11.155302] systemd[1]: Reached target Swaps. client # [ 9.733001] systemd[1]: Finished NixOS Activation. client # [ 9.734432] systemd[1]: Starting Switch Root... worker1 # [ 9.739303] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 11.161048] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 11.163860] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 9.742601] systemd[1]: Finished NixOS Activation. worker1 # [ 9.743929] systemd[1]: Starting Switch Root... lb # [ 11.167932] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 11.170340] systemd[1]: Listening on Factory Reset Management. lb # [ 11.170858] systemd[1]: Listening on Hostname Service Socket. lb # [ 11.177162] systemd[1]: Starting Journal Log Access Socket... lb # [ 11.179755] systemd[1]: Listening on Journal Audit Socket. client # [ 9.757647] systemd[1]: Switching root. lb # [ 11.186121] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 11.187110] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 9.769119] systemd[1]: Switching root. lb # [ 11.190870] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 11.191337] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 8.218544] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 8.220193] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 11.198482] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 11.199092] systemd[1]: Listening on udev Varlink Socket. lb # [ 11.205867] systemd[1]: Mounting Huge Pages File System... worker2 # [ 8.231086] systemd[1]: Stopped target Initrd Default Target. lb # [ 11.210423] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 8.234828] systemd[1]: Stopped target Basic System. worker2 # [ 8.235731] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 8.236797] systemd[1]: Stopped target Path Units. worker2 # [ 8.238359] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 8.242539] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 8.249400] systemd[1]: Stopped target Slice Units. worker2 # [ 8.250305] systemd[1]: Stopped target Socket Units. lb # [ 11.224627] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 8.251893] systemd[1]: Stopped target System Initialization. worker2 # [ 8.254537] systemd[1]: Stopped target Swaps. worker2 # [ 8.260316] systemd[1]: Stopped target Timer Units. lb # [ 11.238851] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 8.263998] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 8.265339] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 8.266231] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 8.269562] systemd[1]: Stopped Find NixOS closure. worker2 # [ 8.271621] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 8.273657] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 8.275021] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 8.275923] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 8.277136] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 8.277911] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 8.279094] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 11.261657] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 11.262309] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 8.295558] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 11.274100] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 8.300404] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 8.301613] systemd[1]: Stopped target Local File Systems. worker2 # [ 8.302592] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 8.303606] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 11.280460] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 11.283791] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 11.287834] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 8.313617] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 8.317347] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 8.324330] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 11.302612] systemd[1]: Mounting FUSE Control File System... worker2 # [ 8.328260] systemd[1]: Stopped Virtual Console Setup. lb # [ 11.307297] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.332596] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 8.336207] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.337183] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 8.342559] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 8.348215] systemd[1]: systemd-udevd.service: Consumed 1.687s CPU time over 3.155s wall clock time, 24.7M memory peak. worker2 # [ 8.351008] systemd[1]: systemd-udevd-varlink.socket: Deactivated successfully. worker2 # [ 8.353665] systemd[1]: Closed udev Varlink Socket. worker2 # [ 8.354453] systemd[1]: Starting Cleanup udev Database... worker2 # [ 8.356572] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 8.360142] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 8.361116] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 8.364371] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 8.365490] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 8.368339] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 8.372294] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 8.373420] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 10.048355] systemd-journald[70]: Received SIGTERM from PID 1 (systemd). worker2 # [ 8.374572] systemd-vconsole-setup[170]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 11.351932] systemd[1]: Starting Journal Service... worker2 # [ 8.380207] systemd[1]: Finished Virtual Console Setup. worker1 # [ 10.066687] systemd-journald[70]: Received SIGTERM from PID 1 (systemd). lb # [ 11.373843] systemd[1]: Starting Load Kernel Modules... worker2 # [ 8.398783] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 8.400721] systemd[1]: Finished Cleanup udev Database. worker2 # [ 8.403041] systemd[1]: Reached target Switch Root. worker2 # [ 8.404298] systemd[1]: Starting NixOS Activation... lb # [ 11.418089] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 11.432548] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 11.432971] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 11.447014] systemd-journald[265]: Collecting audit messages is enabled. lb # [ 11.450730] systemd[1]: Starting Coldplug All udev Devices... lb # [ 11.337034] systemd[1]: Queued start job for default target Multi-User System. lb # [ 11.338543] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 8.503486] initrd-nixos-activation-start[177]: booting system configuration /nix/store/2zx252myayv5qmkzz9lyhs30cskhf704-nixos-system-worker2-test lb # [ 11.487537] systemd[1]: Started Journal Service. lb # [ 11.379878] systemd-modules-load[266]: Module 'atkbd' is built in lb # [ 11.387827] systemd[1]: Listening on Journal Log Access Socket. lb # [ 11.392357] systemd-modules-load[266]: Module 'loop' is built in worker2 # [ 8.540802] initrd-nixos-activation-start[177]: running activation script... lb # [ 11.398974] systemd[1]: Mounted Huge Pages File System. lb # [ 11.399898] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 11.406033] systemd[1]: Mounted Kernel Debug File System. lb # [ 11.406887] systemd[1]: Mounted Kernel Trace File System. lb # [ 11.407689] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 11.418369] systemd[1]: Finished Load Kernel Modules. lb # [ 11.450787] systemd[1]: Starting Firewall... lb # [ 11.456355] systemd[1]: Starting Apply Kernel Variables... lb # [ 11.596767] EXT4-fs (vda): re-mounted a85cf1fb-224b-4095-82f3-8010ee0bd486. lb # [ 11.479376] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 11.501650] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 11.511530] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 11.520712] systemd-oomd[268]: No swap; memory pressure usage will be degraded lb # [ 11.548601] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 11.549715] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 11.578863] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 11.579927] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 11.587342] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 11.593910] systemd[1]: Mounted Kernel Configuration File System. lb # [ 11.595007] systemd[1]: Mounted FUSE Control File System. lb # [ 11.796455] systemd-journald[265]: Received client request to flush runtime journal. lb # [ 11.753198] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 10.571793] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 10.569793] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 10.571853] systemd[1]: Detected virtualization qemu. lb # [ 11.754205] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 10.571912] systemd[1]: Detected architecture arm64. lb # [ 11.755040] systemd[1]: Reached target First Boot Complete. worker1 # [ 10.572027] systemd[1]: Detected first boot. client # [ 10.576952] systemd[1]: Detected virtualization qemu. client # [ 10.577023] systemd[1]: Detected architecture arm64. client # [ 10.577142] systemd[1]: Detected first boot. lb # [ 11.761492] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 10.584843] systemd[1]: Initializing machine ID from random generator. client # [ 10.583158] systemd[1]: Initializing machine ID from random generator. worker2 # [ 8.960640] initrd-nixos-activation-start[200]: setting up /etc... lb # [ 11.851456] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 11.857536] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 10.728271] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 10.735394] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 9.133294] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 9.136251] systemd[1]: Finished NixOS Activation. worker2 # [ 9.138479] systemd[1]: Starting Switch Root... lb # [ 12.009084] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 9.161248] systemd[1]: Switching root. lb # [ 12.016113] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 12.020334] systemd[1]: Mounting /run/wrappers... lb # [ 12.026327] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 12.108755] systemd[1]: Mounted /run/wrappers. lb # [ 12.109948] systemd[1]: Reached target Local File Systems. lb # [ 12.119974] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 12.127019] systemd[1]: Starting register-nix-paths.service... lb # [ 12.132231] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 12.133210] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 12.144119] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 12.162150] systemd[1]: Starting Create System Files and Directories... worker2 # [ 9.455359] systemd-journald[70]: Received SIGTERM from PID 1 (systemd). client # [ 11.049684] systemd[1]: Applying preset policy. worker1 # [ 11.052889] systemd[1]: Applying preset policy. lb # [ 12.355191] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 12.363473] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 12.498720] systemd[1]: Finished Create System Files and Directories. lb # [ 12.518007] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 12.523483] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 11.469549] systemd[1]: Populated /etc with preset unit settings. lb # [ 12.682359] systemd-udevd[310]: Using default interface naming scheme 'v261'. client # [ 11.502707] systemd[1]: Populated /etc with preset unit settings. lb # [ 12.701876] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 9.970674] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 9.970744] systemd[1]: Detected virtualization qemu. worker2 # [ 9.970798] systemd[1]: Detected architecture arm64. worker2 # [ 9.970946] systemd[1]: Detected first boot. worker2 # [ 9.982968] systemd[1]: Initializing machine ID from random generator. lb # [ 12.788229] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 12.797388] systemd[1]: Starting Update is Completed... worker2 # [ 10.128675] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 11.709418] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 11.709933] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 11.712537] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 11.718259] systemd[1]: Created slice Slice /system/getty. worker1 # [ 11.720294] systemd[1]: Created slice User and Session Slice. worker1 # [ 11.723252] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 11.723773] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 11.724456] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 11.728428] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 11.725585] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 11.728462] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 11.730257] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 11.730660] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 11.731332] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 11.731950] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 11.732563] systemd[1]: Reached target Virtual Machines and Containers. client # [ 11.732308] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 11.737975] systemd[1]: Reached target Path Units. client # [ 11.736005] systemd[1]: Created slice Slice /system/getty. worker1 # [ 11.738422] systemd[1]: Reached target Remote File Systems. client # [ 11.737410] systemd[1]: Created slice User and Session Slice. worker1 # [ 11.739256] systemd[1]: Reached target Slice Units. lb # [ 12.917563] systemd[1]: Finished Update is Completed. worker1 # [ 11.739919] systemd[1]: Reached target Swaps. client # [ 11.740224] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 11.740745] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 11.741397] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 11.744952] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 11.745249] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 11.746890] systemd[1]: Listening on Process Core Dump Socket. client # [ 11.745684] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 11.748213] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 11.748502] systemd[1]: Stopped target initrd-fs.target. client # [ 11.748898] systemd[1]: Stopped target initrd-root-fs.target. client # [ 11.749531] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 11.754171] systemd[1]: Listening on Factory Reset Management. worker1 # [ 11.754723] systemd[1]: Listening on Hostname Service Socket. client # [ 11.752938] systemd[1]: Reached target Virtual Machines and Containers. client # [ 11.753364] systemd[1]: Reached target Path Units. worker1 # [ 11.759855] systemd[1]: Starting Journal Log Access Socket... client # [ 11.756220] systemd[1]: Reached target Remote File Systems. client # [ 11.756613] systemd[1]: Reached target Slice Units. client # [ 11.757281] systemd[1]: Reached target Swaps. worker1 # [ 11.762796] systemd[1]: Listening on Journal Audit Socket. client # [ 11.761674] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 11.765474] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 11.766708] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 11.767512] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 11.768042] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 11.768368] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 11.769644] systemd[1]: Listening on Factory Reset Management. client # [ 11.771770] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 11.772721] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 11.778940] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 11.775757] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 11.779561] systemd[1]: Listening on udev Varlink Socket. client # [ 11.777212] systemd[1]: Listening on Journal Audit Socket. client # [ 11.781366] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 11.785295] systemd[1]: Mounting Huge Pages File System... client # [ 11.784200] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 11.785340] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 11.789626] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 11.793183] systemd[1]: Mounting POSIX Message Queue File System... client # [ 11.794127] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 11.794704] systemd[1]: Listening on udev Varlink Socket. client # [ 11.797621] systemd[1]: Mounting Huge Pages File System... worker1 # [ 11.805019] systemd[1]: Mounting Kernel Debug File System... client # [ 11.809959] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 11.812783] systemd[1]: Mounting Kernel Trace File System... client # [ 11.818681] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 11.823388] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 11.823794] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 11.836131] systemd[1]: Mounting Kernel Trace File System... lb # [ 13.016234] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 11.846378] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 11.846815] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 11.847230] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 11.847520] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 11.859518] systemd[1]: Starting Create List of Static Device Nodes... client # [ 11.860136] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 11.874123] systemd[1]: Mounting Kernel Configuration File System... client # [ 11.876425] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 11.892107] systemd[1]: Mounting FUSE Control File System... worker1 # [ 11.892566] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 11.890275] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 11.890852] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 11.912422] systemd[1]: Mounting FUSE Control File System... client # [ 11.912883] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 11.934749] systemd[1]: Starting Journal Service... client # [ 11.950158] systemd[1]: Starting Journal Service... worker1 # [ 11.965675] systemd[1]: Starting Load Kernel Modules... client # [ 11.974299] systemd[1]: Starting Load Kernel Modules... worker1 # [ 11.976876] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 11.985807] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 11.988810] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 11.998687] systemd[1]: Starting Coldplug All udev Devices... client # [ 11.996101] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 12.006562] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 12.007092] systemd[1]: Mounted Huge Pages File System. worker1 # [ 12.008267] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 12.016381] systemd[1]: Mounted Kernel Debug File System. client # [ 12.011850] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 12.012392] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 12.018678] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 12.020092] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 12.023262] systemd[1]: Mounted FUSE Control File System. worker1 # [ 12.040949] systemd[1]: Finished Create List of Static Device Nodes. client # [ 12.035143] systemd-journald[266]: Collecting audit messages is enabled. worker1 # [ 12.046897] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 11.928584] systemd[1]: Queued start job for default target Multi-User System. client # [ 11.930002] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 12.058280] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 10.519811] systemd[1]: Applying preset policy. client # [ 12.085786] systemd[1]: Started Journal Service. client # [ 11.966723] systemd-modules-load[267]: Module 'atkbd' is built in client # [ 11.972592] systemd-modules-load[267]: Module 'loop' is built in client # [ 11.979021] systemd[1]: Listening on Journal Log Access Socket. client # [ 11.983106] systemd[1]: Mounted Huge Pages File System. client # [ 11.988533] systemd[1]: Mounted POSIX Message Queue File System. client # [ 11.989577] systemd[1]: Mounted Kernel Debug File System. client # [ 11.990509] systemd[1]: Mounted Kernel Trace File System. client # [ 11.991316] systemd[1]: Finished Create List of Static Device Nodes. client # [ 12.005375] systemd[1]: Finished Load Kernel Modules. worker1 # [ 12.136260] systemd[1]: Finished Load Kernel Modules. worker1 # [ 12.142397] systemd[1]: Starting Firewall... lb # [ 13.323276] systemd[1]: Finished Coldplug All udev Devices. client # [ 12.142273] EXT4-fs (vda): re-mounted 6ac5a89d-e5b4-4fde-a5ae-ec83ad6e0c8e. worker1 # [ 12.154291] systemd-journald[264]: Collecting audit messages is enabled. worker1 # [ 12.155493] systemd[1]: Starting Apply Kernel Variables... client # [ 12.035208] systemd[1]: Starting Apply Kernel Variables... client # [ 12.042984] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 12.169181] EXT4-fs (vda): re-mounted 1134b3c9-0e9d-4fd8-a9a4-21a46f792f70. client # [ 12.048258] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 12.050978] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 12.185584] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 12.186480] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 12.186887] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 12.073780] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 12.203676] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 12.204198] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 12.208103] systemd[1]: Started Journal Service. client # [ 12.089877] systemd-oomd[269]: No swap; memory pressure usage will be degraded worker1 # [ 12.097164] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 12.100284] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 12.101408] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 12.111096] systemd-modules-load[265]: Module 'atkbd' is built in client # [ 12.115751] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 12.123881] systemd-modules-load[265]: Module 'loop' is built in client # [ 12.119788] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 12.126375] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 12.127361] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 12.138485] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 12.161446] systemd[1]: Mounted FUSE Control File System. worker1 # [ 12.200115] systemd-oomd[266]: No swap; memory pressure usage will be degraded worker1 # [ 12.220870] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 12.221036] systemd[1]: Finished Load/Save OS Random Seed. client # [ 12.222029] systemd[1]: Reached target First Boot Complete. client # [ 12.352778] systemd-journald[266]: Received client request to flush runtime journal. worker1 # [ 12.377873] systemd-journald[264]: Received client request to flush runtime journal. client # [ 12.280494] systemd[1]: Finished Apply Kernel Variables. client # [ 12.289357] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 12.334803] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 12.335837] systemd[1]: Reached target First Boot Complete. worker1 # [ 12.342689] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 12.343617] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 12.356322] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 12.357420] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 10.967355] systemd[1]: Populated /etc with preset unit settings. client # [ 12.412930] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 12.421556] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 12.467427] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 12.472834] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 12.480299] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 13.806665] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 13.817213] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 12.595517] systemd[1]: Mounting /run/wrappers... worker2 # [ 11.197930] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 11.198819] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 11.203910] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 11.207755] systemd[1]: Created slice Slice /system/getty. worker2 # [ 11.210265] systemd[1]: Created slice User and Session Slice. worker2 # [ 11.210872] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 11.211579] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 11.212161] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 11.212749] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 11.218342] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 11.218786] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 11.219447] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 11.220047] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 11.220643] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 11.225892] systemd[1]: Reached target Path Units. worker2 # [ 11.226315] systemd[1]: Reached target Remote File Systems. worker2 # [ 11.226977] systemd[1]: Reached target Slice Units. worker2 # [ 11.227595] systemd[1]: Reached target Swaps. worker2 # [ 11.232333] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 11.236500] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 12.665001] systemd[1]: Mounted /run/wrappers. worker1 # [ 12.665868] systemd[1]: Reached target Local File Systems. worker2 # [ 11.239517] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 11.242570] systemd[1]: Listening on Factory Reset Management. worker2 # [ 11.243145] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 11.248455] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 11.252519] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 12.671036] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 12.681045] systemd[1]: Starting register-nix-paths.service... worker2 # [ 11.256273] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 11.259172] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 11.260555] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 11.264618] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 12.692073] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 11.270835] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 11.271536] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 11.277195] systemd[1]: Mounting Huge Pages File System... worker2 # [ 11.280705] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 12.708467] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 12.718680] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 11.293766] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 12.726835] systemd[1]: Starting Create System Files and Directories... worker2 # [ 11.309211] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 11.330458] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 11.330919] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 11.348127] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 11.348632] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 11.355143] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 11.355558] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 11.375472] systemd[1]: Mounting FUSE Control File System... lb # [ 14.102622] systemd[1]: Finished register-nix-paths.service. lb # [ 14.104273] systemd[1]: Reached target System Initialization. worker2 # [ 11.375947] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 14.110331] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 14.111553] systemd[1]: Started niks3 garbage collection timer. lb # [ 14.116620] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 14.117659] systemd[1]: Reached target Timer Units. lb # [ 14.118444] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 14.124463] systemd[1]: Listening on niks3 server socket. lb # [ 14.128311] systemd[1]: Listening on Nix Daemon Socket. lb # [ 14.129160] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_UNIX Local). lb # [ 14.141663] systemd[1]: Starting OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK)... lb # [ 14.143045] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 11.419194] systemd[1]: Starting Journal Service... lb # [ 14.153566] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 12.862221] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 11.442038] systemd[1]: Starting Load Kernel Modules... worker1 # [ 12.872198] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 12.884909] systemd[1]: Finished Coldplug All udev Devices. client # [ 12.890557] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 12.893051] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 11.469300] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 12.896790] systemd[1]: Mounting /run/wrappers... client # [ 12.900792] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 11.480935] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 11.481477] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 14.221795] systemd-ssh-issue[453]: Options --make-vsock/--rm-vsock have been replaced by make-vsock/rm-vsock verbs. worker2 # [ 11.498257] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 11.498652] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 11.498953] systemd[1]: Stopped Virtual Console Setup. lb # [ 14.231803] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK). lb # [ 14.235842] systemd[1]: Reached target Socket Units. worker2 # [ 11.509968] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 11.510500] systemd[1]: Mounted Huge Pages File System. worker2 # [ 11.510934] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 11.511327] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 11.511723] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 11.512106] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 11.524780] systemd[1]: Mounted FUSE Control File System. client # [ 12.947587] systemd[1]: Mounted /run/wrappers. client # [ 12.950202] systemd[1]: Reached target Local File Systems. client # [ 12.954818] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 12.958695] systemd[1]: Starting register-nix-paths.service... client # [ 12.964135] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 12.965152] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 11.552607] systemd[1]: Finished Create List of Static Device Nodes. client # [ 12.981824] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 11.560637] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 12.990160] systemd[1]: Finished Create System Files and Directories. client # [ 12.989742] systemd[1]: Starting Create System Files and Directories... worker1 # [ 12.995331] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 13.004594] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 14.314952] dbus-broker-launch[455]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 14.321282] dbus-broker-launch[455]: NSS returned no entry for 'systemd-timesync' lb # [ 14.322445] dbus-broker-launch[455]: Invalid user-name in /nix/store/y5a305370pycn3fhwhgamh3bl7g7vmal-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 14.352731] systemd[1]: Started D-Bus System Message Bus. lb # [ 14.357130] systemd[1]: Reached target Basic System. lb # [ 14.363202] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 11.638541] EXT4-fs (vda): re-mounted 56ac7a23-24f9-4799-8723-cdc3c37178b3. lb # [ 14.370218] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.646908] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 11.647595] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 11.647898] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 14.380096] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.654977] systemd-journald[271]: Collecting audit messages is enabled. worker2 # [ 11.665688] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 11.666211] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 13.092106] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 11.671009] systemd[1]: Finished Load Kernel Modules. client # [ 13.097873] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 14.404411] systemd[1]: Started Reset console on configuration changes. lb # [ 14.405877] dbus-broker-launch[455]: Ready worker2 # [ 11.690951] systemd[1]: Starting Firewall... worker2 # [ 11.701514] systemd[1]: Starting Apply Kernel Variables... lb # [ 14.432131] systemd[1]: Starting resolvconf update... worker2 # [ 11.715726] systemd[1]: Started Journal Service. worker1 # [ 13.149733] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 11.596783] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 11.598088] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 11.609639] systemd-modules-load[272]: Module 'atkbd' is built in lb # [ 14.472176] systemd[1]: Starting SSH Host Keys Generation... worker2 # [ 11.625338] systemd-modules-load[272]: Module 'loop' is built in worker2 # [ 11.636957] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 13.193867] systemd-udevd[301]: Using default interface naming scheme 'v261'. client # [ 13.193084] systemd[1]: Finished Create System Files and Directories. client # [ 13.206539] systemd[1]: Starting Rebuild Journal Catalog... client # [ 13.212214] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 13.229383] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 13.234781] systemd[1]: Starting Update is Completed... worker2 # [ 11.707712] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 11.713945] systemd[1]: Reached target First Boot Complete. worker2 # [ 11.724835] systemd-oomd[273]: No swap; memory pressure usage will be degraded worker2 # [ 11.740968] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 13.313727] systemd-udevd[297]: Using default interface naming scheme 'v261'. client # [ 13.339780] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 11.877666] systemd-journald[271]: Received client request to flush runtime journal. lb # [ 14.649008] systemd[1]: Finished Post-Boot Actions. worker1 # [ 13.356356] systemd[1]: Finished Update is Completed. client # [ 13.369647] systemd[1]: Finished Rebuild Journal Catalog. client # [ 13.381488] systemd[1]: Starting Update is Completed... lb # [ 14.686294] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 14.692204] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 14.693331] systemd[1]: Reached target User and Group Name Lookups. lb # [ 14.712480] systemd[1]: Starting User Login Management... client # [ 13.473979] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 13.482562] systemd[1]: Finished Update is Completed. lb # [ 14.871012] nsncd[470]: Nov 12 09:18:36.608 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 13.600102] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 15.008201] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 12.160820] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 12.162149] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 12.163111] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 12.174119] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 12.288675] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 12.292620] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 12.300757] systemd[1]: Mounting /run/wrappers... worker2 # [ 12.308377] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 12.369961] systemd[1]: Mounted /run/wrappers. lb # [ 15.223815] systemd-logind[499]: New seat seat0. worker2 # [ 12.373226] systemd[1]: Reached target Local File Systems. lb # [ 15.234308] systemd[1]: Started User Login Management. worker2 # [ 12.384834] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 12.392583] systemd[1]: Starting register-nix-paths.service... lb # [ 15.369838] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 lb # [ 15.258554] systemd[1]: Starting linger-users.service... worker2 # [ 12.405354] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 12.410068] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 12.420423] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 12.432671] systemd[1]: Starting Create System Files and Directories... lb # [ 15.392456] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 15.393682] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 15.394713] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 15.395633] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 12.548551] systemd-udevd[314]: Using default interface naming scheme 'v261'. lb # [ 15.414692] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 15.415708] systemd[1]: nscd.service: Deactivated successfully. lb # [ 15.424465] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 12.575889] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 15.458613] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 15.465511] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 15.470072] systemd[1]: Finished linger-users.service. worker2 # [ 12.698780] systemd[1]: Finished Create System Files and Directories. worker2 # [ 12.707421] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 12.724339] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 15.584734] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 15.592282] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 15.596542] systemd[1]: Reached target User and Group Name Lookups. lb # [ 15.598090] nsncd[571]: Nov 12 09:18:37.339 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 14.307951] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 14.312142] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 15.621061] systemd[1]: Finished Firewall. worker2 # [ 12.862928] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 14.421752] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 12.868557] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 14.423159] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 15.734937] systemd[1]: Finished resolvconf update. lb # [ 15.748350] systemd[1]: Reached target Preparation for Network. lb # [ 15.757321] systemd[1]: Starting DHCP Client... lb # [ 15.762581] systemd[1]: Starting Extra networking commands.... worker2 # [ 13.005433] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 13.011078] systemd[1]: Starting Update is Completed... worker2 # [ 13.070423] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 13.173501] systemd[1]: Finished Update is Completed. worker1 # [ 14.727537] systemd[1]: Finished Coldplug All udev Devices. lb # [ 16.226291] dhcpcd[605]: dhcpcd-10.3.2 starting lb # [ 16.266579] dhcpcd[646]: dev: loaded udev lb # [ 16.268210] dhcpcd[646]: no valid interfaces found lb # [ 16.271045] dhcpcd[646]: no valid interfaces found client # [ 15.231424] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 worker1 # [ 15.150714] systemd[1]: Finished Firewall. lb # [ 16.528504] systemd[1]: Finished Extra networking commands.. lb # [ 16.536482] systemd[1]: Reached target Network. lb # [ 16.546893] systemd[1]: Starting PostgreSQL Server... lb # [ 16.563661] systemd[1]: Starting Permit User Sessions... client # [ 15.336537] systemd[1]: Finished register-nix-paths.service. client # [ 15.337961] systemd[1]: Reached target System Initialization. client # [ 15.339542] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 15.343413] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 15.346935] systemd[1]: Reached target Timer Units. client # [ 15.347696] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 15.350739] systemd[1]: Listening on Nix Daemon Socket. client # [ 15.356721] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_UNIX Local). client # [ 15.369931] systemd[1]: Starting OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK)... client # [ 15.371324] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 15.385130] systemd[1]: Starting nftables firewall... worker2 # [ 13.847552] systemd[1]: Finished Coldplug All udev Devices. client # [ 15.405182] systemd[1]: Starting D-Bus System Message Bus... lb # [ 16.734648] systemd[1]: Starting Virtual Console Setup... lb # [ 16.744960] systemd[1]: Finished Permit User Sessions. lb # [ 16.756841] systemd[1]: Started Getty on tty1. client # [ 15.461268] systemd-ssh-issue[385]: Options --make-vsock/--rm-vsock have been replaced by make-vsock/rm-vsock verbs. lb # [ 16.774520] systemd[1]: Reached target Login Prompts. client # [ 15.471192] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK). client # [ 15.478107] systemd[1]: Reached target Socket Units. worker2 # [ 13.960410] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 13.974405] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 16.832612] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 13.980294] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 15.535977] systemd[1]: Finished register-nix-paths.service. worker1 # [ 15.539737] systemd[1]: Reached target System Initialization. worker1 # [ 15.541406] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 15.542600] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 15.543588] systemd[1]: Reached target Timer Units. worker1 # [ 15.546205] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 15.547234] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 15.551224] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_UNIX Local). lb # [ 16.855980] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 15.560371] systemd[1]: Starting OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK)... lb # [ 16.864274] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 15.569241] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 15.567481] dbus-broker-launch[387]: Looking up NSS user entry for 'systemd-timesync'... client # [ 15.571771] dbus-broker-launch[387]: NSS returned no entry for 'systemd-timesync' worker1 # [ 15.577235] systemd[1]: Starting D-Bus System Message Bus... client # [ 15.575698] dbus-broker-launch[387]: Invalid user-name in /nix/store/1b8bc9cms53223z8qsx6jnrq2rgqiwzl-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 14.027765] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 16.889839] systemd[1]: Starting Virtual Console Setup... client # [ 15.618710] systemd[1]: Started D-Bus System Message Bus. client # [ 15.624458] systemd[1]: Reached target Basic System. worker1 # [ 15.622726] systemd-ssh-issue[482]: Options --make-vsock/--rm-vsock have been replaced by make-vsock/rm-vsock verbs. worker1 # [ 15.633561] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK). worker1 # [ 15.637559] systemd[1]: Reached target Socket Units. client # [ 15.633971] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 15.643636] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 15.672410] dbus-broker-launch[483]: Looking up NSS user entry for 'systemd-timesync'... client # [ 15.670791] systemd[1]: Starting Post-Boot Actions... worker1 # [ 15.675904] dbus-broker-launch[483]: NSS returned no entry for 'systemd-timesync' client # [ 15.680355] dbus-broker-launch[387]: Ready worker1 # [ 15.679460] dbus-broker-launch[483]: Invalid user-name in /nix/store/000c7k1dvdap3rqf1gy7z1s6ps2i4abl-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 15.705803] systemd[1]: Started Reset console on configuration changes. worker1 # [ 15.718007] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 15.731193] systemd[1]: Reached target Basic System. worker1 # [ 15.748436] systemd[1]: Starting Nix worker-protocol over gRPC... client # [ 15.752383] systemd[1]: Starting resolvconf update... client # [ 15.776475] systemd[1]: Starting SSH Host Keys Generation... worker1 # [ 15.767621] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 15.795452] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 15.818873] systemd[1]: Starting Post-Boot Actions... worker1 # [ 15.841156] systemd[1]: Started Reset console on configuration changes. worker1 # [ 15.859476] systemd[1]: Starting resolvconf update... client # [ 15.865480] systemd[1]: Finished Post-Boot Actions. worker1 # [ 15.874482] systemd[1]: Starting SSH Host Keys Generation... client # [ 15.887177] nsncd[400]: Nov 12 09:18:39.674 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 17.209659] postgresql-pre-start[678]: The files belonging to this database system will be owned by user "postgres". lb # [ 17.211444] postgresql-pre-start[678]: This user must also own the server process. worker1 # [ 15.912966] dbus-broker-launch[483]: Ready client # [ 15.913524] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 14.371461] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 17.229066] postgresql-pre-start[678]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 17.230563] postgresql-pre-start[678]: The default database encoding has accordingly been set to "UTF8". lb # [ 17.231844] postgresql-pre-start[678]: The default text search configuration will be set to "english". lb # [ 17.248633] postgresql-pre-start[678]: Data page checksums are enabled. lb # [ 17.249672] postgresql-pre-start[678]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 17.251033] postgresql-pre-start[678]: creating subdirectories ... ok lb # [ 17.251932] postgresql-pre-start[678]: selecting dynamic shared memory implementation ... posix client # [ 15.985666] systemd[1]: Reached target Host and Network Name Lookups. client # [ 15.986838] systemd[1]: Reached target User and Group Name Lookups. client # [ 15.987775] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 16.016299] systemd[1]: Starting User Login Management... worker1 # [ 16.049857] systemd[1]: Finished Post-Boot Actions. lb # [ 17.353801] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 17.363530] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 14.510165] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. client # [ 16.060982] systemd[1]: Starting Virtual Console Setup... worker1 # [ 16.077737] nix-grpc-daemon[485]: ts=2026-11-12T09:18:39Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" lb # [ 17.378818] systemd[1]: Started backdoor.service. client # [ 16.083659] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 14.558045] systemd[1]: Finished Firewall. worker1 # [ 16.128378] nix-grpc-daemon[485]: ts=2026-11-12T09:18:39Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 16.148713] nix-grpc-daemon[485]: ts=2026-11-12T09:18:39Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 16.164682] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 16.172614] nsncd[487]: Nov 12 09:18:39.914 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 16.195829] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 16.202018] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 16.212658] systemd[1]: Starting User Login Management... worker1 # [ 16.221124] nix-grpc-daemon[485]: ts=2026-11-12T09:18:39Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 14.685618] (udev-worker)[439]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 16.254150] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 14.703450] (udev-worker)[439]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 14.707474] (udev-worker)[440]: Network interface NamePolicy= disabled on kernel command line. lb # [ 17.564099] postgresql-pre-start[678]: selecting default "max_connections" ... 100 worker1 # [ 16.268535] nix-grpc-daemon[485]: ts=2026-11-12T09:18:40Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Could not connect to server" worker1 # [ 16.292462] systemd[1]: Started Nix worker-protocol over gRPC. lb # connecting to host... lb # [ 17.595464] (udev-worker)[611]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 16.303812] nix-grpc-daemon[485]: ts=2026-11-12T09:18:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" lb # [ 17.606816] (udev-worker)[607]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 17.615864] (udev-worker)[607]: Network interface NamePolicy= disabled on kernel command line. lb # [ 17.779191] 8021q: 802.1Q VLAN Support v1.8 client # [ 16.357766] systemd-logind[427]: New seat seat0. worker1 # [ 16.485284] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 client # [ 16.372600] systemd[1]: Started User Login Management. client # [ 16.387453] systemd[1]: Starting linger-users.service... worker2 # [ 14.865352] systemd[1]: Finished register-nix-paths.service. worker2 # [ 14.867454] systemd[1]: Reached target System Initialization. worker2 # [ 14.869060] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 14.870139] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 14.871151] systemd[1]: Reached target Timer Units. worker2 # [ 14.871924] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 14.878540] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 14.879367] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_UNIX Local). worker2 # [ 14.900315] systemd[1]: Starting OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK)... worker1 # [ 16.457727] systemd-logind[539]: New seat seat0. client # [ 16.454049] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 16.455307] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 14.908501] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 16.468426] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 14.918924] systemd[1]: Starting D-Bus System Message Bus... client # [ 16.469421] systemd[1]: Stopping User and Group Name Lookups... client # [ 16.470397] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 16.476309] systemd[1]: Started User Login Management. worker1 # [ 16.483882] systemd[1]: Starting linger-users.service... client # [ 16.485504] systemd[1]: nscd.service: Deactivated successfully. client # [ 16.486676] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 16.508124] nix-grpc-daemon[485]: ts=2026-11-12T09:18:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" worker2 # [ 14.960954] systemd-ssh-issue[493]: Options --make-vsock/--rm-vsock have been replaced by make-vsock/rm-vsock verbs. client # [ 16.516799] systemd[1]: linger-users.service: Deactivated successfully. client # [ 16.522749] systemd[1]: Finished linger-users.service. worker2 # [ 14.973866] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK). worker2 # [ 14.978687] systemd[1]: Reached target Socket Units. client # [ 16.537843] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 14.997543] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 16.557178] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 15.021219] dbus-broker-launch[494]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 16.576963] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 15.026086] dbus-broker-launch[494]: NSS returned no entry for 'systemd-timesync' worker1 # [ 16.581613] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 15.029292] dbus-broker-launch[494]: Invalid user-name in /nix/store/bk75lrzcnz2ykkrrdql36grdpvn3c8xf-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 16.590552] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 15.042732] systemd[1]: Started D-Bus System Message Bus. lb # [ 18.018159] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 16.601247] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 17.903923] postgresql-pre-start[678]: selecting default "shared_buffers" ... 128MB worker2 # [ 15.051504] systemd[1]: Reached target Basic System. worker1 # [ 16.605850] systemd[1]: nscd.service: Deactivated successfully. lb # [ 18.030093] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 18.030650] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 15.062070] systemd[1]: Started backdoor.service. worker1 # [ 16.617107] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 18.040918] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 18.041279] cfg80211: failed to load regulatory.db worker1 # [ 16.624703] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 16.627853] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 16.631333] systemd[1]: Finished linger-users.service. worker2 # [ 15.080651] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 16.645393] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 15.096513] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 15.107254] systemd[1]: Starting Post-Boot Actions... client # [ 16.661066] nsncd[494]: Nov 12 09:18:40.436 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 16.663401] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 15.114474] systemd[1]: Started Reset console on configuration changes. client # [ 16.676182] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 15.134593] systemd[1]: Starting resolvconf update... worker2 # [ 15.140077] systemd[1]: Starting SSH Host Keys Generation... worker1 # [ 16.703208] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 16.705835] nsncd[614]: Nov 12 09:18:40.496 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 16.703659] systemd[1]: Finished resolvconf update. worker1 # [ 16.716832] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 16.724747] systemd[1]: Reached target User and Group Name Lookups. client # [ 16.726039] systemd[1]: Starting DHCP Client... worker2 # [ 15.193228] dbus-broker-launch[494]: Ready worker1 # [ 16.753986] systemd[1]: Finished resolvconf update. worker1 # [ 16.758898] systemd[1]: Reached target Preparation for Network. worker1 # [ 16.768274] systemd[1]: Starting DHCP Client... worker1 # [ 16.776201] systemd[1]: Starting Extra networking commands.... client # [ 16.796454] systemd[1]: Finished nftables firewall. client # [ 16.797434] systemd[1]: Reached target Preparation for Network. client # [ 16.810125] systemd[1]: Starting Extra networking commands.... worker2 # [ 15.270925] systemd[1]: Finished Post-Boot Actions. worker2 # [ 15.344717] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 15.351706] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 16.908494] nix-grpc-daemon[485]: ts=2026-11-12T09:18:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" worker2 # connecting to host... worker2 # [ 15.366487] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 15.367591] systemd[1]: Starting User Login Management... client # [ 16.933456] sshd-keygen-start[438]: Generating public/private rsa key pair. client # [ 16.934652] sshd-keygen-start[438]: Your identification has been saved in /etc/ssh/ssh_host_rsa_key client # [ 16.935901] sshd-keygen-start[438]: Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub worker2 # [ 15.392934] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 15.405846] nsncd[499]: Nov 12 09:18:40.619 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 16.959565] sshd-keygen-start[438]: The key fingerprint is: client # [ 16.962889] sshd-keygen-start[438]: SHA256:GLc8PG+Dq68kX5MnJzLN0B70NNXSUtwJHD9nQe+Wl9s root@client client # [ 16.972698] sshd-keygen-start[438]: The key's randomart image is: client # [ 16.973658] sshd-keygen-start[438]: +---[RSA 4096]----+ lb # [ 18.277580] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 16.974451] sshd-keygen-start[438]: | oB=+.| client # [ 16.975222] sshd-keygen-start[438]: | .o.=.+| client # [ 16.975981] sshd-keygen-start[438]: | . o o o o+| lb # [ 18.298259] systemd-logind[499]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 18.299533] systemd[1]: Starting Address configuration of eth1... client # [ 16.996310] sshd-keygen-start[438]: | O + . o=| client # [ 16.997146] sshd-keygen-start[438]: | o S . o+| client # [ 16.997901] sshd-keygen-start[438]: | = B .+| client # [ 16.998674] sshd-keygen-start[438]: | . + @ * .E| client # [ 16.999479] sshd-keygen-start[438]: | + + O . | client # [ 17.017642] sshd-keygen-start[438]: | ++o | client # [ 17.018572] sshd-keygen-start[438]: +----[SHA256]-----+ lb # [ 18.451175] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 18.338556] dhcpcd[646]: eth0: waiting for carrier lb # [ 18.339825] dhcpcd[646]: eth0: carrier acquired lb # [ 18.367194] dhcpcd[646]: DUID 00:01:00:01:32:88:40:f0:52:54:00:12:34:56 lb # [ 18.372615] dhcpcd[646]: eth0: IAID 00:12:34:56 lb # [ 18.373769] systemd-vconsole-setup[680]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 17.070942] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 18.375392] dhcpcd[646]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 18.390777] systemd[1]: Finished Virtual Console Setup. client # [ 17.091612] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. client # [ 17.097786] sshd-keygen-start[558]: Generating public/private ed25519 key pair. client # [ 17.098904] sshd-keygen-start[558]: Your identification has been saved in /etc/ssh/ssh_host_ed25519_key client # [ 17.109610] sshd-keygen-start[558]: Your public key has been saved in /etc/ssh/ssh_host_ed25519_key.pub client # [ 17.110971] sshd-keygen-start[558]: The key fingerprint is: client # [ 17.111767] sshd-keygen-start[558]: SHA256:6xsgacAlqUuTowvVQXW9KDpJ33qeFAQG3Lo0PJ1+zSU root@client worker1 # [ 17.128324] dhcpcd[659]: dhcpcd-10.3.2 starting worker1 # [ 17.134529] dhcpcd[700]: dev: loaded udev client # [ 17.132338] sshd-keygen-start[558]: The key's randomart image is: client # [ 17.133279] sshd-keygen-start[558]: +--[ED25519 256]--+ client # [ 17.134031] sshd-keygen-start[558]: | .++++ .. | client # [ 17.134948] sshd-keygen-start[558]: | ..oo..o . | client # [ 17.135712] sshd-keygen-start[558]: | .+o + ... . | worker1 # [ 17.145502] dhcpcd[700]: no valid interfaces found worker1 # [ 17.148742] dhcpcd[700]: no valid interfaces found worker2 # [ 15.595718] systemd-logind[515]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 15.602131] systemd-logind[515]: New seat seat0. client # [ 17.156801] sshd-keygen-start[558]: |.=..O.+.. E . | client # [ 17.157643] sshd-keygen-start[558]: |oooo+O.oSo o | client # [ 17.158427] sshd-keygen-start[558]: |+ .=.o.ooo | client # [ 17.159189] sshd-keygen-start[558]: |.. . o+ | client # [ 17.159944] sshd-keygen-start[558]: |. .o.o | worker2 # [ 15.612137] systemd[1]: Started User Login Management. worker2 # [ 15.628342] systemd[1]: Starting linger-users.service... worker1 # [ 17.183554] systemd[1]: Finished Extra networking commands.. client # [ 17.185909] sshd-keygen-start[558]: | o=. | client # [ 17.186871] sshd-keygen-start[558]: +----[SHA256]-----+ worker1 # [ 17.192664] systemd[1]: Reached target Network. worker1 # [ 17.196209] systemd[1]: Starting Permit User Sessions... lb # [ 18.620824] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 15.647114] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 17.200545] dhcpcd[539]: dhcpcd-10.3.2 starting client # [ 17.207003] systemd[1]: Started backdoor.service. worker2 # [ 15.659781] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 15.668602] systemd[1]: Stopped target User and Group Name Lookups. client # [ 17.218858] dhcpcd[570]: dev: loaded udev worker2 # [ 15.669765] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 15.670637] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 15.671578] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 17.232921] nix-grpc-daemon[485]: ts=2026-11-12T09:18:41Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Could not connect to server" worker2 # [ 15.684592] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 15.685579] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 18.540488] network-addresses-eth1-start[707]: adding address 192.168.1.2/24... done worker1 # [ 17.255485] systemd[1]: Finished Permit User Sessions. worker1 # [ 17.260405] systemd[1]: Started Getty on tty1. worker1 # [ 17.268247] systemd[1]: Reached target Login Prompts. client # [ 17.389575] 8021q: 802.1Q VLAN Support v1.8 lb # [ 18.570803] network-addresses-eth1-start[707]: adding address 2001:db8:1::2/64... done client # [ 17.273042] sshd-keygen-start[587]: Generating public/private mldsa44-ed25519 key pair. client # [ 17.274416] sshd-keygen-start[587]: Your identification has been saved in /etc/ssh/ssh_host_mldsa44_ed25519_key client # [ 17.275786] sshd-keygen-start[587]: Your public key has been saved in /etc/ssh/ssh_host_mldsa44_ed25519_key.pub client # [ 17.293886] sshd-keygen-start[587]: The key fingerprint is: client # [ 17.294785] sshd-keygen-start[587]: SHA256:Qhod9EHJPocAVlKuGzl0HeTs7OOlD+gU3g3NG3ICJF0 root@client worker2 # [ 15.749228] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 15.750339] systemd[1]: Finished linger-users.service. client # [ 17.296002] sshd-keygen-start[587]: The key's randomart image is: client # [ 17.307722] sshd-keygen-start[587]: +[MLDSA44-ED25519-+ client # [ 17.312419] sshd-keygen-start[587]: | =**=E. | client # [ 17.313227] sshd-keygen-start[587]: | . *o*oo | client # [ 17.313987] sshd-keygen-start[587]: | o *o=. | lb # [ 18.618315] systemd[1]: Finished Address configuration of eth1. client # [ 17.314892] sshd-keygen-start[587]: | . B ++o. | client # [ 17.315664] sshd-keygen-start[587]: | * o So= | client # connecting to host... client # [ 17.339163] sshd-keygen-start[587]: | = * * o | lb # [ 18.764507] mousedev: PS/2 mouse device common for all mice client # [ 17.343843] sshd-keygen-start[587]: | . + = + | worker2 # [ 15.801611] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 17.352296] sshd-keygen-start[587]: | o . = | client # [ 17.353100] sshd-keygen-start[587]: | . o.. | client # [ 17.353819] sshd-keygen-start[587]: +----[SHA256]-----+ worker2 # [ 15.803037] nsncd[576]: Nov 12 09:18:41.073 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 17.354790] systemd[1]: sshd-keygen.service: Deactivated successfully. client # [ 17.355753] systemd[1]: Finished SSH Host Keys Generation. worker2 # [ 15.820541] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 15.821570] systemd[1]: Reached target User and Group Name Lookups. client # [ 17.393233] systemd-vconsole-setup[429]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 17.395938] systemd[1]: Finished Virtual Console Setup. worker2 # [ 15.860543] systemd[1]: Finished resolvconf update. worker2 # [ 15.861434] systemd[1]: Reached target Preparation for Network. worker2 # [ 15.866085] systemd[1]: Starting DHCP Client... client # [ 17.441863] (udev-worker)[518]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 15.900120] systemd[1]: Starting Address configuration of eth1... [63.16s] client: Guest shell says: b'Spawning backdoor root shell...\n' worker2 # [ 15.912780] systemd[1]: Starting Extra networking commands.... client # [ 17.481017] (udev-worker)[518]: Network interface NamePolicy= disabled on kernel command line. client # [ 17.484997] (udev-worker)[528]: Network interface NamePolicy= disabled on kernel command line. client # [ 17.627142] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 17.633732] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 17.635939] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 17.640152] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 [63.23s] client: connected to guest root shell client # [ 17.640497] cfg80211: failed to load regulatory.db [63.23s] client: (connecting took 16.39 seconds) client # [ 17.521206] dhcpcd[570]: no valid interfaces found [63.23s] client: (finished: waiting for the VM to finish booting, in 16.39 seconds) client # [ 17.523362] dhcpcd[570]: no valid interfaces found client # [ 17.534521] systemd[1]: Finished Extra networking commands.. client # [ 17.538540] systemd[1]: Reached target Network. client # [ 17.545266] systemd[1]: Starting SSH Daemon... worker2 # [ 16.121195] mousedev: PS/2 mouse device common for all mice client # [ 17.577042] systemd[1]: Starting Permit User Sessions... worker2 # [ 16.104875] network-addresses-eth1-start[612]: adding address 192.168.1.4/24... done client # [ 17.678548] systemd[1]: Finished Permit User Sessions. worker2 # [ 16.135960] network-addresses-eth1-start[612]: adding address 2001:db8:1::4/64... done client # [ 17.693232] sshd[615]: Server listening on 0.0.0.0 port 22. client # [ 17.694193] sshd[615]: Server listening on :: port 22. worker1 # [ 17.698872] systemd[1]: Starting Virtual Console Setup... client # [ 17.700641] systemd[1]: Started Getty on tty1. client # [ 17.704130] systemd[1]: Reached target Login Prompts. client # [ 17.710958] systemd[1]: Started SSH Daemon. worker1 # [ 17.708926] nix-grpc-daemon[485]: ts=2026-11-12T09:18:41Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" worker1 # [ 17.738285] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 17.743822] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 16.191469] systemd[1]: Finished Address configuration of eth1. worker1 # [ 17.748367] systemd[1]: Starting Virtual Console Setup... worker1 # [ 17.806308] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 17.844609] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 16.297645] dhcpcd[623]: dhcpcd-10.3.2 starting client # [ 17.850559] systemd[1]: Starting Address configuration of eth1... worker2 # [ 16.311774] dhcpcd[662]: dev: loaded udev lb # [ 19.182852] systemd-logind[499]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 16.488033] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 16.488431] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 18.099498] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 17.985838] dhcpcd[570]: eth0: waiting for carrier client # [ 18.111061] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 17.988864] dhcpcd[570]: eth0: carrier acquired client # [ 18.004348] dhcpcd[570]: DUID 00:01:00:01:32:88:40:f1:52:54:00:12:34:56 client # [ 18.005419] dhcpcd[570]: eth0: IAID 00:12:34:56 client # [ 18.006077] dhcpcd[570]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 18.011177] systemd-logind[427]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 16.461995] systemd-logind[515]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 18.017849] network-addresses-eth1-start[631]: adding address 192.168.1.1/24... done worker1 # [ 18.035795] systemd-vconsole-setup[715]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 16.616104] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 18.038500] network-addresses-eth1-start[631]: adding address 2001:db8:1::1/64... done worker1 # [ 18.046654] systemd[1]: Finished Virtual Console Setup. worker2 # [ 16.620241] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 16.620740] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 16.626999] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 16.627389] cfg80211: failed to load regulatory.db client # [ 18.062680] systemd[1]: Finished Address configuration of eth1. worker2 # [ 16.517097] systemd[1]: Finished Extra networking commands.. worker2 # [ 16.518050] systemd[1]: Reached target Network. worker2 # [ 16.518713] systemd[1]: Starting Permit User Sessions... client # [ 18.257325] mousedev: PS/2 mouse device common for all mice worker2 # [ 16.611071] systemd[1]: Finished Permit User Sessions. worker2 # [ 16.614460] systemd[1]: Started Getty on tty1. worker2 # [ 16.615253] systemd[1]: Reached target Login Prompts. worker1 # [ 18.202145] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 16.780476] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 16.658583] dhcpcd[662]: eth0: waiting for carrier worker2 # [ 16.659435] dhcpcd[662]: eth0: carrier acquired client # [ 18.218507] systemd-logind[427]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 16.674836] dhcpcd[662]: DUID 00:01:00:01:32:88:40:f1:52:54:00:12:34:56 worker2 # [ 16.675951] dhcpcd[662]: eth0: IAID 00:12:34:56 worker1 # [ 18.233331] nix-grpc-daemon[485]: ts=2026-11-12T09:18:42Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Could not connect to server" worker2 # [ 16.681351] dhcpcd[662]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 18.274329] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 18.284525] systemd[1]: Started backdoor.service. lb # [ 19.664739] dhcpcd[646]: eth0: soliciting a DHCP lease lb # [ 19.673330] dhcpcd[646]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 19.681022] dhcpcd[646]: eth0: probing address 10.0.2.15/24 worker1 # connecting to host... worker1 # [ 18.461268] (udev-worker)[650]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 18.468549] (udev-worker)[633]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 18.611911] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 18.496237] (udev-worker)[633]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 17.001714] sshd-keygen-start[537]: Generating public/private rsa key pair. worker2 # [ 17.002856] sshd-keygen-start[537]: Your identification has been saved in /etc/ssh/ssh_host_rsa_key worker2 # [ 17.009296] sshd-keygen-start[537]: Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub worker2 # [ 17.010623] sshd-keygen-start[537]: The key fingerprint is: worker2 # [ 17.011404] sshd-keygen-start[537]: SHA256:vfgqhlXnZ53dW0XYLae/GRIOU1FLvbbbEEf3h6CjXpM root@worker2 worker2 # [ 17.019967] sshd-keygen-start[537]: The key's randomart image is: worker2 # [ 17.021148] sshd-keygen-start[537]: +---[RSA 4096]----+ worker2 # [ 17.021891] sshd-keygen-start[537]: | .o=o| worker2 # [ 17.022624] sshd-keygen-start[537]: | ..+ X| worker2 # [ 17.023358] sshd-keygen-start[537]: | ... O+| worker2 # [ 17.033210] sshd-keygen-start[537]: | ..+o .+o=| worker2 # [ 17.034046] sshd-keygen-start[537]: | .S+.o+.o*=| worker2 # [ 17.034783] sshd-keygen-start[537]: | . ..E.oo+o=| worker2 # [ 17.035514] sshd-keygen-start[537]: | o ....+ ..O| worker2 # [ 17.043199] sshd-keygen-start[537]: | . o .. =.| worker2 # [ 17.045012] sshd-keygen-start[537]: | . .... | worker2 # [ 17.045851] sshd-keygen-start[537]: +----[SHA256]-----+ worker2 # [ 17.072931] sshd-keygen-start[700]: Generating public/private ed25519 key pair. worker2 # [ 17.074126] sshd-keygen-start[700]: Your identification has been saved in /etc/ssh/ssh_host_ed25519_key worker2 # [ 17.075407] sshd-keygen-start[700]: Your public key has been saved in /etc/ssh/ssh_host_ed25519_key.pub worker1 # [ 18.758950] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 18.760316] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 17.085036] sshd-keygen-start[700]: The key fingerprint is: worker2 # [ 17.085913] sshd-keygen-start[700]: SHA256:Wa38fqJg8DH2ZWm7fIXrB44llFUuhnBympiPOek7Vu4 root@worker2 worker2 # [ 17.087148] sshd-keygen-start[700]: The key's randomart image is: worker1 # [ 18.764171] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 17.087983] sshd-keygen-start[700]: +--[ED25519 256]--+ worker1 # [ 18.767263] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 18.767603] cfg80211: failed to load regulatory.db worker2 # [ 17.096565] sshd-keygen-start[700]: | o o ..| worker2 # [ 17.097393] sshd-keygen-start[700]: | o O ... | worker2 # [ 17.098132] sshd-keygen-start[700]: | o + ooo .| worker2 # [ 17.098864] sshd-keygen-start[700]: | O .oo . | worker2 # [ 17.099601] sshd-keygen-start[700]: | . S +.= . | worker2 # [ 17.108799] sshd-keygen-start[700]: | = =.=..+ .| worker2 # [ 17.109661] sshd-keygen-start[700]: | =o. o= + | worker2 # [ 17.110399] sshd-keygen-start[700]: | .oo.oo.= .| worker2 # [ 17.111137] sshd-keygen-start[700]: | ..oE.+=.. | worker2 # [ 17.111875] sshd-keygen-start[700]: +----[SHA256]-----+ worker2 # [ 17.140208] sshd-keygen-start[706]: Generating public/private mldsa44-ed25519 key pair. worker2 # [ 17.141572] sshd-keygen-start[706]: Your identification has been saved in /etc/ssh/ssh_host_mldsa44_ed25519_key worker2 # [ 17.142926] sshd-keygen-start[706]: Your public key has been saved in /etc/ssh/ssh_host_mldsa44_ed25519_key.pub worker2 # [ 17.160470] sshd-keygen-start[706]: The key fingerprint is: worker2 # [ 17.161359] sshd-keygen-start[706]: SHA256:zJQrz52h3PWqQgxZ8hDfS1ikAOQZMAdmpHxqD9Cnink root@worker2 worker2 # [ 17.162588] sshd-keygen-start[706]: The key's randomart image is: worker2 # [ 17.163478] sshd-keygen-start[706]: +[MLDSA44-ED25519-+ worker2 # [ 17.169122] sshd-keygen-start[706]: | .B+=.o. .o | worker2 # [ 17.169988] sshd-keygen-start[706]: |.= + ooo.* | worker2 # [ 17.170737] sshd-keygen-start[706]: |o...+ ** o | worker2 # [ 17.171605] sshd-keygen-start[706]: |. oo o+.o . | worker2 # [ 17.176756] sshd-keygen-start[706]: | +. .oS o . | worker2 # [ 17.177562] sshd-keygen-start[706]: |ooo =o+ + . | worker2 # [ 17.178297] sshd-keygen-start[706]: |+ E. .= + . | worker2 # [ 17.179044] sshd-keygen-start[706]: | . . . | worker2 # [ 17.179781] sshd-keygen-start[706]: | .... | worker2 # [ 17.188555] sshd-keygen-start[706]: +----[SHA256]-----+ worker2 # [ 17.193225] systemd[1]: sshd-keygen.service: Deactivated successfully. worker2 # [ 17.197584] systemd[1]: Finished SSH Host Keys Generation. worker2 # [ 17.198522] systemd[1]: Starting SSH Daemon... worker2 # [ 17.227945] dhcpcd[662]: eth0: soliciting a DHCP lease worker2 # [ 17.234754] dhcpcd[662]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 17.241411] dhcpcd[662]: eth0: probing address 10.0.2.15/24 worker2 # [ 17.245858] sshd[708]: Server listening on 0.0.0.0 port 22. worker2 # [ 17.246799] systemd[1]: Started SSH Daemon. worker2 # [ 17.247446] sshd[708]: Server listening on :: port 22. [64.55s] client: (finished: waiting for unit network-addresses-eth1.service, in 17.70 seconds) [64.55s] client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } worker1 # [ 18.882399] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 18.892292] systemd[1]: Starting Address configuration of eth1... [64.60s] client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds) [64.60s] lb: waiting for unit network-addresses-eth1.service [64.60s] lb: waiting for the VM to finish booting [64.60s] lb: Guest shell says: b'Spawning backdoor root shell...\n' [64.60s] lb: connected to guest root shell [64.60s] lb: (connecting took 0.00 seconds) [64.60s] lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 19.137883] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 19.016996] dhcpcd[700]: eth0: waiting for carrier worker1 # [ 19.017816] dhcpcd[700]: eth0: carrier acquired worker1 # [ 19.161696] 8021q: adding VLAN 0 to HW filter on device eth1 [64.74s] lb: (finished: waiting for unit network-addresses-eth1.service, in 0.15 seconds) [64.74s] lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } worker1 # [ 19.049351] dhcpcd[700]: DUID 00:01:00:01:32:88:40:f2:52:54:00:12:34:56 worker1 # [ 19.050473] dhcpcd[700]: eth0: IAID 00:12:34:56 worker1 # [ 19.051150] dhcpcd[700]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 19.068306] network-addresses-eth1-start[733]: adding address 192.168.1.3/24... done worker1 # [ 19.088298] network-addresses-eth1-start[733]: adding address 2001:db8:1::3/64... done worker1 # [ 19.111859] systemd[1]: Finished Address configuration of eth1. worker1 # [ 19.116537] systemd-logind[539]: Watching system buttons on /dev/input/event0 (gpio-keys) [64.82s] lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.08 seconds) [64.82s] worker1: waiting for unit network-addresses-eth1.service [64.82s] worker1: waiting for the VM to finish booting [64.82s] worker1: Guest shell says: b'Spawning backdoor root shell...\n' [64.82s] worker1: connected to guest root shell [64.82s] worker1: (connecting took 0.00 seconds) [64.82s] worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) [64.93s] worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.11 seconds) [64.93s] worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } lb # [ 20.564785] dhcpcd[646]: eth0: soliciting an IPv6 router lb # [ 20.565946] dhcpcd[646]: eth0: Router Advertisement from fe80::2 lb # [ 20.566067] dhcpcd[646]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 20.566120] dhcpcd[646]: eth0: adding route to fec0::/64 lb # [ 20.566162] dhcpcd[646]: eth0: adding default route via fe80::2 worker2 # [ 17.867457] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 worker1 # [ 19.309749] nix-grpc-daemon[485]: ts=2026-11-12T09:18:43Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" [65.01s] worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.08 seconds) [65.01s] worker2: waiting for unit network-addresses-eth1.service [65.01s] worker2: waiting for the VM to finish booting [65.01s] worker2: Guest shell says: b'Spawning backdoor root shell...\n' [65.01s] worker2: connected to guest root shell [65.01s] worker2: (connecting took 0.00 seconds) [65.01s] worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 19.381893] dhcpcd[700]: eth0: soliciting a DHCP lease worker1 # [ 19.390617] dhcpcd[700]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 19.397812] dhcpcd[700]: eth0: probing address 10.0.2.15/24 lb # [ 20.716435] sshd-keygen-start[522]: Generating public/private rsa key pair. lb # [ 20.717579] sshd-keygen-start[522]: Your identification has been saved in /etc/ssh/ssh_host_rsa_key lb # [ 20.718839] sshd-keygen-start[522]: Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub worker2 # [ 17.866779] dhcpcd[662]: eth0: soliciting an IPv6 router lb # [ 20.729220] sshd-keygen-start[522]: The key fingerprint is: lb # [ 20.730222] sshd-keygen-start[522]: SHA256:taH+UdCX1BKEVEd9EyNAcydAK43qWSw9xDOEYgmyeN0 root@lb lb # [ 20.731375] sshd-keygen-start[522]: The key's randomart image is: lb # [ 20.732384] sshd-keygen-start[522]: +---[RSA 4096]----+ lb # [ 20.733114] sshd-keygen-start[522]: | . .. . ..oB+B=B=| [65.13s] worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.11 seconds) [65.13s] worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } lb # [ 20.733832] sshd-keygen-start[522]: |. o. = .o o.=.=+=| lb # [ 20.734620] sshd-keygen-start[522]: |... o E B+o. o.o| lb # [ 20.735338] sshd-keygen-start[522]: | . =o++ . | lb # [ 20.738797] sshd-keygen-start[522]: | oS=. . | lb # [ 20.739603] sshd-keygen-start[522]: | ..+ .. | lb # [ 20.742553] sshd-keygen-start[522]: | o. . | lb # [ 20.743385] sshd-keygen-start[522]: | . . | lb # [ 20.747768] sshd-keygen-start[522]: | . | worker2 # [ 17.894293] dhcpcd[662]: eth0: Router Advertisement from fe80::2 worker2 # [ 17.895289] dhcpcd[662]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 20.750463] sshd-keygen-start[522]: +----[SHA256]-----+ worker2 # [ 17.900695] dhcpcd[662]: eth0: adding route to fec0::/64 worker2 # [ 17.901565] dhcpcd[662]: eth0: adding default route via fe80::2 [65.18s] worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds) [65.18s] lb: waiting for unit niks3.service lb # [ 20.807447] sshd-keygen-start[745]: Generating public/private ed25519 key pair. lb # [ 20.810405] sshd-keygen-start[745]: Your identification has been saved in /etc/ssh/ssh_host_ed25519_key lb # [ 20.817575] sshd-keygen-start[745]: Your public key has been saved in /etc/ssh/ssh_host_ed25519_key.pub lb # [ 20.818944] sshd-keygen-start[745]: The key fingerprint is: lb # [ 20.819710] sshd-keygen-start[745]: SHA256:xinkwZF4NTPlmJrvYNBRctv88NtG4w2Tojb1SoFVAF0 root@lb worker1 # [ 19.644748] mousedev: PS/2 mouse device common for all mice lb # [ 20.831602] sshd-keygen-start[745]: The key's randomart image is: client # [ 19.530278] dhcpcd[570]: eth0: soliciting an IPv6 router client # [ 19.531796] dhcpcd[570]: eth0: Router Advertisement from fe80::2 lb # [ 20.836506] sshd-keygen-start[745]: +--[ED25519 256]--+ client # [ 19.532826] dhcpcd[570]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 20.837376] sshd-keygen-start[745]: | .ooB.oo.oE | client # [ 19.533773] dhcpcd[570]: eth0: adding route to fec0::/64 lb # [ 20.838137] sshd-keygen-start[745]: | ..o= @ .. | client # [ 19.534559] dhcpcd[570]: eth0: adding default route via fe80::2 lb # [ 20.838885] sshd-keygen-start[745]: | .= + = . | lb # [ 20.839609] sshd-keygen-start[745]: | + * . * . | lb # [ 20.851595] sshd-keygen-start[745]: | . * S . * * | lb # [ 20.855880] sshd-keygen-start[745]: | . + o O = | client # [ 19.551932] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 19.554773] systemd[1]: Stopped Virtual Console Setup. lb # [ 20.859196] sshd-keygen-start[745]: | o . + o = .| client # [ 19.555593] systemd[1]: Stopping Virtual Console Setup... lb # [ 20.865247] sshd-keygen-start[745]: | . o . o o | lb # [ 20.866118] sshd-keygen-start[745]: | . . | lb # [ 20.866845] sshd-keygen-start[745]: +----[SHA256]-----+ client # [ 19.564769] systemd[1]: Starting Virtual Console Setup... client # [ 19.592230] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 19.598297] systemd[1]: Stopped Virtual Console Setup. lb # [ 20.910882] sshd-keygen-start[755]: Generating public/private mldsa44-ed25519 key pair. client # [ 19.611625] systemd[1]: Starting Virtual Console Setup... lb # [ 20.916639] sshd-keygen-start[755]: Your identification has been saved in /etc/ssh/ssh_host_mldsa44_ed25519_key lb # [ 20.918125] sshd-keygen-start[755]: Your public key has been saved in /etc/ssh/ssh_host_mldsa44_ed25519_key.pub lb # [ 20.919453] sshd-keygen-start[755]: The key fingerprint is: client # [ 19.623409] systemd-logind[427]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 19.631287] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 20.930834] sshd-keygen-start[755]: SHA256:8IpuJLsuU9E83vG9LlAOZb8C3HGy3dwflvhCGjHaYH8 root@lb lb # [ 20.937516] sshd-keygen-start[755]: The key's randomart image is: lb # [ 20.938527] sshd-keygen-start[755]: +[MLDSA44-ED25519-+ lb # [ 20.939256] sshd-keygen-start[755]: | | lb # [ 20.939977] sshd-keygen-start[755]: | =o.o | client # [ 19.638675] dhcpcd[570]: eth0: soliciting a DHCP lease client # [ 19.644591] dhcpcd[570]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 20.955306] sshd-keygen-start[755]: | o ..+.B=oo.. .| client # [ 19.652522] dhcpcd[570]: eth0: probing address 10.0.2.15/24 lb # [ 20.957920] sshd-keygen-start[755]: | . + =o+.o+oE.+ | lb # [ 20.958744] sshd-keygen-start[755]: | o o BS. .= o..| lb # [ 20.959483] sshd-keygen-start[755]: | o o.o.+ o. . ..| lb # [ 20.969777] sshd-keygen-start[755]: | . +. .. . . . | lb # [ 20.976487] sshd-keygen-start[755]: |o ... . . | lb # [ 20.977329] sshd-keygen-start[755]: | +oo. o. | lb # [ 20.978208] sshd-keygen-start[755]: +----[SHA256]-----+ lb # [ 20.979449] systemd[1]: sshd-keygen.service: Deactivated successfully. lb # [ 20.997861] systemd[1]: Finished SSH Host Keys Generation. lb # [ 20.998768] systemd[1]: sshd-keygen.service: Consumed 2.223s CPU time over 6.455s wall clock time, 4.5M memory peak. lb # [ 21.005542] systemd[1]: Starting SSH Daemon... worker1 # [ 19.724514] sshd-keygen-start[576]: Generating public/private rsa key pair. worker1 # [ 19.725631] sshd-keygen-start[576]: Your identification has been saved in /etc/ssh/ssh_host_rsa_key worker1 # [ 19.726863] sshd-keygen-start[576]: Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub worker1 # [ 19.733920] sshd-keygen-start[576]: The key fingerprint is: worker1 # [ 19.734946] sshd-keygen-start[576]: SHA256:vsp6ItJBTs2is6RsiQOVZJupLTDjjYDF8gRIMPTqOHk root@worker1 worker1 # [ 19.740715] sshd-keygen-start[576]: The key's randomart image is: worker1 # [ 19.741631] sshd-keygen-start[576]: +---[RSA 4096]----+ worker1 # [ 19.742463] sshd-keygen-start[576]: |O= | worker1 # [ 19.743186] sshd-keygen-start[576]: |o.B | worker1 # [ 19.743902] sshd-keygen-start[576]: |.B O | worker1 # [ 19.754357] sshd-keygen-start[576]: |* % o | client # [ 19.749556] systemd-vconsole-setup[676]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 19.755281] sshd-keygen-start[576]: |+%o. S | client # [ 19.753575] systemd[1]: Finished Virtual Console Setup. worker1 # [ 19.759253] sshd-keygen-start[576]: |O=+. . | worker2 # [ 18.206191] systemd[1]: Starting Virtual Console Setup... worker1 # [ 19.762598] sshd-keygen-start[576]: |X*E. . | worker1 # [ 19.763388] sshd-keygen-start[576]: |**o ... . | worker1 # [ 19.767478] sshd-keygen-start[576]: |.o ..+o.. | worker1 # [ 19.770222] sshd-keygen-start[576]: +----[SHA256]-----+ lb # [ 21.071087] sshd[761]: Server listening on 0.0.0.0 port 22. worker1 # [ 19.771058] systemd-logind[539]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 21.074404] systemd[1]: Started SSH Daemon. lb # [ 21.075187] sshd[761]: Server listening on :: port 22. worker1 # [ 19.795203] sshd-keygen-start[775]: Generating public/private ed25519 key pair. worker2 # [ 18.244527] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 18.245715] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 19.799068] sshd-keygen-start[775]: Your identification has been saved in /etc/ssh/ssh_host_ed25519_key worker2 # [ 18.246470] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 19.803783] sshd-keygen-start[775]: Your public key has been saved in /etc/ssh/ssh_host_ed25519_key.pub worker1 # [ 19.808215] sshd-keygen-start[775]: The key fingerprint is: worker1 # [ 19.809066] sshd-keygen-start[775]: SHA256:gme85CY1ggJ4d0UYOFP9TUAgvcanPCIBq9pr4Sx6cwk root@worker1 worker1 # [ 19.810312] sshd-keygen-start[775]: The key's randomart image is: worker1 # [ 19.811139] sshd-keygen-start[775]: +--[ED25519 256]--+ worker1 # [ 19.811853] sshd-keygen-start[775]: | o+*+oo. | worker2 # [ 18.258699] systemd[1]: Starting Virtual Console Setup... worker1 # [ 19.822319] sshd-keygen-start[775]: |. . + .oo . | worker1 # [ 19.823153] sshd-keygen-start[775]: |o .o.o.. o o | worker1 # [ 19.823877] sshd-keygen-start[775]: |...o.+ + o . | worker1 # [ 19.830339] sshd-keygen-start[775]: |... o.OoSo | worker1 # [ 19.831132] sshd-keygen-start[775]: |..E .B.++ | worker1 # [ 19.831855] sshd-keygen-start[775]: |.+ o.o+. . | worker1 # [ 19.837518] sshd-keygen-start[775]: |o B oo | worker1 # [ 19.838451] sshd-keygen-start[775]: |o+.+ | worker1 # [ 19.839179] sshd-keygen-start[775]: +----[SHA256]-----+ worker1 # [ 19.871868] sshd-keygen-start[781]: Generating public/private mldsa44-ed25519 key pair. worker2 # [ 18.320649] systemd-logind[515]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 19.876170] sshd-keygen-start[781]: Your identification has been saved in /etc/ssh/ssh_host_mldsa44_ed25519_key worker1 # [ 19.877614] sshd-keygen-start[781]: Your public key has been saved in /etc/ssh/ssh_host_mldsa44_ed25519_key.pub worker1 # [ 19.879090] sshd-keygen-start[781]: The key fingerprint is: worker1 # [ 19.879883] sshd-keygen-start[781]: SHA256:FoxFPk5ImsP6cNlSnNvpNjMn78pZLyr8SebIVlYhhW4 root@worker1 worker1 # [ 19.897863] sshd-keygen-start[781]: The key's randomart image is: worker1 # [ 19.898892] sshd-keygen-start[781]: +[MLDSA44-ED25519-+ worker1 # [ 19.899621] sshd-keygen-start[781]: | ..oo. | worker1 # [ 19.903626] sshd-keygen-start[781]: | . = Bo . | worker1 # [ 19.905369] sshd-keygen-start[781]: | = *.*. . | worker1 # [ 19.906131] sshd-keygen-start[781]: | . = =E+. | worker1 # [ 19.906959] sshd-keygen-start[781]: | o + o.S. | worker1 # [ 19.907680] sshd-keygen-start[781]: | + . oo | worker1 # [ 19.914001] sshd-keygen-start[781]: | .. oX o | worker1 # [ 19.914857] sshd-keygen-start[781]: | .+B @.. | worker1 # [ 19.915630] sshd-keygen-start[781]: | .ooO+o.. | worker1 # [ 19.923941] sshd-keygen-start[781]: +----[SHA256]-----+ worker1 # [ 19.926148] systemd[1]: sshd-keygen.service: Deactivated successfully. worker1 # [ 19.931267] systemd[1]: Finished SSH Host Keys Generation. worker1 # [ 19.933387] systemd[1]: sshd-keygen.service: Consumed 1.261s CPU time over 4.093s wall clock time, 2.6M memory peak. worker1 # [ 19.935028] systemd[1]: Starting SSH Daemon... worker2 # [ 18.398652] systemd-vconsole-setup[724]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 18.404515] systemd[1]: Finished Virtual Console Setup. worker1 # [ 19.970785] sshd[783]: Server listening on 0.0.0.0 port 22. worker1 # [ 19.971733] systemd[1]: Started SSH Daemon. worker1 # [ 19.975316] sshd[783]: Server listening on :: port 22. lb # [ 21.503846] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 21.508366] systemd[1]: Stopped Virtual Console Setup. lb # [ 21.509210] systemd[1]: Stopping Virtual Console Setup... lb # [ 21.515745] systemd[1]: Starting Virtual Console Setup... lb # [ 21.542103] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 21.548638] systemd[1]: Stopped Virtual Console Setup. lb # [ 21.556912] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 21.569304] systemd[1]: Starting Virtual Console Setup... lb # [ 21.627429] systemd-logind[499]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 21.807147] systemd-vconsole-setup[769]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 21.816179] systemd[1]: Finished Virtual Console Setup. worker1 # [ 20.539751] dhcpcd[700]: eth0: soliciting an IPv6 router worker1 # [ 20.541561] dhcpcd[700]: eth0: Router Advertisement from fe80::2 worker1 # [ 20.544119] dhcpcd[700]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 20.546959] dhcpcd[700]: eth0: adding route to fec0::/64 worker1 # [ 20.547811] dhcpcd[700]: eth0: adding default route via fe80::2 lb # [ 22.154165] postgresql-pre-start[678]: selecting default time zone ... UTC lb # [ 22.160831] postgresql-pre-start[678]: creating configuration files ... ok worker1 # [ 21.139660] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 21.142860] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 21.143687] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 21.155522] systemd[1]: Starting Virtual Console Setup... lb # [ 22.458010] postgresql-pre-start[678]: running bootstrap script ... ok worker1 # [ 21.181174] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 21.184432] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 21.189949] systemd[1]: Starting Virtual Console Setup... worker1 # [ 21.200335] systemd-logind[539]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 21.239829] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 21.329589] systemd-vconsole-setup[790]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 21.332516] systemd[1]: Finished Virtual Console Setup. lb # [ 23.264689] postgresql-pre-start[678]: performing post-bootstrap initialization ... ok lb # [ 23.441035] postgresql-pre-start[678]: syncing data to disk ... ok lb # [ 23.442207] postgresql-pre-start[678]: initdb: warning: enabling "trust" authentication for local connections lb # [ 23.444925] postgresql-pre-start[678]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 23.447386] postgresql-pre-start[678]: Success. You can now start the database server using: lb # [ 23.448645] postgresql-pre-start[678]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 23.545262] postgres[802]: [802] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 23.551829] postgres[802]: [802] LOG: listening on IPv6 address "::1", port 5432 lb # [ 23.553357] postgres[802]: [802] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 23.555146] postgres[802]: [802] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 23.570819] postgres[811]: [811] LOG: database system was shut down at 2026-11-12 09:18:45 GMT lb # [ 23.576151] postgres[802]: [802] LOG: database system is ready to accept connections lb # [ 23.584235] systemd[1]: Started PostgreSQL Server. lb # [ 23.594649] systemd[1]: Starting PostgreSQL Setup Scripts... worker1 # [ 22.511168] nix-grpc-daemon[485]: ts=2026-11-12T09:18:46Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 23.839870] postgresql-setup-start[822]: CREATE DATABASE lb # [ 23.886244] postgresql-setup-start[827]: CREATE ROLE lb # [ 23.911766] postgresql-setup-start[829]: ALTER DATABASE lb # [ 23.916378] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 23.918607] systemd[1]: Reached target PostgreSQL. lb # [ 24.567365] dhcpcd[646]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 24.567558] dhcpcd[646]: eth0: adding route to 10.0.2.0/24 lb # [ 24.567627] dhcpcd[646]: eth0: adding default route via 10.0.2.2 lb # [ 24.704950] systemd[1]: Started DHCP Client. lb # [ 24.707468] systemd[1]: Reached target Network is Online. lb # [ 24.712492] systemd[1]: Started Envoy reverse proxy. lb # [ 24.724765] systemd[1]: Started Garage Object Storage (S3 compatible). lb # [ 24.732130] systemd[1]: Starting garage-setup.service... lb # [ 24.740267] systemd[1]: Started mock-oidc.service. lb # [ 25.012443] garage[898]: 2026-11-12T09:18:46.771717Z INFO garage::server: Loading configuration... lb # [ 25.035155] garage[898]: 2026-11-12T09:18:46.794433Z INFO garage::server: Initializing Garage main data store... lb # [ 25.042343] garage[898]: 2026-11-12T09:18:46.802087Z INFO garage_model::garage: Opening database... lb # [ 25.049064] garage[898]: 2026-11-12T09:18:46.808163Z INFO garage_db::lmdb_adapter: Opening LMDB database at: /var/lib/garage/meta/db.lmdb lb # [ 25.054827] garage[898]: 2026-11-12T09:18:46.813646Z INFO garage_model::garage: Initializing RPC... lb # [ 25.061744] garage[898]: 2026-11-12T09:18:46.813699Z WARN garage_rpc::replication_mode: Legacy config option replication_mode in use. Please migrate to replication_factor and consistency_mode lb # [ 25.066090] garage[898]: 2026-11-12T09:18:46.817823Z INFO garage_model::garage: Initialize background variable system... lb # [ 25.069384] garage[898]: 2026-11-12T09:18:46.817849Z INFO garage_model::garage: Initialize membership management system... lb # [ 25.072299] garage[898]: 2026-11-12T09:18:46.817932Z INFO garage_rpc::system: Generating new node key pair. lb # [ 25.076110] garage[898]: 2026-11-12T09:18:46.818184Z INFO garage_rpc::system: Node ID of this node: 1663f402f1dfffc9 lb # [ 25.078004] garage[898]: 2026-11-12T09:18:46.818412Z WARN garage_rpc::system: Using autodetected rpc_public_addr: 10.0.2.15:3901. Consider specifying it explicitly in configuration file if possible. lb # [ 25.083620] garage[898]: 2026-11-12T09:18:46.821292Z INFO garage_rpc::layout::manager: No valid previous cluster layout stored (IO error: No such file or directory (os error 2)), starting fresh. lb # [ 25.087180] garage-setup-start[912]: Error: Unable to read node key. It will be generated by your garage node the first time is it launched. Ensure that your garage node is currently running. (The node key is supposed to be stored in your metadata directory.) lb # [ 25.094548] garage-setup-start[912]: IO error: No such file or directory (os error 2) lb # [ 25.098481] mock-oidc-server[900]: Mock OIDC Server running lb # [ 25.099271] mock-oidc-server[900]: OIDC Address: 192.168.1.2:8080 lb # [ 25.100116] mock-oidc-server[900]: Issue Address: 0.0.0.0:8081 lb # [ 25.100877] mock-oidc-server[900]: Issuer: http://192.168.1.2:8080/oidc lb # [ 25.101727] mock-oidc-server[900]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 25.102936] mock-oidc-server[900]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 25.104214] mock-oidc-server[900]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 25.105260] garage[898]: 2026-11-12T09:18:46.834399Z INFO garage_rpc::layout::helper: ack_until updated to 0 lb # [ 25.106985] garage[898]: 2026-11-12T09:18:46.834504Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.109009] garage[898]: 2026-11-12T09:18:46.834511Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.111766] garage[898]: 2026-11-12T09:18:46.834515Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.115086] garage[898]: 2026-11-12T09:18:46.834520Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.117384] garage[898]: 2026-11-12T09:18:46.834523Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.120601] garage[898]: 2026-11-12T09:18:46.834526Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.124282] garage[898]: 2026-11-12T09:18:46.834530Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.126424] garage[898]: 2026-11-12T09:18:46.834533Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.130489] garage[898]: 2026-11-12T09:18:46.834540Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.132884] garage[898]: 2026-11-12T09:18:46.834546Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.135178] garage[898]: 2026-11-12T09:18:46.834550Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.137911] garage[898]: 2026-11-12T09:18:46.834553Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.140109] garage[898]: 2026-11-12T09:18:46.834557Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.145055] garage[898]: 2026-11-12T09:18:46.834560Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.149052] garage[898]: 2026-11-12T09:18:46.834563Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.151026] garage[898]: 2026-11-12T09:18:46.834567Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.154917] garage[898]: 2026-11-12T09:18:46.834573Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.160110] garage[898]: 2026-11-12T09:18:46.834577Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.162076] garage[898]: 2026-11-12T09:18:46.834581Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.173919] garage[898]: 2026-11-12T09:18:46.834586Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.176000] garage[898]: 2026-11-12T09:18:46.834589Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.183861] garage[898]: 2026-11-12T09:18:46.834592Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.187047] garage[898]: 2026-11-12T09:18:46.834596Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.190845] garage[898]: 2026-11-12T09:18:46.834600Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.193863] garage[898]: 2026-11-12T09:18:46.834606Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.196293] garage[898]: 2026-11-12T09:18:46.834611Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.199408] garage[898]: 2026-11-12T09:18:46.834615Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.201540] garage[898]: 2026-11-12T09:18:46.834618Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.205060] garage[898]: 2026-11-12T09:18:46.834621Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.207737] garage[898]: 2026-11-12T09:18:46.834625Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.209809] garage[898]: 2026-11-12T09:18:46.834628Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.212570] garage[898]: 2026-11-12T09:18:46.834631Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.215350] garage[898]: 2026-11-12T09:18:46.834648Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.217418] garage[898]: 2026-11-12T09:18:46.834658Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.220501] garage[898]: 2026-11-12T09:18:46.834662Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.222448] garage[898]: 2026-11-12T09:18:46.834667Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.228574] garage[898]: 2026-11-12T09:18:46.834671Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.230602] garage[898]: 2026-11-12T09:18:46.834674Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.233483] garage[898]: 2026-11-12T09:18:46.834677Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.235391] garage[898]: 2026-11-12T09:18:46.834681Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.238834] garage[898]: 2026-11-12T09:18:46.834688Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.240885] garage[898]: 2026-11-12T09:18:46.834692Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.243725] garage[898]: 2026-11-12T09:18:46.834696Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.247194] garage[898]: 2026-11-12T09:18:46.834700Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.249244] garage[898]: 2026-11-12T09:18:46.834703Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.251546] garage[898]: 2026-11-12T09:18:46.834706Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.254109] garage[898]: 2026-11-12T09:18:46.834710Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.257033] garage[898]: 2026-11-12T09:18:46.834713Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.259954] garage[898]: 2026-11-12T09:18:46.834719Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.262090] garage[898]: 2026-11-12T09:18:46.834723Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.265288] garage[898]: 2026-11-12T09:18:46.834727Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.268092] garage[898]: 2026-11-12T09:18:46.834731Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.270047] garage[898]: 2026-11-12T09:18:46.834735Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.271999] garage[898]: 2026-11-12T09:18:46.834738Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.274587] garage[898]: 2026-11-12T09:18:46.834741Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.277823] garage[898]: 2026-11-12T09:18:46.834744Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.279869] garage[898]: 2026-11-12T09:18:46.834751Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.282329] garage[898]: 2026-11-12T09:18:46.834756Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.284482] garage[898]: 2026-11-12T09:18:46.834759Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.286497] garage[898]: 2026-11-12T09:18:46.834762Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.289289] garage[898]: 2026-11-12T09:18:46.834765Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.291464] garage[898]: 2026-11-12T09:18:46.834769Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.293829] garage[898]: 2026-11-12T09:18:46.834773Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.296234] garage[898]: 2026-11-12T09:18:46.834776Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.298206] garage[898]: 2026-11-12T09:18:46.834782Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.301475] garage[898]: 2026-11-12T09:18:46.834787Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.303483] garage[898]: 2026-11-12T09:18:46.834791Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.307366] garage[898]: 2026-11-12T09:18:46.834796Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.309792] garage[898]: 2026-11-12T09:18:46.834799Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.312202] garage[898]: 2026-11-12T09:18:46.834802Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.314764] garage[898]: 2026-11-12T09:18:46.834806Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.317096] garage[898]: 2026-11-12T09:18:46.834810Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.319653] garage[898]: 2026-11-12T09:18:46.834820Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.322166] garage[898]: 2026-11-12T09:18:46.834824Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.325265] garage[898]: 2026-11-12T09:18:46.834828Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.327646] garage[898]: 2026-11-12T09:18:46.834831Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.329893] garage[898]: 2026-11-12T09:18:46.834836Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.332234] garage[898]: 2026-11-12T09:18:46.834840Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.336124] garage[898]: 2026-11-12T09:18:46.834844Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.338415] garage[898]: 2026-11-12T09:18:46.834846Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.340793] garage[898]: 2026-11-12T09:18:46.834854Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.343231] garage[898]: 2026-11-12T09:18:46.834858Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.345633] garage[898]: 2026-11-12T09:18:46.834862Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.347973] garage[898]: 2026-11-12T09:18:46.834865Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.350455] garage[898]: 2026-11-12T09:18:46.834868Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.352810] garage[898]: 2026-11-12T09:18:46.834871Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.356582] garage[898]: 2026-11-12T09:18:46.834875Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.358874] garage[898]: 2026-11-12T09:18:46.834879Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.361202] garage[898]: 2026-11-12T09:18:46.834885Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.363548] garage[898]: 2026-11-12T09:18:46.834889Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.365935] garage[898]: 2026-11-12T09:18:46.834892Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.368244] garage[898]: 2026-11-12T09:18:46.834895Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.371231] garage[898]: 2026-11-12T09:18:46.834899Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.373476] garage[898]: 2026-11-12T09:18:46.834906Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.375961] garage[898]: 2026-11-12T09:18:46.834910Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.378513] garage[898]: 2026-11-12T09:18:46.834914Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.381465] garage[898]: 2026-11-12T09:18:46.834920Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.384128] garage[898]: 2026-11-12T09:18:46.834925Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.386477] garage[898]: 2026-11-12T09:18:46.834929Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.388812] garage[898]: 2026-11-12T09:18:46.834932Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.391163] garage[898]: 2026-11-12T09:18:46.834936Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.393538] garage[898]: 2026-11-12T09:18:46.834939Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.395803] garage[898]: 2026-11-12T09:18:46.834943Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.398360] garage[898]: 2026-11-12T09:18:46.834946Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.400652] garage[898]: 2026-11-12T09:18:46.834953Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.402997] garage[898]: 2026-11-12T09:18:46.834957Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.406975] garage[898]: 2026-11-12T09:18:46.834960Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.410893] garage[898]: 2026-11-12T09:18:46.834963Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.414612] garage[898]: 2026-11-12T09:18:46.834967Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.417424] garage[898]: 2026-11-12T09:18:46.834971Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.420850] garage[898]: 2026-11-12T09:18:46.834975Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.423688] garage[898]: 2026-11-12T09:18:46.834978Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.427105] garage[898]: 2026-11-12T09:18:46.834986Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.429740] garage[898]: 2026-11-12T09:18:46.834991Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.432989] garage[898]: 2026-11-12T09:18:46.834995Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.436512] garage[898]: 2026-11-12T09:18:46.834998Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.442149] garage[898]: 2026-11-12T09:18:46.835001Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.447070] garage[898]: 2026-11-12T09:18:46.835005Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.450921] garage[898]: 2026-11-12T09:18:46.835008Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.452967] garage[898]: 2026-11-12T09:18:46.835011Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.454875] garage[898]: 2026-11-12T09:18:46.835036Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.457434] garage[898]: 2026-11-12T09:18:46.835041Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.462508] garage[898]: 2026-11-12T09:18:46.835045Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.465047] garage[898]: 2026-11-12T09:18:46.835050Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.467991] garage[898]: 2026-11-12T09:18:46.835053Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.471983] garage[898]: 2026-11-12T09:18:46.835056Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.474636] garage[898]: 2026-11-12T09:18:46.835060Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.477560] garage[898]: 2026-11-12T09:18:46.835063Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.481000] garage[898]: 2026-11-12T09:18:46.835071Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.483458] garage[898]: 2026-11-12T09:18:46.835075Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.486094] garage[898]: 2026-11-12T09:18:46.835079Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.490202] garage[898]: 2026-11-12T09:18:46.835082Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.492612] garage[898]: 2026-11-12T09:18:46.835085Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.495133] garage[898]: 2026-11-12T09:18:46.835088Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.497668] garage[898]: 2026-11-12T09:18:46.835093Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.500149] garage[898]: 2026-11-12T09:18:46.835096Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.502128] garage[898]: 2026-11-12T09:18:46.835103Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.503974] garage[898]: 2026-11-12T09:18:46.835108Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.509769] garage[898]: 2026-11-12T09:18:46.835111Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.513575] garage[898]: 2026-11-12T09:18:46.835115Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.515572] garage[898]: 2026-11-12T09:18:46.835118Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.518195] garage[898]: 2026-11-12T09:18:46.835121Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.520557] garage[898]: 2026-11-12T09:18:46.835124Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.522492] garage[898]: 2026-11-12T09:18:46.835128Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.524881] garage[898]: 2026-11-12T09:18:46.835135Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.527314] garage[898]: 2026-11-12T09:18:46.835139Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.530090] garage[898]: 2026-11-12T09:18:46.835142Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.531994] garage[898]: 2026-11-12T09:18:46.835146Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.536371] garage[898]: 2026-11-12T09:18:46.835149Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.539009] garage[898]: 2026-11-12T09:18:46.835153Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.541480] garage[898]: 2026-11-12T09:18:46.835159Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.543837] garage[898]: 2026-11-12T09:18:46.835162Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.546409] garage[898]: 2026-11-12T09:18:46.835170Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.548843] garage[898]: 2026-11-12T09:18:46.835174Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.550776] garage[898]: 2026-11-12T09:18:46.835179Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.553159] garage[898]: 2026-11-12T09:18:46.835182Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.555547] garage[898]: 2026-11-12T09:18:46.835186Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.558218] garage[898]: 2026-11-12T09:18:46.835189Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.561206] garage[898]: 2026-11-12T09:18:46.835192Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.563145] garage[898]: 2026-11-12T09:18:46.835195Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.565333] garage[898]: 2026-11-12T09:18:46.835203Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.567454] garage[898]: 2026-11-12T09:18:46.835207Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.571327] garage[898]: 2026-11-12T09:18:46.835212Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.573884] garage[898]: 2026-11-12T09:18:46.835220Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.575799] garage[898]: 2026-11-12T09:18:46.835224Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.578748] garage[898]: 2026-11-12T09:18:46.835228Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.581332] garage[898]: 2026-11-12T09:18:46.835232Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.588142] garage[898]: 2026-11-12T09:18:46.835235Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.590139] garage[898]: 2026-11-12T09:18:46.835242Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.592584] garage[898]: 2026-11-12T09:18:46.835246Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.595061] garage[898]: 2026-11-12T09:18:46.835250Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.600614] garage[898]: 2026-11-12T09:18:46.835254Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.603273] garage[898]: 2026-11-12T09:18:46.835257Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.607303] garage[898]: 2026-11-12T09:18:46.835260Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.613055] garage[898]: 2026-11-12T09:18:46.835263Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.615290] garage[898]: 2026-11-12T09:18:46.835267Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.617348] garage[898]: 2026-11-12T09:18:46.835274Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.619475] garage[898]: 2026-11-12T09:18:46.835278Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.621710] garage[898]: 2026-11-12T09:18:46.835282Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.623734] garage[898]: 2026-11-12T09:18:46.835291Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.627067] garage[898]: 2026-11-12T09:18:46.835296Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.629470] garage[898]: 2026-11-12T09:18:46.835300Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.631732] garage[898]: 2026-11-12T09:18:46.835303Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.634086] garage[898]: 2026-11-12T09:18:46.835306Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.636332] garage[898]: 2026-11-12T09:18:46.835313Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.639153] garage[898]: 2026-11-12T09:18:46.835318Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.642143] garage[898]: 2026-11-12T09:18:46.835322Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.645710] garage[898]: 2026-11-12T09:18:46.835325Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.647651] garage[898]: 2026-11-12T09:18:46.835328Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.650160] garage[898]: 2026-11-12T09:18:46.835331Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.652545] garage[898]: 2026-11-12T09:18:46.835334Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.656157] garage[898]: 2026-11-12T09:18:46.835338Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.658762] garage[898]: 2026-11-12T09:18:46.835344Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 22.808728] dhcpcd[662]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 25.662103] garage[898]: 2026-11-12T09:18:46.835349Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 22.810386] dhcpcd[662]: eth0: adding route to 10.0.2.0/24 worker2 # [ 22.811252] dhcpcd[662]: eth0: adding default route via 10.0.2.2 lb # [ 25.664859] garage[898]: 2026-11-12T09:18:46.835351Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.668821] garage[898]: 2026-11-12T09:18:46.835358Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.672755] garage[898]: 2026-11-12T09:18:46.835363Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.680401] garage[898]: 2026-11-12T09:18:46.835367Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.685454] garage[898]: 2026-11-12T09:18:46.835370Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.688066] garage[898]: 2026-11-12T09:18:46.835374Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.692146] garage[898]: 2026-11-12T09:18:46.835381Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.694222] garage[898]: 2026-11-12T09:18:46.835385Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.697517] garage[898]: 2026-11-12T09:18:46.835388Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.700897] garage[898]: 2026-11-12T09:18:46.835391Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.702865] garage[898]: 2026-11-12T09:18:46.835394Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.705663] garage[898]: 2026-11-12T09:18:46.835398Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.708589] garage[898]: 2026-11-12T09:18:46.835401Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.710972] garage[898]: 2026-11-12T09:18:46.835405Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.714966] garage[898]: 2026-11-12T09:18:46.835412Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.718243] garage[898]: 2026-11-12T09:18:46.835416Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.722619] garage[898]: 2026-11-12T09:18:46.835420Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.724918] garage[898]: 2026-11-12T09:18:46.835427Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.726846] garage[898]: 2026-11-12T09:18:46.835431Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.729740] garage[898]: 2026-11-12T09:18:46.835435Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.732262] garage[898]: 2026-11-12T09:18:46.835438Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.735000] garage[898]: 2026-11-12T09:18:46.835441Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.738381] garage[898]: 2026-11-12T09:18:46.835450Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.742445] garage[898]: 2026-11-12T09:18:46.835454Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.744701] garage[898]: 2026-11-12T09:18:46.835458Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.748123] garage[898]: 2026-11-12T09:18:46.835462Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 22.898189] systemd[1]: Started DHCP Client. lb # [ 25.750506] garage[898]: 2026-11-12T09:18:46.835465Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.752909] garage[898]: 2026-11-12T09:18:46.835468Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 22.902217] systemd[1]: Reached target Network is Online. lb # [ 25.754851] garage[898]: 2026-11-12T09:18:46.835472Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 22.905362] systemd[1]: Starting scheduler-token.service... lb # [ 25.762226] garage[898]: 2026-11-12T09:18:46.835475Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.764751] garage[898]: 2026-11-12T09:18:46.835482Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.767173] garage[898]: 2026-11-12T09:18:46.835486Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.769901] garage[898]: 2026-11-12T09:18:46.835489Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.771843] garage[898]: 2026-11-12T09:18:46.835496Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.776488] garage[898]: 2026-11-12T09:18:46.835501Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.778984] garage[898]: 2026-11-12T09:18:46.835505Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.781444] garage[898]: 2026-11-12T09:18:46.835508Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.784729] garage[898]: 2026-11-12T09:18:46.835512Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.786739] garage[898]: 2026-11-12T09:18:46.835519Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.789606] garage[898]: 2026-11-12T09:18:46.835524Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.796427] garage[898]: 2026-11-12T09:18:46.835528Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.798436] garage[898]: 2026-11-12T09:18:46.835531Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.803639] garage[898]: 2026-11-12T09:18:46.835534Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.807839] garage[898]: 2026-11-12T09:18:46.835538Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.818336] garage[898]: 2026-11-12T09:18:46.835541Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 22.970475] systemd[1]: scheduler-token.service: Deactivated successfully. lb # [ 25.824236] garage[898]: 2026-11-12T09:18:46.835544Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 22.973574] systemd[1]: Finished scheduler-token.service. lb # [ 25.826217] garage[898]: 2026-11-12T09:18:46.835551Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 22.974602] systemd[1]: scheduler-token.service: Consumed 31ms CPU time over 67ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb # [ 25.828606] garage[898]: 2026-11-12T09:18:46.835556Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.833470] garage[898]: 2026-11-12T09:18:46.835559Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.835906] garage[898]: 2026-11-12T09:18:46.835567Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.838256] garage[898]: 2026-11-12T09:18:46.835571Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.840339] garage[898]: 2026-11-12T09:18:46.835574Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 22.990250] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 25.843125] garage[898]: 2026-11-12T09:18:46.835578Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.845363] garage[898]: 2026-11-12T09:18:46.835581Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.848781] garage[898]: 2026-11-12T09:18:46.835588Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.851486] garage[898]: 2026-11-12T09:18:46.835593Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.853708] garage[898]: 2026-11-12T09:18:46.835596Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.856654] garage[898]: 2026-11-12T09:18:46.835599Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.859003] garage[898]: 2026-11-12T09:18:46.835603Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.862693] garage[898]: 2026-11-12T09:18:46.835606Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.865259] garage[898]: 2026-11-12T09:18:46.835610Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.867233] garage[898]: 2026-11-12T09:18:46.835613Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.869956] garage[898]: 2026-11-12T09:18:46.835619Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.872262] garage[898]: 2026-11-12T09:18:46.835623Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.874173] garage[898]: 2026-11-12T09:18:46.835627Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.877572] garage[898]: 2026-11-12T09:18:46.835635Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.880043] garage[898]: 2026-11-12T09:18:46.835639Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.882262] garage[898]: 2026-11-12T09:18:46.835642Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.884518] garage[898]: 2026-11-12T09:18:46.835645Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.886785] garage[898]: 2026-11-12T09:18:46.835656Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.890401] garage[898]: 2026-11-12T09:18:46.835669Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.892783] garage[898]: 2026-11-12T09:18:46.835673Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.895197] garage[898]: 2026-11-12T09:18:46.835676Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.897541] garage[898]: 2026-11-12T09:18:46.835680Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.899783] garage[898]: 2026-11-12T09:18:46.835683Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.902278] garage[898]: 2026-11-12T09:18:46.835687Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.904519] garage[898]: 2026-11-12T09:18:46.835691Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.906766] garage[898]: 2026-11-12T09:18:46.835694Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.909071] garage[898]: 2026-11-12T09:18:46.835701Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.911318] garage[898]: 2026-11-12T09:18:46.835705Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.913647] garage[898]: 2026-11-12T09:18:46.835709Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.915873] garage[898]: 2026-11-12T09:18:46.835716Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.918354] garage[898]: 2026-11-12T09:18:46.835721Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.921414] garage[898]: 2026-11-12T09:18:46.835725Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.923596] garage[898]: 2026-11-12T09:18:46.835728Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.926034] garage[898]: 2026-11-12T09:18:46.835731Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.929272] garage[898]: 2026-11-12T09:18:46.835739Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.931511] garage[898]: 2026-11-12T09:18:46.835743Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.933935] garage[898]: 2026-11-12T09:18:46.835746Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.936179] garage[898]: 2026-11-12T09:18:46.835749Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.938453] garage[898]: 2026-11-12T09:18:46.835752Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.940983] garage[898]: 2026-11-12T09:18:46.835756Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.943194] garage[898]: 2026-11-12T09:18:46.835759Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.947515] garage[898]: 2026-11-12T09:18:46.835762Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.949946] garage[898]: 2026-11-12T09:18:46.835769Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.953326] garage[898]: 2026-11-12T09:18:46.835773Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.955975] garage[898]: 2026-11-12T09:18:46.835777Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.958363] garage[898]: 2026-11-12T09:18:46.835785Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.960624] garage[898]: 2026-11-12T09:18:46.835790Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.962914] garage[898]: 2026-11-12T09:18:46.835793Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.966087] garage[898]: 2026-11-12T09:18:46.835797Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.968562] garage[898]: 2026-11-12T09:18:46.835800Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.971241] garage[898]: 2026-11-12T09:18:46.835807Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.974413] garage[898]: 2026-11-12T09:18:46.835818Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.976741] garage[898]: 2026-11-12T09:18:46.835828Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.979769] garage[898]: 2026-11-12T09:18:46.835831Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.981932] garage[898]: 2026-11-12T09:18:46.835835Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.984070] garage[898]: 2026-11-12T09:18:46.835839Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.986618] garage[898]: 2026-11-12T09:18:46.835842Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.989424] garage[898]: 2026-11-12T09:18:46.835852Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.991674] garage[898]: 2026-11-12T09:18:46.835862Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.994859] garage[898]: 2026-11-12T09:18:46.835867Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 25.999447] garage[898]: 2026-11-12T09:18:46.835871Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.002493] garage[898]: 2026-11-12T09:18:46.835881Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.005224] garage[898]: 2026-11-12T09:18:46.835885Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.007915] garage[898]: 2026-11-12T09:18:46.835888Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 23.154949] nix-grpc-daemon[791]: ts=2026-11-12T09:18:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" lb # [ 26.010416] garage[898]: 2026-11-12T09:18:46.835892Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.013246] garage[898]: 2026-11-12T09:18:46.835895Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.015270] garage[898]: 2026-11-12T09:18:46.835902Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.018865] garage[898]: 2026-11-12T09:18:46.835907Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.022326] garage[898]: 2026-11-12T09:18:46.835910Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 23.171063] nix-grpc-daemon[791]: ts=2026-11-12T09:18:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc lb # [ 26.026300] garage[898]: 2026-11-12T09:18:46.835913Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.028596] garage[898]: 2026-11-12T09:18:46.835917Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 23.175794] nix-grpc-daemon[791]: ts=2026-11-12T09:18:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 26.031174] garage[898]: 2026-11-12T09:18:46.835920Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.033621] garage[898]: 2026-11-12T09:18:46.835923Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.036897] garage[898]: 2026-11-12T09:18:46.835927Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.040076] garage[898]: 2026-11-12T09:18:46.835933Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.042171] garage[898]: 2026-11-12T09:18:46.835937Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.045312] garage[898]: 2026-11-12T09:18:46.835942Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.047632] garage[898]: 2026-11-12T09:18:46.835950Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.050234] garage[898]: 2026-11-12T09:18:46.835954Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.052189] garage[898]: 2026-11-12T09:18:46.835957Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.054858] garage[898]: 2026-11-12T09:18:46.835960Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.057235] garage[898]: 2026-11-12T09:18:46.835964Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.059870] garage[898]: 2026-11-12T09:18:46.835971Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.062573] garage[898]: 2026-11-12T09:18:46.835975Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.067405] garage[898]: 2026-11-12T09:18:46.835979Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.069806] garage[898]: 2026-11-12T09:18:46.835982Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.072124] garage[898]: 2026-11-12T09:18:46.835985Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.074296] garage[898]: 2026-11-12T09:18:46.835988Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.076634] garage[898]: 2026-11-12T09:18:46.835992Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.079511] garage[898]: 2026-11-12T09:18:46.835995Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 23.228933] nix-grpc-daemon[791]: ts=2026-11-12T09:18:48Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 26.083696] garage[898]: 2026-11-12T09:18:46.836001Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.085893] garage[898]: 2026-11-12T09:18:46.836006Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.087835] garage[898]: 2026-11-12T09:18:46.836010Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 23.237996] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 23.239110] systemd[1]: Reached target Multi-User System. lb # [ 26.091960] garage[898]: 2026-11-12T09:18:46.836016Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.094256] garage[898]: 2026-11-12T09:18:46.836021Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.097168] garage[898]: 2026-11-12T09:18:46.836025Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 23.245328] systemd[1]: Startup finished in 4.308s (kernel) + 5.103s (initrd) + 13.821s (userspace) = 23.232s. lb # [ 26.100349] garage[898]: 2026-11-12T09:18:46.836028Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.104121] garage[898]: 2026-11-12T09:18:46.836032Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.106142] garage[898]: 2026-11-12T09:18:46.836039Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.108315] garage[898]: 2026-11-12T09:18:46.836043Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.111589] garage[898]: 2026-11-12T09:18:46.836047Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.114124] garage[898]: 2026-11-12T09:18:46.836049Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.120303] garage[898]: 2026-11-12T09:18:46.836053Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.122821] envoy[897]: [2026-11-12 09:18:47.822][897][warning][misc] [source/server/cgroup_cpu_util.cc:253] Cgroup path /system.slice/envoy.service is outside mount root /system.slice/envoy.service/memory.pressure lb # [ 26.130670] envoy[897]: [2026-11-12 09:18:47.862][897][info][main] [source/server/server.cc:463] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 26.132752] envoy[897]: [2026-11-12 09:18:47.862][897][info][main] [source/server/server.cc:465] statically linked extensions: lb # [ 26.134836] envoy[897]: [2026-11-12 09:18:47.862][897][info][main] [source/server/server.cc:467] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 26.139027] envoy[897]: [2026-11-12 09:18:47.862][897][info][main] [source/server/server.cc:467] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 26.144662] envoy[897]: [2026-11-12 09:18:47.862][897][info][main] [source/server/server.cc:467] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit worker2 # [ 23.291542] nix-grpc-daemon[791]: ts=2026-11-12T09:18:48Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 26.147595] envoy[897]: [2026-11-12 09:18:47.862][897][info][main] [source/server/server.cc:467] envoy.tls_handshakers: envoy.tls.handshakers.dynamic_modules lb # [ 26.151864] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.http.ai_filters: envoy.http.ai_filters.request_info, envoy.http.ai_filters.schema_validation, envoy.http.ai_filters.transcoder lb # [ 26.160217] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san worker1 # [ 24.868597] dhcpcd[700]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 24.871065] dhcpcd[700]: eth0: adding route to 10.0.2.0/24 worker1 # [ 24.874096] dhcpcd[700]: eth0: adding default route via 10.0.2.2 lb # [ 26.199200] garage[898]: 2026-11-12T09:18:46.836056Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.207976] garage[898]: 2026-11-12T09:18:46.836059Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.210143] garage[898]: 2026-11-12T09:18:46.836062Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.216378] garage[898]: 2026-11-12T09:18:46.836068Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.218449] garage[898]: 2026-11-12T09:18:46.836073Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.224775] garage[898]: 2026-11-12T09:18:46.840966Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.229238] garage[898]: 2026-11-12T09:18:46.841002Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.231368] garage[898]: 2026-11-12T09:18:46.841007Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.237267] garage[898]: 2026-11-12T09:18:46.841011Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.239452] garage[898]: 2026-11-12T09:18:46.841015Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.242403] garage[898]: 2026-11-12T09:18:46.841018Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.244577] garage[898]: 2026-11-12T09:18:46.841026Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.246594] garage[898]: 2026-11-12T09:18:46.841030Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.248813] garage[898]: 2026-11-12T09:18:46.841034Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.250769] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 26.254622] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 26.257579] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 26.260606] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string lb # [ 26.263151] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift, envoy.health_checkers.udp lb # [ 26.267916] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 26.273598] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 26.276274] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 26.280395] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.route_config_update_requester: envoy.route_config_update_requester.default worker1 # [ 24.982594] systemd[1]: Started DHCP Client. worker1 # [ 24.984753] systemd[1]: Reached target Multi-User System. worker1 # [ 24.985698] systemd[1]: Startup finished in 5.786s (kernel) + 4.230s (initrd) + 14.967s (userspace) = 24.984s. lb # [ 26.282674] garage[898]: 2026-11-12T09:18:46.841038Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.287695] garage[898]: 2026-11-12T09:18:46.841042Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.289963] garage[898]: 2026-11-12T09:18:46.841045Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.291894] garage[898]: 2026-11-12T09:18:46.841048Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.294192] garage[898]: 2026-11-12T09:18:46.841052Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.296437] garage[898]: 2026-11-12T09:18:46.841059Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.298365] garage[898]: 2026-11-12T09:18:46.841063Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.300356] garage[898]: 2026-11-12T09:18:46.841067Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.302362] garage[898]: 2026-11-12T09:18:46.841074Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.304485] garage[898]: 2026-11-12T09:18:46.841078Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.306410] garage[898]: 2026-11-12T09:18:46.841082Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.311217] garage[898]: 2026-11-12T09:18:46.841086Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.314620] garage[898]: 2026-11-12T09:18:46.841089Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.317790] garage[898]: 2026-11-12T09:18:46.841096Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.323869] garage-setup-start[928]: ==== HEALTHY NODES ==== lb # [ 26.328388] garage-setup-start[928]: ID Hostname Address Tags Zone Capacity DataAvail lb # [ 26.329905] garage-setup-start[928]: 1663f402f1dfffc9 lb 10.0.2.15:3901 NO ROLE ASSIGNED lb # [ 26.331318] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata worker2 # [ 23.492177] nix-grpc-daemon[791]: ts=2026-11-12T09:18:48Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 26.342176] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.dynamic_module_string_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 26.359254] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 26.367626] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 26.370612] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 26.373054] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.http.early_header_mutation: envoy.http.early_header_mutation.dynamic_modules, envoy.http.early_header_mutation.header_mutation lb # [ 26.376464] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 26.380623] garage[898]: 2026-11-12T09:18:46.841100Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.383204] garage[898]: 2026-11-12T09:18:46.841104Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.387225] garage[898]: 2026-11-12T09:18:46.841108Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.389563] garage[898]: 2026-11-12T09:18:46.841111Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.391644] garage[898]: 2026-11-12T09:18:46.841115Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.393951] garage[898]: 2026-11-12T09:18:46.841118Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.395871] garage[898]: 2026-11-12T09:18:46.841122Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.398216] garage[898]: 2026-11-12T09:18:46.841130Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.400326] garage[898]: 2026-11-12T09:18:46.841134Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.402261] garage[898]: 2026-11-12T09:18:46.841137Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.404419] garage[898]: 2026-11-12T09:18:46.841145Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.406434] garage[898]: 2026-11-12T09:18:46.841157Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.408616] garage[898]: 2026-11-12T09:18:46.841171Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.410584] garage[898]: 2026-11-12T09:18:46.841179Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.413277] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 26.415140] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.backtrace_action, envoy.watchdog.profile_action lb # [ 26.417945] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 26.432989] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 26.440673] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 26.443313] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 26.446082] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 26.448134] garage[898]: 2026-11-12T09:18:46.841182Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.450089] garage[898]: 2026-11-12T09:18:46.841189Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.451996] garage[898]: 2026-11-12T09:18:46.841194Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.453982] garage[898]: 2026-11-12T09:18:46.841197Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.455881] garage[898]: 2026-11-12T09:18:46.841201Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.457942] garage[898]: 2026-11-12T09:18:46.841204Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.459881] garage[898]: 2026-11-12T09:18:46.841207Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.461971] garage[898]: 2026-11-12T09:18:46.841211Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.463903] garage[898]: 2026-11-12T09:18:46.841215Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.465955] garage[898]: 2026-11-12T09:18:46.841222Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.467854] garage[898]: 2026-11-12T09:18:46.841226Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.469981] garage[898]: 2026-11-12T09:18:46.841230Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.471899] garage[898]: 2026-11-12T09:18:46.841237Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.473963] garage[898]: 2026-11-12T09:18:46.841242Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.475858] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 26.478848] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 26.480580] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 26.483041] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.dubbo_proxy.protocols: dubbo lb # [ 26.488293] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.connection_handler: envoy.connection_handler.default lb # [ 26.491176] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 26.493428] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.srds_factory: envoy.srds_factory.default lb # [ 26.495119] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr, envoy.rate_limit_descriptors.jwt_claim lb # [ 26.497694] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 26.501237] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 26.504484] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 26.506646] garage[898]: 2026-11-12T09:18:46.841245Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.509264] garage[898]: 2026-11-12T09:18:46.841249Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.511355] garage[898]: 2026-11-12T09:18:46.841252Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.513529] garage[898]: 2026-11-12T09:18:46.841259Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.515479] garage[898]: 2026-11-12T09:18:46.841263Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! client # [ 25.212071] dhcpcd[570]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 25.214485] dhcpcd[570]: eth0: adding route to 10.0.2.0/24 lb # [ 26.518191] garage[898]: 2026-11-12T09:18:46.841268Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! client # [ 25.215843] dhcpcd[570]: eth0: adding default route via 10.0.2.2 lb # [ 26.520265] garage[898]: 2026-11-12T09:18:46.841271Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.522211] garage[898]: 2026-11-12T09:18:46.841275Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.524390] garage[898]: 2026-11-12T09:18:46.841278Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.526423] garage[898]: 2026-11-12T09:18:46.841282Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.528544] garage[898]: 2026-11-12T09:18:46.841285Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.530470] garage[898]: 2026-11-12T09:18:46.841292Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.532624] garage[898]: 2026-11-12T09:18:46.841296Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.534658] garage[898]: 2026-11-12T09:18:46.841299Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.537019] garage-setup-start[937]: Role changes are staged but not yet committed. lb # [ 26.538069] garage-setup-start[937]: Use `garage layout show` to view staged role changes, lb # [ 26.539153] garage-setup-start[937]: and `garage layout apply` to enact staged changes. lb # [ 26.540422] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 26.560842] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 26.566336] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 26.568278] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 26.570163] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.router.route_specifiers: envoy.router.route_specifiers.dynamic_modules lb # [ 26.572262] garage[898]: 2026-11-12T09:18:46.841306Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.574351] garage[898]: 2026-11-12T09:18:46.841310Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.576305] garage[898]: 2026-11-12T09:18:46.841315Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.578243] garage[898]: 2026-11-12T09:18:46.841318Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.580159] garage[898]: 2026-11-12T09:18:46.841321Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.582303] garage[898]: 2026-11-12T09:18:46.841328Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.584247] garage[898]: 2026-11-12T09:18:46.841332Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.586163] garage[898]: 2026-11-12T09:18:46.841335Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.588080] garage[898]: 2026-11-12T09:18:46.841339Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.589988] garage[898]: 2026-11-12T09:18:46.841342Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.591852] garage[898]: 2026-11-12T09:18:46.841345Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.593966] garage[898]: 2026-11-12T09:18:46.841349Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.595873] garage[898]: 2026-11-12T09:18:46.841352Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.598001] garage[898]: 2026-11-12T09:18:46.841359Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.599972] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 26.602822] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 26.605093] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 26.607307] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 26.616157] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 26.618710] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 26.632553] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input client # [ 25.330567] systemd[1]: Started DHCP Client. lb # [ 26.634583] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.content_parsers: envoy.content_parsers.json client # [ 25.333129] systemd[1]: Reached target Multi-User System. client # [ 25.334707] systemd[1]: Startup finished in 5.792s (kernel) + 4.214s (initrd) + 15.327s (userspace) = 25.334s. lb # [ 26.638116] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.config.validators: envoy.config.validators.dynamic_modules, envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 26.644253] garage[898]: 2026-11-12T09:18:46.841363Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.646184] garage[898]: 2026-11-12T09:18:46.841367Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.652100] garage[898]: 2026-11-12T09:18:46.841374Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.654161] garage[898]: 2026-11-12T09:18:46.841378Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.664193] garage[898]: 2026-11-12T09:18:46.841382Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.666123] garage[898]: 2026-11-12T09:18:46.841385Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.672094] garage[898]: 2026-11-12T09:18:46.841389Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.674041] garage[898]: 2026-11-12T09:18:46.841396Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.675947] garage[898]: 2026-11-12T09:18:46.841400Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.684151] garage[898]: 2026-11-12T09:18:46.841404Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.686124] garage[898]: 2026-11-12T09:18:46.841407Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.689420] garage[898]: 2026-11-12T09:18:46.841410Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.691376] garage[898]: 2026-11-12T09:18:46.841413Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.696109] garage[898]: 2026-11-12T09:18:46.841417Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.698150] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.queue_policy: envoy.queue_policy.fifo lb # [ 26.699843] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 26.708914] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 26.720561] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 26.730494] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 26.739025] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query worker2 # [ 23.892674] nix-grpc-daemon[791]: ts=2026-11-12T09:18:49Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 26.750774] garage-setup-start[939]: ==== COMPUTATION OF A NEW PARTITION ASSIGNATION ==== lb # [ 26.751953] garage-setup-start[939]: Partitions are replicated 1 times on at least 1 distinct zones. lb # [ 26.760355] garage-setup-start[939]: Optimal partition size: 3.9 MB lb # [ 26.761592] garage-setup-start[939]: Usable capacity / total cluster capacity: 1000.0 MB / 1000.0 MB (100.0 %) lb # [ 26.763201] garage-setup-start[939]: Effective capacity (replication factor 1): 1000.0 MB lb # [ 26.768335] garage-setup-start[939]: test Tags Partitions Capacity Usable capacity lb # [ 26.769696] garage-setup-start[939]: 1663f402f1dfffc9 256 (256 new) 1000.0 MB 1000.0 MB (100.0%) lb # [ 26.770976] garage-setup-start[939]: TOTAL 256 (256 unique) 1000.0 MB 1000.0 MB (100.0%) lb # [ 26.774271] garage-setup-start[939]: New cluster layout with updated role assignment has been applied in cluster. lb # [ 26.775726] garage-setup-start[939]: Data will now be moved around between nodes accordingly. lb # [ 26.777249] garage[898]: 2026-11-12T09:18:46.841420Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.779235] garage[898]: 2026-11-12T09:18:46.841427Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.781450] garage[898]: 2026-11-12T09:18:46.841432Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.783723] garage[898]: 2026-11-12T09:18:46.841436Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.785861] garage[898]: 2026-11-12T09:18:46.841443Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.787955] garage[898]: 2026-11-12T09:18:46.841447Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.790253] garage[898]: 2026-11-12T09:18:46.841452Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.792346] garage[898]: 2026-11-12T09:18:46.841455Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.794278] garage[898]: 2026-11-12T09:18:46.841459Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.796405] garage[898]: 2026-11-12T09:18:46.841465Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.798447] garage[898]: 2026-11-12T09:18:46.841470Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.800568] garage[898]: 2026-11-12T09:18:46.841474Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.802489] garage[898]: 2026-11-12T09:18:46.841478Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.804806] garage[898]: 2026-11-12T09:18:46.841481Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.806925] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.body_size_limit, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 26.819651] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 26.829037] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 26.831227] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] quic.http_server_connection: quic.http_server_connection.default lb # [ 26.833916] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 26.835872] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 26.838043] garage[898]: 2026-11-12T09:18:46.841485Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.840093] garage[898]: 2026-11-12T09:18:46.841488Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.842035] garage[898]: 2026-11-12T09:18:46.841492Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.843975] garage[898]: 2026-11-12T09:18:46.841499Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.846014] garage[898]: 2026-11-12T09:18:46.841503Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.847964] garage[898]: 2026-11-12T09:18:46.841507Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.855191] garage[898]: 2026-11-12T09:18:46.841514Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.863852] garage[898]: 2026-11-12T09:18:46.841519Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.867423] garage[898]: 2026-11-12T09:18:46.841522Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.872981] garage[898]: 2026-11-12T09:18:46.841526Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.877974] garage[898]: 2026-11-12T09:18:46.841529Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.880633] garage[898]: 2026-11-12T09:18:46.841537Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.883696] garage[898]: 2026-11-12T09:18:46.841542Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.887100] garage[898]: 2026-11-12T09:18:46.841546Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.890446] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 26.897314] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 26.899265] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 26.916384] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 26.918609] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 26.922061] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 26.923860] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 26.929883] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 26.933174] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 26.935113] garage[898]: 2026-11-12T09:18:46.841549Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.937544] garage[898]: 2026-11-12T09:18:46.841552Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.939491] garage[898]: 2026-11-12T09:18:46.841555Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.941690] garage[898]: 2026-11-12T09:18:46.841559Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.943706] garage[898]: 2026-11-12T09:18:46.841562Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.946237] garage[898]: 2026-11-12T09:18:46.841569Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.948781] garage[898]: 2026-11-12T09:18:46.841573Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.950785] garage[898]: 2026-11-12T09:18:46.841576Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.952842] garage[898]: 2026-11-12T09:18:46.841583Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.954810] garage[898]: 2026-11-12T09:18:46.841587Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.957029] garage[898]: 2026-11-12T09:18:46.841591Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.958957] garage[898]: 2026-11-12T09:18:46.841595Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.961024] garage[898]: 2026-11-12T09:18:46.841599Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.962921] garage[898]: 2026-11-12T09:18:46.841606Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 26.965433] garage-setup-start[941]: Key name: farm lb # [ 26.966252] garage-setup-start[941]: Key ID: GK0123456789abcdef01234567 lb # [ 26.967136] garage-setup-start[941]: Secret key: 0123456789abcdef0123456789abcdef0123456789abcdef0123456789abcdef lb # [ 26.968884] garage-setup-start[941]: Can create buckets: false lb # [ 26.969695] garage-setup-start[941]: Key-specific bucket aliases: lb # [ 26.970530] garage-setup-start[941]: Authorized buckets: lb # [ 26.971289] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 26.983337] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 26.993273] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 26.995231] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 27.003414] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 27.012582] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 27.014678] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] filter_state.object: envoy.ai.llm_protocol.request, envoy.ai.model.request, envoy.bool, envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 27.030294] garage[898]: 2026-11-12T09:18:46.841611Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.032530] garage[898]: 2026-11-12T09:18:46.841614Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.034561] garage[898]: 2026-11-12T09:18:46.841618Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.037159] garage[898]: 2026-11-12T09:18:46.841622Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.039102] garage[898]: 2026-11-12T09:18:46.841626Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.041738] garage[898]: 2026-11-12T09:18:46.841630Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.043667] garage[898]: 2026-11-12T09:18:46.841633Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.046023] garage[898]: 2026-11-12T09:18:46.841639Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.047939] garage[898]: 2026-11-12T09:18:46.841644Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.050189] garage[898]: 2026-11-12T09:18:46.841647Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.052255] garage[898]: 2026-11-12T09:18:46.841655Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.054244] garage[898]: 2026-11-12T09:18:46.841659Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.056452] garage[898]: 2026-11-12T09:18:46.841663Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.058730] garage[898]: 2026-11-12T09:18:46.841667Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.061118] garage-setup-start[947]: Bucket farm was created. lb # [ 27.062099] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 27.066869] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.string_matcher: envoy.string_matcher.lua lb # [ 27.068755] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 27.070644] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 27.076517] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.request_id: envoy.request_id.uuid lb # [ 27.078241] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 27.080770] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.rds_factory: envoy.rds_factory.default lb # [ 27.082456] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 27.091205] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 27.099017] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] network.connection.client: default, envoy_internal lb # [ 27.102010] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 27.112375] garage[898]: 2026-11-12T09:18:46.841670Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.114422] garage[898]: 2026-11-12T09:18:46.841676Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.123449] garage[898]: 2026-11-12T09:18:46.841681Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.129329] garage[898]: 2026-11-12T09:18:46.841684Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.131470] garage[898]: 2026-11-12T09:18:46.841687Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.138862] garage[898]: 2026-11-12T09:18:46.841691Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.143797] garage[898]: 2026-11-12T09:18:46.841694Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.147577] garage[898]: 2026-11-12T09:18:46.841698Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.150035] garage[898]: 2026-11-12T09:18:46.841701Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 27.151997] garage[898]: 2026-11-12T09:18:46.846624Z INFO garage_model::garage: Initialize block manager... lb # [ 27.154227] garage[898]: 2026-11-12T09:18:46.879597Z INFO garage_model::garage: Initialize bucket_table... lb # [ 27.155865] garage[898]: 2026-11-12T09:18:46.902708Z INFO garage_model::garage: Initialize bucket_alias_table... lb # [ 27.158043] garage[898]: 2026-11-12T09:18:46.913543Z INFO garage_model::garage: Initialize key_table_table... lb # [ 27.159722] garage[898]: 2026-11-12T09:18:46.918124Z INFO garage_model::garage: Initialize block_ref_table... lb # [ 27.161642] garage[898]: 2026-11-12T09:18:46.926622Z INFO garage_model::garage: Initialize version_table... lb # [ 27.163623] garage-setup-start[949]: New permissions for GK0123456789abcdef01234567 on farm: read true, write true, owner true. lb # [ 27.165932] systemd[1]: Finished garage-setup.service. lb # [ 27.166800] garage[898]: 2026-11-12T09:18:46.930815Z INFO garage_model::garage: Initialize multipart upload counter table... lb # [ 27.169055] garage[898]: 2026-11-12T09:18:46.936889Z INFO garage_model::garage: Initialize multipart upload table... lb # [ 27.170896] garage[898]: 2026-11-12T09:18:46.937260Z INFO garage_model::garage: Initialize object counter table... lb # [ 27.172873] garage[898]: 2026-11-12T09:18:46.937349Z INFO garage_model::garage: Initialize object_table... lb # [ 27.174520] garage[898]: 2026-11-12T09:18:46.946113Z INFO garage_model::garage: Load lifecycle worker state... lb # [ 27.176431] garage[898]: 2026-11-12T09:18:46.946198Z INFO garage_model::garage: Initialize K2V counter table... lb # [ 27.178197] garage[898]: 2026-11-12T09:18:46.949759Z INFO garage_model::garage: Initialize K2V subscription manager... lb # [ 27.179960] garage[898]: 2026-11-12T09:18:46.949783Z INFO garage_model::garage: Initialize K2V item table... lb # [ 27.183604] garage[898]: 2026-11-12T09:18:46.956130Z INFO garage_model::garage: Initialize K2V RPC handler... lb # [ 27.185586] garage[898]: 2026-11-12T09:18:46.958378Z INFO garage::server: Initializing background runner... lb # [ 27.187649] garage[898]: 2026-11-12T09:18:46.964921Z INFO garage::server: Spawning Garage workers... lb # [ 27.189786] garage[898]: 2026-11-12T09:18:46.972412Z INFO garage_model::s3::lifecycle_worker: Starting lifecycle worker for 2026-11-12 lb # [ 27.191751] garage[898]: 2026-11-12T09:18:46.972444Z INFO garage::server: Initialize Admin API server and metrics collector... lb # [ 27.193948] garage[898]: 2026-11-12T09:18:46.975260Z INFO garage::server: Launching internal Garage cluster communications... lb # [ 27.195819] garage[898]: 2026-11-12T09:18:46.975317Z INFO garage::server: Create admin RPC handler... lb # [ 27.203549] garage[898]: 2026-11-12T09:18:46.975338Z INFO garage::server: Initializing S3 API server... lb # [ 27.208629] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_eventstream_parser, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.body_size_limit, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 27.252769] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 27.265188] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.dynamic_modules, envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher, envoy.router.cluster_specifier_plugin.priority_group lb # [ 27.269415] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 27.271437] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 27.278293] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 27.282537] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 27.284561] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.common.key_value: envoy.key_value.file_based lb # [ 27.286307] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.dynamic_modules, envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 27.289446] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 27.292158] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 27.294093] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 27.296219] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 27.299251] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 27.301383] systemd[1]: Starting niks3 server... lb # [ 27.302691] garage[898]: 2026-11-12T09:18:47.003041Z INFO garage_model::s3::lifecycle_worker: Lifecycle worker finished for 2026-11-12, objects expired: 0, mpu aborted: 0 lb # [ 27.305328] garage[898]: 2026-11-12T09:18:47.006289Z INFO garage_net::netapp: Listening on 127.0.0.1:3901 lb # [ 27.307973] garage[898]: 2026-11-12T09:18:47.006758Z INFO garage_rpc::system: Doing a bootstrap/discovery step (not_configured: true, no_peers: false, bad_peers: true) lb # [ 27.310600] garage[898]: 2026-11-12T09:18:47.006902Z INFO garage_api_common::generic_server: S3 API server listening on http://0.0.0.0:9000 lb # [ 27.312718] garage[898]: 2026-11-12T09:18:47.983371Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:52236, negotiating handshake... lb # [ 27.314817] garage[898]: 2026-11-12T09:18:47.988741Z INFO garage_net::netapp: Accepted connection from d61ab43b2b4afdcd at 127.0.0.1:52236 lb # [ 27.316933] garage[898]: 2026-11-12T09:18:48.046353Z INFO garage_net::netapp: Connection from d61ab43b2b4afdcd closed lb # [ 27.318826] garage[898]: 2026-11-12T09:18:48.199321Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:52238, negotiating handshake... lb # [ 27.320998] garage[898]: 2026-11-12T09:18:48.200477Z INFO garage_net::netapp: Accepted connection from 7ad52e3c4ad6999c at 127.0.0.1:52238 lb # [ 27.322988] garage[898]: 2026-11-12T09:18:48.246937Z INFO garage_net::netapp: Connection from 7ad52e3c4ad6999c closed lb # [ 27.324878] garage[898]: 2026-11-12T09:18:48.324954Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:52252, negotiating handshake... lb # [ 27.327218] garage[898]: 2026-11-12T09:18:48.325934Z INFO garage_net::netapp: Accepted connection from 5325ce51c8bc8224 at 127.0.0.1:52252 lb # [ 27.329344] garage[898]: 2026-11-12T09:18:48.489390Z INFO garage_table::sync: (bucket_v2) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 27.332324] envoy[897]: [2026-11-12 09:18:47.863][897][info][main] [source/server/server.cc:467] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.filter_state, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 27.336389] envoy[897]: [2026-11-12 09:18:47.888][897][info][main] [source/server/server.cc:544] HTTP header map info: lb # [ 27.337779] envoy[897]: [2026-11-12 09:18:47.889][897][info][main] [source/server/server.cc:547] request header map: 648 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 27.354812] envoy[897]: [2026-11-12 09:18:47.889][897][info][main] [source/server/server.cc:547] request trailer map: 104 bytes: lb # [ 27.356591] envoy[897]: [2026-11-12 09:18:47.889][897][info][main] [source/server/server.cc:547] response header map: 416 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 27.366884] envoy[897]: [2026-11-12 09:18:47.889][897][info][main] [source/server/server.cc:547] response trailer map: 128 bytes: grpc-message,grpc-status lb # [ 27.368974] envoy[897]: [2026-11-12 09:18:47.953][897][info][main] [source/server/server.cc:989] runtime: {} lb # [ 27.370299] envoy[897]: [2026-11-12 09:18:47.958][897][info][main] [source/server/server.cc:813] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 27.372156] envoy[897]: [2026-11-12 09:18:47.961][897][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 27.373675] envoy[897]: [2026-11-12 09:18:47.963][897][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 27.375338] envoy[897]: [2026-11-12 09:18:47.963][897][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 27.377602] envoy[897]: [2026-11-12 09:18:47.963][897][info][config] [source/server/configuration_impl.cc:138] loading 4 cluster(s) lb # [ 27.379252] envoy[897]: [2026-11-12 09:18:48.080][897][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 27.381468] envoy[897]: [2026-11-12 09:18:48.100][897][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 27.383996] envoy[897]: [2026-11-12 09:18:48.101][897][warning][main] [source/server/server.cc:1059] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 27.387807] envoy[897]: [2026-11-12 09:18:48.101][897][info][main] [source/server/server.cc:1098] starting main dispatch loop lb # [ 27.389604] envoy[897]: [2026-11-12 09:18:48.138][897][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 27.391493] envoy[897]: [2026-11-12 09:18:48.138][897][info][upstream] [source/common/upstream/cluster_manager_impl.cc:228] cm init: initializing secondary clusters lb # [ 27.393610] garage[898]: 2026-11-12T09:18:48.489438Z INFO garage_table::sync: bucket_v2: Adding full sync for ack layout version 1 lb # [ 27.395830] garage[898]: 2026-11-12T09:18:48.489469Z INFO garage_table::sync: (bucket_alias) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 27.399038] garage[898]: 2026-11-12T09:18:48.489476Z INFO garage_table::sync: bucket_alias: Adding full sync for ack layout version 1 lb # [ 27.401046] garage[898]: 2026-11-12T09:18:48.489491Z INFO garage_table::sync: (key) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 27.404038] garage[898]: 2026-11-12T09:18:48.489499Z INFO garage_table::sync: key: Adding full sync for ack layout version 1 lb # [ 27.405884] garage[898]: 2026-11-12T09:18:48.489510Z INFO garage_table::sync: (object) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 27.408647] garage[898]: 2026-11-12T09:18:48.489606Z INFO garage_table::sync: object: Adding full sync for ack layout version 1 lb # [ 27.410929] garage[898]: 2026-11-12T09:18:48.489638Z INFO garage_table::sync: (bucket_object_counter) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 27.414073] garage[898]: 2026-11-12T09:18:48.489727Z INFO garage_table::sync: bucket_object_counter: Adding full sync for ack layout version 1 lb # [ 27.416255] garage[898]: 2026-11-12T09:18:48.489747Z INFO garage_table::sync: (multipart_upload) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 27.419300] garage[898]: 2026-11-12T09:18:48.489837Z INFO garage_table::sync: multipart_upload: Adding full sync for ack layout version 1 lb # [ 27.421546] garage[898]: 2026-11-12T09:18:48.489854Z INFO garage_table::sync: (bucket_mpu_counter) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 27.424894] garage[898]: 2026-11-12T09:18:48.490060Z INFO garage_table::sync: bucket_mpu_counter: Adding full sync for ack layout version 1 lb # [ 27.427440] garage[898]: 2026-11-12T09:18:48.490091Z INFO garage_table::sync: (version) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 27.430798] garage[898]: 2026-11-12T09:18:48.490191Z INFO garage_table::sync: version: Adding full sync for ack layout version 1 lb # [ 27.432902] garage[898]: 2026-11-12T09:18:48.490211Z INFO garage_table::sync: (block_ref) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 27.435920] garage[898]: 2026-11-12T09:18:48.490307Z INFO garage_table::sync: block_ref: Adding full sync for ack layout version 1 lb # [ 27.438217] garage[898]: 2026-11-12T09:18:48.498538Z INFO garage_table::sync: (k2v_item) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 27.441365] garage[898]: 2026-11-12T09:18:48.498691Z INFO garage_table::sync: k2v_item: Adding full sync for ack layout version 1 lb # [ 27.443456] garage[898]: 2026-11-12T09:18:48.498720Z INFO garage_table::sync: (k2v_index_counter_v2) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 27.446899] garage[898]: 2026-11-12T09:18:48.498841Z INFO garage_table::sync: k2v_index_counter_v2: Adding full sync for ack layout version 1 lb # [ 27.449047] garage[898]: 2026-11-12T09:18:48.502724Z INFO garage_table::sync: bucket_v2: Completed full sync for ack layout version 1 lb # [ 27.451975] garage[898]: 2026-11-12T09:18:48.502769Z INFO garage_table::sync: bucket_alias: Completed full sync for ack layout version 1 lb # [ 27.455003] garage[898]: 2026-11-12T09:18:48.502790Z INFO garage_table::sync: key: Completed full sync for ack layout version 1 lb # [ 27.457187] garage[898]: 2026-11-12T09:18:48.507681Z INFO garage_table::sync: object: Completed full sync for ack layout version 1 lb # [ 27.459309] garage[898]: 2026-11-12T09:18:48.507709Z INFO garage_table::sync: bucket_object_counter: Completed full sync for ack layout version 1 lb # [ 27.461626] garage[898]: 2026-11-12T09:18:48.507720Z INFO garage_table::sync: multipart_upload: Completed full sync for ack layout version 1 lb # [ 27.465613] garage[898]: 2026-11-12T09:18:48.507729Z INFO garage_table::sync: bucket_mpu_counter: Completed full sync for ack layout version 1 lb # [ 27.467877] garage[898]: 2026-11-12T09:18:48.507739Z INFO garage_table::sync: version: Completed full sync for ack layout version 1 lb # [ 27.470236] garage[898]: 2026-11-12T09:18:48.507749Z INFO garage_table::sync: block_ref: Completed full sync for ack layout version 1 lb # [ 27.472316] garage[898]: 2026-11-12T09:18:48.507759Z INFO garage_table::sync: k2v_item: Completed full sync for ack layout version 1 lb # [ 27.475093] garage[898]: 2026-11-12T09:18:48.507769Z INFO garage_table::sync: k2v_index_counter_v2: Completed full sync for ack layout version 1 lb # [ 27.477246] garage[898]: 2026-11-12T09:18:48.533991Z INFO garage_net::netapp: Connection from 5325ce51c8bc8224 closed lb # [ 27.479096] garage[898]: 2026-11-12T09:18:48.587597Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:52268, negotiating handshake... lb # [ 27.481303] garage[898]: 2026-11-12T09:18:48.588903Z INFO garage_net::netapp: Accepted connection from 91767d51b3e5bf7d at 127.0.0.1:52268 lb # [ 27.483283] garage[898]: 2026-11-12T09:18:48.656964Z INFO garage_net::netapp: Connection from 91767d51b3e5bf7d closed lb # [ 27.487404] garage[898]: 2026-11-12T09:18:48.687756Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:52272, negotiating handshake... lb # [ 27.490064] garage[898]: 2026-11-12T09:18:48.688688Z INFO garage_net::netapp: Accepted connection from 10c652a3d961f98a at 127.0.0.1:52272 lb # [ 27.492268] garage[898]: 2026-11-12T09:18:48.740629Z INFO garage_net::netapp: Connection from 10c652a3d961f98a closed lb # [ 27.494209] garage[898]: 2026-11-12T09:18:48.770855Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:52274, negotiating handshake... lb # [ 27.496464] garage[898]: 2026-11-12T09:18:48.788634Z INFO garage_net::netapp: Accepted connection from dd3e095d6ac2258b at 127.0.0.1:52274 lb # [ 27.501458] garage[898]: 2026-11-12T09:18:48.835960Z INFO garage_net::netapp: Connection from dd3e095d6ac2258b closed worker2 # [ 24.694718] nix-grpc-daemon[791]: ts=2026-11-12T09:18:49Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" lb # [ 27.859493] niks3-server[956]: 2026/11/12 09:18:49 INFO Loaded signing key name=farm-test-1 path=/nix/store/qcn6zbvp2fnqabyy8lxshg7h698xr74x-key lb # [ 27.869669] garage[898]: 2026-11-12T09:18:49.629045Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) GET /farm/?location= lb # [ 27.876728] garage[898]: 2026-11-12T09:18:49.636397Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/nix-cache-info lb # [ 27.882479] garage[898]: 2026-11-12T09:18:49.639738Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 27.884761] garage[898]: 2026-11-12T09:18:49.641873Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) PUT /farm/nix-cache-info lb # [ 27.890683] garage[898]: 2026-11-12T09:18:49.648397Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) GET /farm/?lifecycle=&withUpdatedAt=true lb # [ 27.897435] niks3-server[956]: 2026/11/12 09:18:49 WARN Cannot read the bucket lifecycle configuration; incomplete uploads are only removed by niks3 gc. Add an AbortIncompleteMultipartUpload lifecycle rule to the bucket, or set --abort-incomplete-uploads-days=0 to silence this warning bucket=farm error="The specified bucket does not exist." lb # [ 27.906782] niks3-server[956]: 2026/11/12 09:18:49 INFO Read proxy enabled — serving cache objects from S3 lb # [ 27.910228] niks3-server[956]: 2026/11/12 09:18:49 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 27.911461] niks3-server[956]: 2026/11/12 09:18:49 INFO systemd watchdog enabled interval=15s lb # [ 27.916922] niks3-server[956]: 2026/11/12 09:18:49 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 27.918972] systemd[1]: Started niks3 server. lb # [ 27.919692] systemd[1]: Reached target Multi-User System. lb # [ 27.920953] systemd[1]: Startup finished in 4.831s (kernel) + 4.470s (initrd) + 18.594s (userspace) = 27.896s. [72.64s] lb: (finished: waiting for unit niks3.service, in 7.46 seconds) [72.64s] lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! [72.70s] lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds) [72.70s] lb: waiting for unit envoy.service [72.75s] lb: (finished: waiting for unit envoy.service, in 0.05 seconds) [72.75s] lb: waiting for TCP port 50051 on localhost worker1 # [ 27.512309] nix-grpc-daemon[485]: ts=2026-11-12T09:18:51Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 26.295255] nix-grpc-daemon[791]: ts=2026-11-12T09:18:51Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 29.496635] nix-grpc-daemon[791]: ts=2026-11-12T09:18:54Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker1 # [ 32.513928] nix-grpc-daemon[485]: ts=2026-11-12T09:18:56Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 34.496990] nix-grpc-daemon[791]: ts=2026-11-12T09:18:59Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 37.901067] niks3-server[956]: 2026/11/12 09:18:59 INFO lead: acquired remote=192.168.1.3:33950 worker1 # [ 37.514637] nix-grpc-daemon[485]: ts=2026-11-12T09:19:01Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 41.381208] envoy[897]: [2026-11-12 09:19:03.139][897][warning][config] [source/extensions/config_subscription/grpc/grpc_subscription_impl.cc:152] gRPC config: initial fetch timed out for type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment lb # [ 41.381390] envoy[897]: [2026-11-12 09:19:03.140][897][warning][config] [source/extensions/config_subscription/grpc/grpc_subscription_impl.cc:152] gRPC config: initial fetch timed out for type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment lb # [ 41.381448] envoy[897]: [2026-11-12 09:19:03.140][897][info][upstream] [source/common/upstream/cluster_manager_impl.cc:251] cm init: all clusters initialized lb # [ 41.381555] envoy[897]: [2026-11-12 09:19:03.140][897][info][main] [source/server/server.cc:1078] all clusters initialized. initializing init manager lb # [ 41.402256] envoy[897]: [2026-11-12 09:19:03.160][897][info][config] [source/common/listener_manager/listener_manager_impl.cc:1149] all dependencies initialized. starting workers lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 41.833013] envoy[897]: conn peer=[::1]:34156 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=8 [86.23s] lb: (finished: waiting for TCP port 50051 on localhost, in 13.48 seconds) worker2 # [ 39.095524] systemd[1]: Starting scheduler-token.service... worker2 # [ 39.162668] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 39.167408] systemd[1]: Finished scheduler-token.service. worker2 # [ 39.169458] systemd[1]: scheduler-token.service: Consumed 40ms CPU time over 69ms wall clock time, 3.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. [86.42s] subtest: extraSystems are advertised ??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead. File "/nix/store/81dgbf2d9k9llajgi9597ahypdjn5iam-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 179 worker2 # [ 39.497639] nix-grpc-daemon[791]: ts=2026-11-12T09:19:04Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker1 # [ 42.515559] nix-grpc-daemon[485]: ts=2026-11-12T09:19:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 42.520298] nix-grpc-daemon[485]: ts=2026-11-12T09:19:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 42.721135] nix-grpc-daemon[485]: ts=2026-11-12T09:19:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 42.724251] nix-grpc-daemon[485]: ts=2026-11-12T09:19:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 42.924875] nix-grpc-daemon[485]: ts=2026-11-12T09:19:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 42.927990] nix-grpc-daemon[485]: ts=2026-11-12T09:19:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 43.128741] nix-grpc-daemon[485]: ts=2026-11-12T09:19:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 43.132174] nix-grpc-daemon[485]: ts=2026-11-12T09:19:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 43.332761] nix-grpc-daemon[485]: ts=2026-11-12T09:19:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 43.335969] nix-grpc-daemon[485]: ts=2026-11-12T09:19:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 43.538180] nix-grpc-daemon[485]: ts=2026-11-12T09:19:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 43.540761] nix-grpc-daemon[485]: ts=2026-11-12T09:19:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 43.739323] nix-grpc-daemon[485]: ts=2026-11-12T09:19:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 43.742851] nix-grpc-daemon[485]: ts=2026-11-12T09:19:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 43.943560] nix-grpc-daemon[485]: ts=2026-11-12T09:19:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 43.947093] nix-grpc-daemon[485]: ts=2026-11-12T09:19:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 44.147737] nix-grpc-daemon[485]: ts=2026-11-12T09:19:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 44.151165] nix-grpc-daemon[485]: ts=2026-11-12T09:19:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 44.351986] nix-grpc-daemon[485]: ts=2026-11-12T09:19:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 44.355403] nix-grpc-daemon[485]: ts=2026-11-12T09:19:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 44.557369] nix-grpc-daemon[485]: ts=2026-11-12T09:19:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 44.559729] nix-grpc-daemon[485]: ts=2026-11-12T09:19:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 44.758142] nix-grpc-daemon[485]: ts=2026-11-12T09:19:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 44.761270] nix-grpc-daemon[485]: ts=2026-11-12T09:19:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 44.962094] nix-grpc-daemon[485]: ts=2026-11-12T09:19:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 44.965297] nix-grpc-daemon[485]: ts=2026-11-12T09:19:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 45.165802] nix-grpc-daemon[485]: ts=2026-11-12T09:19:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 45.168915] nix-grpc-daemon[485]: ts=2026-11-12T09:19:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 45.369626] nix-grpc-daemon[485]: ts=2026-11-12T09:19:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 45.373019] nix-grpc-daemon[485]: ts=2026-11-12T09:19:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 45.574729] nix-grpc-daemon[485]: ts=2026-11-12T09:19:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 45.578083] nix-grpc-daemon[485]: ts=2026-11-12T09:19:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 45.778777] nix-grpc-daemon[485]: ts=2026-11-12T09:19:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 45.781876] nix-grpc-daemon[485]: ts=2026-11-12T09:19:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 45.982598] nix-grpc-daemon[485]: ts=2026-11-12T09:19:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 45.985751] nix-grpc-daemon[485]: ts=2026-11-12T09:19:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 44.499097] nix-grpc-daemon[791]: ts=2026-11-12T09:19:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 44.506336] nix-grpc-daemon[791]: ts=2026-11-12T09:19:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 46.186404] nix-grpc-daemon[485]: ts=2026-11-12T09:19:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 46.189524] nix-grpc-daemon[485]: ts=2026-11-12T09:19:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 44.707530] nix-grpc-daemon[791]: ts=2026-11-12T09:19:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 44.711310] nix-grpc-daemon[791]: ts=2026-11-12T09:19:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 46.390128] nix-grpc-daemon[485]: ts=2026-11-12T09:19:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 46.393427] nix-grpc-daemon[485]: ts=2026-11-12T09:19:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 44.912420] nix-grpc-daemon[791]: ts=2026-11-12T09:19:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 44.915843] nix-grpc-daemon[791]: ts=2026-11-12T09:19:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 46.595152] nix-grpc-daemon[485]: ts=2026-11-12T09:19:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 46.597496] nix-grpc-daemon[485]: ts=2026-11-12T09:19:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 46.600964] nix-grpc-daemon[485]: ts=2026-11-12T09:19:10Z level=info event=scheduler_take_over worker2 # [ 45.116910] nix-grpc-daemon[791]: ts=2026-11-12T09:19:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 45.120186] nix-grpc-daemon[791]: ts=2026-11-12T09:19:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 46.796097] nix-grpc-daemon[485]: ts=2026-11-12T09:19:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 46.799496] nix-grpc-daemon[485]: ts=2026-11-12T09:19:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 45.321366] nix-grpc-daemon[791]: ts=2026-11-12T09:19:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 45.324789] nix-grpc-daemon[791]: ts=2026-11-12T09:19:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 47.000425] nix-grpc-daemon[485]: ts=2026-11-12T09:19:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 47.004495] nix-grpc-daemon[485]: ts=2026-11-12T09:19:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 45.526466] nix-grpc-daemon[791]: ts=2026-11-12T09:19:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 45.529629] nix-grpc-daemon[791]: ts=2026-11-12T09:19:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 47.205043] nix-grpc-daemon[485]: ts=2026-11-12T09:19:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 47.216468] nix-grpc-daemon[485]: ts=2026-11-12T09:19:11Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 47.219864] nix-grpc-daemon[485]: ts=2026-11-12T09:19:11Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 45.730682] nix-grpc-daemon[791]: ts=2026-11-12T09:19:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 47.304144] nix-grpc-daemon[485]: ts=2026-11-12T09:19:11Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 47.307982] nix-grpc-daemon[485]: ts=2026-11-12T09:19:11Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:46232 worker1 # [ 47.311385] nix-grpc-daemon[485]: ts=2026-11-12T09:19:11Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux,riscv64-linux max_jobs=1 running=0 [93.16s] (finished: subtest: extraSystems are advertised, in 6.74 seconds) [93.16s] subtest: independent builds running 4 tests worker1 # [ 48.954928] nix-grpc-daemon[485]: ts=2026-11-12T09:19:12Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:46236 lb # [ 50.813666] systemd[1]: Created slice Slice /system/sshd-vsock. lb # [ 50.817745] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 50.822617] systemd[1]: Started SSH per-connection Daemon (vsock:2:0). lb # [ 50.986658] sshd-session[1043]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 50.996285] sshd-session[1043]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 51.008543] sshd-session[1043]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 51.044596] systemd[1]: Created slice Slice /user/0. lb # [ 51.053883] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 51.095110] systemd-logind[499]: New session '1' of user 'root' with class 'user' and type 'tty'. lb # [ 51.114059] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 51.120746] systemd[1]: Starting User Manager for UID 0... lb # [ 51.152632] (systemd)[1052]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 51.163129] systemd-logind[499]: New session '2' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 51.294612] systemd[1052]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 51.441062] systemd[1052]: Queued start job for default target Main User Target. lb # [ 51.449129] systemd[1052]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 51.452195] systemd[1052]: Created slice User Application Slice. lb # [ 51.455044] systemd[1052]: Started Daily Cleanup of User's Temporary Directories. lb # [ 51.458279] systemd[1052]: Reached target Paths. lb # [ 51.459055] systemd[1052]: Reached target Timers. lb # [ 51.459752] systemd[1052]: Starting D-Bus User Message Bus Socket... lb # [ 51.462670] systemd[1052]: Starting Create User Files and Directories... lb # [ 51.518469] systemd[1052]: Finished Create User Files and Directories. lb # [ 51.566916] systemd[1052]: Listening on D-Bus User Message Bus Socket. lb # [ 51.572505] systemd[1052]: Reached target Sockets. lb # [ 51.573530] systemd[1052]: Reached target Basic System. lb # [ 51.574513] systemd[1052]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 51.577731] systemd[1052]: Reached target Main User Target. lb # [ 51.578724] systemd[1052]: Startup finished in 381ms. lb # [ 51.579590] systemd[1]: Started User Manager for UID 0. lb # [ 51.583487] systemd[1]: Started Session 1 of User root. lb # [ 51.605209] sshd-session[1066]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 51.608124] sshd-session[1066]: Disconnected from user root UNKNOWN port 65535 lb # [ 51.609545] sshd-session[1043]: pam_unix(sshd:session): session closed for user root lb # [ 51.614175] systemd[1]: sshd-vsock@0-1-4:22-2:0.service: Deactivated successfully. lb # [ 51.618540] systemd[1]: session-1.scope: Deactivated successfully. lb # [ 51.623131] systemd-logind[499]: Session 1 logged out. Waiting for processes to exit. lb # [ 51.625862] systemd-logind[499]: Removed session 1. worker1 # [ 50.383910] nix-grpc-daemon[485]: ts=2026-11-12T09:19:14Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:46236 lb # [ 52.307866] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 52.315684] systemd[1]: Started SSH per-connection Daemon (vsock:2:1). lb # [ 52.412478] sshd-session[1071]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 52.422392] sshd-session[1071]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 52.431238] sshd-session[1071]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 52.442488] systemd-logind[499]: New session '3' of user 'root' with class 'user' and type 'tty'. lb # [ 52.452122] systemd[1]: Started Session 3 of User root. lb # [ 52.510260] sshd-session[1077]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 52.511863] sshd-session[1077]: Disconnected from user root UNKNOWN port 65535 lb # [ 52.514214] sshd-session[1071]: pam_unix(sshd:session): session closed for user root lb # [ 52.518272] systemd[1]: sshd-vsock@1-2-4:22-2:1.service: Deactivated successfully. lb # [ 52.523924] systemd[1]: session-3.scope: Deactivated successfully. lb # [ 52.527688] systemd[1]: session-3.scope: Consumed 36ms CPU time over 76ms wall clock time, 5.6M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 52.532899] systemd-logind[499]: Session 3 logged out. Waiting for processes to exit. lb # [ 52.534254] systemd-logind[499]: Removed session 3. lb # [ 54.381981] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 54.391008] systemd[1]: Started SSH per-connection Daemon (vsock:2:2). lb # [ 54.487141] sshd-session[1082]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 54.495596] sshd-session[1082]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 54.504170] sshd-session[1082]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 54.515064] systemd-logind[499]: New session '4' of user 'root' with class 'user' and type 'tty'. lb # [ 54.521491] systemd[1]: Started Session 4 of User root. lb # [ 54.556130] sshd-session[1088]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 54.558505] sshd-session[1088]: Disconnected from user root UNKNOWN port 65535 lb # [ 54.560127] sshd-session[1082]: pam_unix(sshd:session): session closed for user root lb # [ 54.564246] systemd[1]: sshd-vsock@2-3-4:22-2:2.service: Deactivated successfully. lb # [ 54.569000] systemd[1]: session-4.scope: Deactivated successfully. lb # [ 54.570823] systemd[1]: session-4.scope: Consumed 27ms CPU time over 49ms wall clock time, 4.8M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 54.576717] systemd-logind[499]: Session 4 logged out. Waiting for processes to exit. lb # [ 54.577911] systemd-logind[499]: Removed session 4. worker1 # [ 53.473486] systemd[1]: Created slice Slice /system/sshd-vsock. worker1 # [ 53.476657] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 53.483643] systemd[1]: Started SSH per-connection Daemon (vsock:2:0). worker1 # [ 53.624763] sshd-session[923]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 53.635636] sshd-session[923]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 53.646679] sshd-session[923]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 53.677644] systemd-logind[539]: New session '1' of user 'root' with class 'user' and type 'tty'. worker1 # [ 53.684647] systemd[1]: Created slice Slice /user/0. worker1 # [ 53.692526] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 53.730764] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 53.739808] systemd[1]: Starting User Manager for UID 0... worker1 # [ 53.769070] (systemd)[931]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 53.776701] systemd-logind[539]: New session '2' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 53.873423] systemd[931]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 54.004531] systemd[931]: Queued start job for default target Main User Target. worker1 # [ 54.013242] systemd[931]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 54.017962] systemd[931]: Created slice User Application Slice. worker1 # [ 54.021169] systemd[931]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 54.022404] systemd[931]: Reached target Paths. worker1 # [ 54.023082] systemd[931]: Reached target Timers. worker1 # [ 54.023786] systemd[931]: Starting D-Bus User Message Bus Socket... worker1 # [ 54.028555] systemd[931]: Starting Create User Files and Directories... worker1 # [ 54.078201] systemd[931]: Finished Create User Files and Directories. worker1 # [ 54.126076] systemd[931]: Listening on D-Bus User Message Bus Socket. worker1 # [ 54.127386] systemd[931]: Reached target Sockets. worker1 # [ 54.132777] systemd[931]: Reached target Basic System. worker1 # [ 54.133788] systemd[931]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 54.135478] systemd[931]: Reached target Main User Target. worker1 # [ 54.140690] systemd[931]: Startup finished in 331ms. worker1 # [ 54.143785] systemd[1]: Started User Manager for UID 0. worker1 # [ 54.145599] systemd[1]: Started Session 1 of User root. worker1 # [ 54.166658] sshd-session[944]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 54.168416] sshd-session[944]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 54.170658] sshd-session[923]: pam_unix(sshd:session): session closed for user root worker1 # [ 54.175726] systemd[1]: sshd-vsock@0-1-5:22-2:0.service: Deactivated successfully. worker1 # [ 54.181448] systemd[1]: session-1.scope: Deactivated successfully. worker1 # [ 54.186556] systemd-logind[539]: Session 1 logged out. Waiting for processes to exit. worker1 # [ 54.189300] systemd-logind[539]: Removed session 1. worker1 # [ 54.996293] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 54.999959] systemd[1]: Started SSH per-connection Daemon (vsock:2:1). worker1 # [ 55.095509] sshd-session[949]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 55.104755] sshd-session[949]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 55.115657] sshd-session[949]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 55.128639] systemd-logind[539]: New session '3' of user 'root' with class 'user' and type 'tty'. worker1 # [ 55.132574] systemd[1]: Started Session 3 of User root. worker1 # [ 55.189493] sshd-session[955]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 55.192457] sshd-session[955]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 55.194001] sshd-session[949]: pam_unix(sshd:session): session closed for user root worker1 # [ 55.198474] systemd[1]: sshd-vsock@1-2-5:22-2:1.service: Deactivated successfully. worker1 # [ 55.204211] systemd[1]: session-3.scope: Deactivated successfully. worker1 # [ 55.208734] systemd[1]: session-3.scope: Consumed 37ms CPU time over 73ms wall clock time, 3.3M memory peak, 4.1K incoming IP traffic, 509B outgoing IP traffic. worker1 # [ 55.211662] systemd-logind[539]: Session 3 logged out. Waiting for processes to exit. worker1 # [ 55.214613] systemd-logind[539]: Removed session 3. worker1 # [ 55.405939] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 55.416523] systemd[1]: Started SSH per-connection Daemon (vsock:2:2). worker1 # [ 55.424932] systemd[1]: Started SSH per-connection Daemon (vsock:2:3). worker1 # [ 55.431096] systemd[1]: Started SSH per-connection Daemon (vsock:2:4). worker1 # [ 55.645296] sshd-session[962]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 55.650825] sshd-session[960]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 55.657086] sshd-session[961]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 55.664582] sshd-session[962]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 55.672647] sshd-session[960]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 55.675879] sshd-session[961]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 55.685175] sshd-session[962]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 55.700832] systemd-logind[539]: New session '4' of user 'root' with class 'user' and type 'tty'. worker1 # [ 55.708116] sshd-session[961]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 55.709484] systemd[1]: Started Session 4 of User root. worker1 # [ 55.719430] sshd-session[960]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 55.729009] systemd-logind[539]: New session '5' of user 'root' with class 'user' and type 'tty'. worker1 # [ 55.737330] systemd[1]: Started Session 5 of User root. worker1 # [ 55.744483] systemd-logind[539]: New session '6' of user 'root' with class 'user' and type 'tty'. worker1 # [ 55.753185] systemd[1]: Started Session 6 of User root. worker1 # [ 55.804522] sshd-session[978]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 55.807737] sshd-session[978]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 55.810829] sshd-session[962]: pam_unix(sshd:session): session closed for user root worker1 # [ 55.820882] systemd[1]: sshd-vsock@4-5-5:22-2:4.service: Deactivated successfully. worker1 # [ 55.826914] systemd[1]: session-4.scope: Deactivated successfully. worker1 # [ 55.835393] systemd-logind[539]: Session 4 logged out. Waiting for processes to exit. worker1 # [ 55.847931] systemd-logind[539]: Removed session 4. worker1 # [ 55.855937] sshd-session[982]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 55.859611] sshd-session[982]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 55.863572] sshd-session[981]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 55.866724] sshd-session[981]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 55.867775] sshd-session[960]: pam_unix(sshd:session): session closed for user root worker1 # [ 55.869215] sshd-session[961]: pam_unix(sshd:session): session closed for user root worker1 # [ 55.871436] systemd[1]: sshd-vsock@2-3-5:22-2:2.service: Deactivated successfully. worker1 # [ 55.876246] systemd[1]: sshd-vsock@3-4-5:22-2:3.service: Deactivated successfully. worker1 # [ 55.881526] systemd[1]: session-5.scope: Deactivated successfully. worker1 # [ 55.884274] systemd[1]: session-6.scope: Deactivated successfully. worker1 # [ 55.888959] systemd-logind[539]: Session 6 logged out. Waiting for processes to exit. worker1 # [ 55.891073] systemd-logind[539]: Removed session 6. worker1 # [ 55.893433] systemd-logind[539]: Session 5 logged out. Waiting for processes to exit. worker1 # [ 55.895278] systemd-logind[539]: Removed session 5. worker2 # [ 55.855849] systemd[1]: Created slice Slice /system/sshd-vsock. worker2 # [ 55.858514] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 55.866250] systemd[1]: Started SSH per-connection Daemon (vsock:2:0). worker2 # [ 55.995789] sshd-session[908]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 56.005810] sshd-session[908]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 56.016209] sshd-session[908]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 56.044678] systemd[1]: Created slice Slice /user/0. worker2 # [ 56.049837] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 56.063128] systemd-logind[515]: New session '1' of user 'root' with class 'user' and type 'tty'. worker2 # [ 56.097910] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 56.105918] systemd[1]: Starting User Manager for UID 0... worker2 # [ 56.136243] (systemd)[916]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 56.142459] systemd-logind[515]: New session '2' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 56.239763] systemd[916]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 56.361035] systemd[916]: Queued start job for default target Main User Target. worker2 # [ 56.369500] systemd[916]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 56.374019] systemd[916]: Created slice User Application Slice. worker2 # [ 56.375076] systemd[916]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 56.378753] systemd[916]: Reached target Paths. worker2 # [ 56.379522] systemd[916]: Reached target Timers. worker2 # [ 56.381329] systemd[916]: Starting D-Bus User Message Bus Socket... worker2 # [ 56.383881] systemd[916]: Starting Create User Files and Directories... worker2 # [ 56.436832] systemd[916]: Finished Create User Files and Directories. worker2 # [ 56.480169] systemd[916]: Listening on D-Bus User Message Bus Socket. worker2 # [ 56.481449] systemd[916]: Reached target Sockets. worker2 # [ 56.482374] systemd[916]: Reached target Basic System. worker2 # [ 56.483315] systemd[916]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 56.489853] systemd[916]: Reached target Main User Target. worker2 # [ 56.490908] systemd[916]: Startup finished in 318ms. worker2 # [ 56.491786] systemd[1]: Started User Manager for UID 0. worker2 # [ 56.497389] systemd[1]: Started Session 1 of User root. worker2 # [ 56.518423] sshd-session[929]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 56.521526] sshd-session[929]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 56.523104] sshd-session[908]: pam_unix(sshd:session): session closed for user root worker2 # [ 56.527965] systemd[1]: sshd-vsock@0-1-6:22-2:0.service: Deactivated successfully. worker2 # [ 56.533744] systemd[1]: session-1.scope: Deactivated successfully. worker2 # [ 56.538324] systemd-logind[515]: Session 1 logged out. Waiting for processes to exit. worker2 # [ 56.541350] systemd-logind[515]: Removed session 1. worker2 # [ 57.374060] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 57.382667] systemd[1]: Started SSH per-connection Daemon (vsock:2:1). worker2 # [ 57.392812] systemd[1]: Started SSH per-connection Daemon (vsock:2:2). worker2 # [ 57.397927] systemd[1]: Started SSH per-connection Daemon (vsock:2:3). worker2 # [ 57.610706] sshd-session[936]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 57.617557] sshd-session[934]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 57.619579] sshd-session[935]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 57.630581] sshd-session[936]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 57.633551] sshd-session[934]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 57.642043] sshd-session[935]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 57.655231] sshd-session[936]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 57.659823] sshd-session[934]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 57.663464] sshd-session[935]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 57.673584] systemd-logind[515]: New session '3' of user 'root' with class 'user' and type 'tty'. worker2 # [ 57.684508] systemd[1]: Started Session 3 of User root. worker2 # [ 57.691252] systemd-logind[515]: New session '5' of user 'root' with class 'user' and type 'tty'. worker2 # [ 57.695908] systemd[1]: Started Session 5 of User root. worker2 # [ 57.700209] systemd-logind[515]: New session '4' of user 'root' with class 'user' and type 'tty'. worker2 # [ 57.704600] systemd[1]: Started Session 4 of User root. worker2 # [ 57.791885] sshd-session[952]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 57.795703] sshd-session[952]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 57.802686] sshd-session[936]: pam_unix(sshd:session): session closed for user root worker2 # [ 57.806045] sshd-session[953]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 57.807430] sshd-session[953]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 57.811411] sshd-session[954]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 57.815617] sshd-session[954]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 57.818807] systemd[1]: sshd-vsock@3-4-6:22-2:3.service: Deactivated successfully. worker2 # [ 57.819968] sshd-session[934]: pam_unix(sshd:session): session closed for user root worker2 # [ 57.828955] systemd[1]: session-3.scope: Deactivated successfully. worker2 # [ 57.830014] sshd-session[935]: pam_unix(sshd:session): session closed for user root worker2 # [ 57.831106] systemd-logind[515]: Session 3 logged out. Waiting for processes to exit. worker2 # [ 57.833922] systemd-logind[515]: Removed session 3. worker2 # [ 57.836725] systemd[1]: sshd-vsock@1-2-6:22-2:1.service: Deactivated successfully. worker2 # [ 57.839559] systemd[1]: session-4.scope: Deactivated successfully. worker2 # [ 57.845006] systemd[1]: sshd-vsock@2-3-6:22-2:2.service: Deactivated successfully. worker2 # [ 57.847697] systemd[1]: session-5.scope: Deactivated successfully. worker2 # [ 57.851597] systemd-logind[515]: Session 4 logged out. Waiting for processes to exit. worker2 # [ 57.855369] systemd-logind[515]: Removed session 4. worker2 # [ 57.857385] systemd-logind[515]: Session 5 logged out. Waiting for processes to exit. worker2 # [ 57.859372] systemd-logind[515]: Removed session 5. lb # [ 64.281265] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 64.288926] systemd[1]: Started SSH per-connection Daemon (vsock:2:3). lb # [ 64.298555] systemd[1]: Started SSH per-connection Daemon (vsock:2:4). lb # [ 64.307741] systemd[1]: Started SSH per-connection Daemon (vsock:2:5). lb # [ 64.513274] sshd-session[1094]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 64.519550] sshd-session[1095]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 64.527638] sshd-session[1093]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 64.535121] sshd-session[1094]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 64.540266] sshd-session[1093]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 64.546926] sshd-session[1095]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 64.554171] sshd-session[1095]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 64.560272] sshd-session[1094]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 64.561736] sshd-session[1093]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 64.571727] systemd-logind[499]: New session '5' of user 'root' with class 'user' and type 'tty'. lb # [ 64.580499] systemd[1]: Started Session 5 of User root. lb # [ 64.585050] systemd-logind[499]: New session '7' of user 'root' with class 'user' and type 'tty'. lb # [ 64.591074] systemd[1]: Started Session 7 of User root. lb # [ 64.595767] systemd-logind[499]: New session '6' of user 'root' with class 'user' and type 'tty'. lb # [ 64.599871] systemd[1]: Started Session 6 of User root. lb # [ 64.698555] sshd-session[1111]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 64.701194] sshd-session[1111]: Disconnected from user root UNKNOWN port 65535 lb # [ 64.706060] sshd-session[1095]: pam_unix(sshd:session): session closed for user root lb # [ 64.712923] sshd-session[1113]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 64.714477] sshd-session[1113]: Disconnected from user root UNKNOWN port 65535 lb # [ 64.718142] sshd-session[1114]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 64.719501] systemd[1]: sshd-vsock@5-6-4:22-2:5.service: Deactivated successfully. lb # [ 64.723833] sshd-session[1114]: Disconnected from user root UNKNOWN port 65535 lb # [ 64.727109] systemd[1]: session-5.scope: Deactivated successfully. lb # [ 64.732512] sshd-session[1093]: pam_unix(sshd:session): session closed for user root lb # [ 64.733711] systemd[1]: session-5.scope: Consumed 30ms CPU time over 142ms wall clock time, 2.9M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 64.735610] sshd-session[1094]: pam_unix(sshd:session): session closed for user root lb # [ 64.739239] systemd-logind[499]: Session 5 logged out. Waiting for processes to exit. lb # [ 64.740578] systemd-logind[499]: Removed session 5. lb # [ 64.742410] systemd[1]: sshd-vsock@3-4-4:22-2:3.service: Deactivated successfully. lb # [ 64.746271] systemd[1]: sshd-vsock@4-5-4:22-2:4.service: Deactivated successfully. lb # [ 64.751451] systemd[1]: session-6.scope: Deactivated successfully. lb # [ 64.756362] systemd[1]: session-6.scope: Consumed 28ms CPU time over 154ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 64.758431] systemd[1]: session-7.scope: Deactivated successfully. lb # [ 64.759321] systemd[1]: session-7.scope: Consumed 29ms CPU time over 165ms wall clock time, 3M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 64.763747] systemd-logind[499]: Session 7 logged out. Waiting for processes to exit. lb # [ 64.767084] systemd-logind[499]: Removed session 7. lb # [ 64.767882] systemd-logind[499]: Session 6 logged out. Waiting for processes to exit. lb # [ 64.770037] systemd-logind[499]: Removed session 6. worker1 # [ 65.696858] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 65.702749] systemd[1]: Started SSH per-connection Daemon (vsock:2:5). worker1 # [ 65.707569] systemd[1]: Started SSH per-connection Daemon (vsock:2:6). worker1 # [ 65.713423] systemd[1]: Started SSH per-connection Daemon (vsock:2:7). worker1 # [ 65.913107] sshd-session[998]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 65.918526] sshd-session[996]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 65.922749] sshd-session[997]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 65.932471] sshd-session[998]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 65.935808] sshd-session[996]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 65.942478] sshd-session[997]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 65.957745] sshd-session[996]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 65.962098] sshd-session[998]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 65.970390] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 65.971382] sshd-session[997]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 65.980841] systemd[931]: Activating special unit Exit the Session... worker1 # [ 65.982036] systemd[931]: Stopped target Main User Target. worker1 # [ 65.982853] systemd[931]: Stopped target Basic System. worker1 # [ 65.983615] systemd[931]: Stopped target Paths. worker1 # [ 65.987842] systemd[931]: Stopped target Sockets. worker1 # [ 65.992474] systemd[931]: Stopped target Timers. worker1 # [ 65.993274] systemd[931]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 65.994396] systemd[931]: Closed D-Bus User Message Bus Socket. worker1 # [ 65.995252] systemd[931]: Stopped Create User Files and Directories. worker1 # [ 66.000307] systemd[931]: Removed slice User Application Slice. worker1 # [ 66.001295] systemd[931]: Reached target Shutdown. worker1 # [ 66.002141] systemd[931]: Finished Exit the Session. worker1 # [ 66.002873] systemd[931]: Reached target Exit the Session. worker1 # [ 66.003970] systemd-logind[539]: New session '7' of user 'root' with class 'user' and type 'tty'. worker1 # [ 66.011561] systemd-logind[539]: New session '8' of user 'root' with class 'user' and type 'tty'. worker1 # [ 66.014713] systemd-logind[539]: New session '9' of user 'root' with class 'user' and type 'tty'. worker1 # [ 66.021169] systemd-logind[539]: Removed session 2. worker1 # [ 66.026869] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 66.032353] systemd[1]: Starting User Manager for UID 0... worker1 # [ 66.058493] (systemd)[1016]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 66.063993] systemd-logind[539]: New session '10' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 66.155775] systemd[1016]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 66.260332] systemd[1016]: Queued start job for default target Main User Target. worker1 # [ 66.269030] systemd[1016]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 66.272112] systemd[1016]: Created slice User Application Slice. worker1 # [ 66.273149] systemd[1016]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 66.275943] systemd[1016]: Reached target Paths. worker1 # [ 66.278607] systemd[1016]: Reached target Timers. worker1 # [ 66.279373] systemd[1016]: Starting D-Bus User Message Bus Socket... worker1 # [ 66.281875] systemd[1016]: Starting Create User Files and Directories... worker1 # [ 66.328816] systemd[1016]: Finished Create User Files and Directories. worker1 # [ 66.333161] systemd[1016]: Listening on D-Bus User Message Bus Socket. worker1 # [ 66.335558] systemd[1016]: Reached target Sockets. worker1 # [ 66.338524] systemd[1016]: Reached target Basic System. worker1 # [ 66.339335] systemd[1016]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 66.342211] systemd[1016]: Reached target Main User Target. worker1 # [ 66.343077] systemd[1016]: Startup finished in 254ms. worker1 # [ 66.343811] systemd[1]: Started User Manager for UID 0. worker1 # [ 66.350569] systemd[1]: Started Session 7 of User root. worker1 # [ 66.351415] systemd[1]: Started Session 8 of User root. worker1 # [ 66.359078] systemd[1]: Started Session 9 of User root. worker1 # [ 66.439162] sshd-session[1030]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 66.442662] sshd-session[1030]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 66.446078] sshd-session[1029]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 66.447590] sshd-session[1029]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 66.450449] sshd-session[998]: pam_unix(sshd:session): session closed for user root worker1 # [ 66.451566] sshd-session[996]: pam_unix(sshd:session): session closed for user root worker1 # [ 66.456959] systemd[1]: sshd-vsock@7-8-5:22-2:7.service: Deactivated successfully. worker1 # [ 66.462756] systemd[1]: session-8.scope: Deactivated successfully. worker1 # [ 66.466482] sshd-session[1032]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 66.467835] sshd-session[1032]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 66.472456] sshd-session[997]: pam_unix(sshd:session): session closed for user root worker1 # [ 66.473649] systemd[1]: session-8.scope: Consumed 27ms CPU time over 121ms wall clock time, 4.7M memory peak, 4.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 66.475591] systemd[1]: sshd-vsock@5-6-5:22-2:5.service: Deactivated successfully. worker1 # [ 66.482738] systemd[1]: session-7.scope: Deactivated successfully. worker1 # [ 66.483706] systemd[1]: session-7.scope: Consumed 28ms CPU time over 133ms wall clock time, 3M memory peak, 4.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 66.486109] systemd-logind[539]: Session 8 logged out. Waiting for processes to exit. worker1 # [ 66.487643] systemd-logind[539]: Removed session 8. worker1 # [ 66.490082] systemd-logind[539]: Session 7 logged out. Waiting for processes to exit. worker1 # [ 66.493604] systemd-logind[539]: Removed session 7. worker1 # [ 66.496761] systemd[1]: sshd-vsock@6-7-5:22-2:6.service: Deactivated successfully. worker1 # [ 66.501620] systemd[1]: session-9.scope: Deactivated successfully. worker1 # [ 66.503369] systemd[1]: session-9.scope: Consumed 28ms CPU time over 150ms wall clock time, 5.1M memory peak, 4.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 66.509298] systemd-logind[539]: Session 9 logged out. Waiting for processes to exit. worker1 # [ 66.510532] systemd-logind[539]: Removed session 9. worker2 # [ 68.085197] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 68.091493] systemd[916]: Activating special unit Exit the Session... worker2 # [ 68.096444] systemd[916]: Stopped target Main User Target. worker2 # [ 68.097751] systemd[916]: Stopped target Basic System. worker2 # [ 68.098973] systemd[916]: Stopped target Paths. worker2 # [ 68.105629] systemd[916]: Stopped target Sockets. worker2 # [ 68.106901] systemd[916]: Stopped target Timers. worker2 # [ 68.108266] systemd[916]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 68.109952] systemd[916]: Closed D-Bus User Message Bus Socket. worker2 # [ 68.111303] systemd[916]: Stopped Create User Files and Directories. worker2 # [ 68.113062] systemd[916]: Removed slice User Application Slice. worker2 # [ 68.114426] systemd[916]: Reached target Shutdown. worker2 # [ 68.115570] systemd[916]: Finished Exit the Session. worker2 # [ 68.116989] systemd[916]: Reached target Exit the Session. worker2 # [ 68.141971] systemd-logind[515]: Removed session 2. worker2 # [ 68.146526] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 68.148892] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 68.167251] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 68.206947] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 68.211787] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 68.216725] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 72.579452] systemd[1]: Created slice Slice /system/sshd-vsock. client # [ 72.584359] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 72.588472] systemd[1]: Started SSH per-connection Daemon (vsock:2:0). client # [ 72.717735] sshd-session[748]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 72.728636] sshd-session[748]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 72.738309] sshd-session[748]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 72.772077] systemd[1]: Created slice Slice /user/0. client # [ 72.776910] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 72.819500] systemd-logind[427]: New session '1' of user 'root' with class 'user' and type 'tty'. client # [ 72.831290] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 72.837474] systemd[1]: Starting User Manager for UID 0... client # [ 72.869496] (systemd)[757]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 72.875780] systemd-logind[427]: New session '2' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 72.965782] systemd[757]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 73.081806] systemd[757]: Queued start job for default target Main User Target. client # [ 73.089505] systemd[757]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 73.093043] systemd[757]: Created slice User Application Slice. client # [ 73.095573] systemd[757]: Started Daily Cleanup of User's Temporary Directories. client # [ 73.099305] systemd[757]: Reached target Paths. client # [ 73.100120] systemd[757]: Reached target Timers. client # [ 73.100833] systemd[757]: Starting D-Bus User Message Bus Socket... client # [ 73.103372] systemd[757]: Starting Create User Files and Directories... client # [ 73.146738] systemd[757]: Finished Create User Files and Directories. client # [ 73.194176] systemd[757]: Listening on D-Bus User Message Bus Socket. client # [ 73.200133] systemd[757]: Reached target Sockets. client # [ 73.201297] systemd[757]: Reached target Basic System. client # [ 73.202286] systemd[757]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 73.204755] systemd[757]: Reached target Main User Target. client # [ 73.205931] systemd[1]: Started User Manager for UID 0. client # [ 73.206908] systemd[757]: Startup finished in 305ms. client # [ 73.214935] systemd[1]: Started Session 1 of User root. client # [ 73.232935] sshd-session[770]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 73.236057] sshd-session[770]: Disconnected from user root UNKNOWN port 65535 client # [ 73.238117] sshd-session[748]: pam_unix(sshd:session): session closed for user root client # [ 73.242328] systemd[1]: sshd-vsock@0-1-3:22-2:0.service: Deactivated successfully. client # [ 73.247177] systemd[1]: session-1.scope: Deactivated successfully. client # [ 73.251306] systemd-logind[427]: Session 1 logged out. Waiting for processes to exit. client # [ 73.254130] systemd-logind[427]: Removed session 1. lb # [ 74.806818] systemd[1]: Stopping User Manager for UID 0... lb # [ 74.813970] systemd[1052]: Activating special unit Exit the Session... lb # [ 74.819999] systemd[1052]: Stopped target Main User Target. lb # [ 74.821515] systemd[1052]: Stopped target Basic System. lb # [ 74.824910] systemd[1052]: Stopped target Paths. lb # [ 74.826076] systemd[1052]: Stopped target Sockets. lb # [ 74.827235] systemd[1052]: Stopped target Timers. lb # [ 74.829669] systemd[1052]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 74.831337] systemd[1052]: Closed D-Bus User Message Bus Socket. lb # [ 74.833795] systemd[1052]: Stopped Create User Files and Directories. lb # [ 74.835277] systemd[1052]: Removed slice User Application Slice. lb # [ 74.836849] systemd[1052]: Reached target Shutdown. lb # [ 74.838103] systemd[1052]: Finished Exit the Session. lb # [ 74.839276] systemd[1052]: Reached target Exit the Session. lb # [ 74.857667] systemd-logind[499]: Removed session 2. lb # [ 74.865288] systemd[1]: user@0.service: Deactivated successfully. lb # [ 74.870138] systemd[1]: Stopped User Manager for UID 0. lb # [ 74.934917] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 74.973151] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 74.978852] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 74.982374] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 74.438222] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 74.448483] systemd[1]: Started SSH per-connection Daemon (vsock:2:1). client # [ 74.461048] systemd[1]: Started SSH per-connection Daemon (vsock:2:2). client # [ 74.462691] systemd[1]: Started SSH per-connection Daemon (vsock:2:3). client # [ 74.664309] sshd-session[775]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 74.671621] sshd-session[777]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 74.681463] sshd-session[776]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 74.683211] sshd-session[775]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 74.693295] sshd-session[777]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 74.694523] sshd-session[776]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 74.704097] sshd-session[777]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 74.711320] sshd-session[775]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 74.720229] sshd-session[776]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 74.722034] systemd-logind[427]: New session '3' of user 'root' with class 'user' and type 'tty'. client # [ 74.735647] systemd[1]: Started Session 3 of User root. client # [ 74.741099] systemd-logind[427]: New session '4' of user 'root' with class 'user' and type 'tty'. client # [ 74.743639] systemd[1]: Started Session 4 of User root. client # [ 74.750737] systemd-logind[427]: New session '5' of user 'root' with class 'user' and type 'tty'. client # [ 74.754822] systemd[1]: Started Session 5 of User root. client # [ 75.262291] systemd[1]: Started Nix Daemon. worker1 # [ 75.413010] nix-grpc-daemon[485]: ts=2026-11-12T09:19:39Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36426 worker2 # [ 73.888915] nix-grpc-daemon[791]: ts=2026-11-12T09:19:39Z level=debug event=rpc_start method=Connect cn=ci-1 peer=ipv4:192.168.1.2:43368 worker2 # [ 73.893878] systemd[1]: Started Nix Daemon. worker2 # [ 74.053289] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) client # [ 75.613105] nix-daemon[813]: accepted connection from pid 801, user root (trusted) worker2 # [ 74.121370] nix-grpc-daemon[791]: ts=2026-11-12T09:19:39Z level=info event=rpc method=Connect cn=ci-1 peer=ipv4:192.168.1.2:43368 duration_s=0 bytes_in=232 bytes_out=184 worker2 # [ 74.125359] nix-daemon[976]: reaped child process 978, status = succeeded client # [ 75.729662] sshd-session[793]: Received disconnect from UNKNOWN port 65535:11: disconnected by user test farm::independent::a_system_without_builders_is_served_by_the_default_one ... ok client # [ 75.740234] sshd-session[793]: Disconnected from user root UNKNOWN port 65535 client # [ 75.741752] sshd-session[777]: pam_unix(sshd:session): session closed for user root client # [ 75.763952] systemd[1]: sshd-vsock@3-4-3:22-2:3.service: Deactivated successfully. client # [ 75.768799] systemd[1]: session-3.scope: Deactivated successfully. client # [ 75.769859] systemd[1]: session-3.scope: Consumed 234ms CPU time over 1.027s wall clock time, 42M memory peak, 6.3K incoming IP traffic, 5K outgoing IP traffic. client # [ 75.779482] systemd-logind[427]: Session 3 logged out. Waiting for processes to exit. client # [ 75.788291] systemd-logind[427]: Removed session 3. client # [ 75.853182] sshd-session[796]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 75.854766] sshd-session[796]: Disconnected from user root UNKNOWN port 65535 client # [ 75.857379] sshd-session[776]: pam_unix(sshd:session): session closed for user root client # [ 75.862214] systemd[1]: sshd-vsock@2-3-3:22-2:2.service: Deactivated successfully. client # [ 75.865832] systemd[1]: session-5.scope: Deactivated successfully. client # [ 75.871661] systemd-logind[427]: Session 5 logged out. Waiting for processes to exit. client # [ 75.875957] systemd-logind[427]: Removed session 5. worker2 # [ 74.422265] nix-grpc-daemon[791]: ts=2026-11-12T09:19:39Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43368 worker2 # [ 74.429000] nix-grpc-daemon[791]: ts=2026-11-12T09:19:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43368 worker2 # [ 74.437195] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) client # [ 76.012232] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 76.017476] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 76.017983] systemd[1]: Started SSH per-connection Daemon (vsock:2:4). worker1 # [ 76.026313] systemd[1]: Started SSH per-connection Daemon (vsock:2:8). worker2 # [ 74.473820] nix-grpc-daemon[791]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 1/5) lb # [ 77.330468] garage[898]: 2026-11-12T09:19:39.088199Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/nix-cache-info lb # [ 77.335427] garage[898]: 2026-11-12T09:19:39.094872Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) GET /farm/nix-cache-info worker2 # [ 74.539714] nix-grpc-daemon[791]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 2/5) worker2 # [ 74.546991] nix-grpc-daemon[791]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 3/5) client # [ 76.100495] sshd-session[841]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 76.108175] sshd-session[841]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 76.116613] sshd-session[1045]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 76.114968] sshd-session[841]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 76.123830] sshd-session[1045]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 76.122478] systemd-logind[427]: New session '6' of user 'root' with class 'user' and type 'tty'. client # [ 76.129538] systemd[1]: Started Session 6 of User root. worker1 # [ 76.133828] sshd-session[1045]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 76.144762] systemd-logind[539]: New session '11' of user 'root' with class 'user' and type 'tty'. worker1 # [ 76.148566] systemd[1]: Started Session 11 of User root. worker2 # [ 74.591533] nix-grpc-daemon[791]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 244 ms (attempt 4/5) worker1 # [ 76.181328] sshd-session[1051]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 76.182844] sshd-session[1051]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 76.184411] sshd-session[1045]: pam_unix(sshd:session): session closed for user root worker1 # [ 76.189629] systemd[1]: sshd-vsock@8-9-5:22-2:8.service: Deactivated successfully. worker1 # [ 76.194704] systemd[1]: session-11.scope: Deactivated successfully. worker1 # [ 76.199788] systemd-logind[539]: Session 11 logged out. Waiting for processes to exit. worker1 # [ 76.202717] systemd-logind[539]: Removed session 11. client # [ 76.286070] sshd-session[847]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 76.287959] sshd-session[847]: Disconnected from user root UNKNOWN port 65535 client # [ 76.290317] sshd-session[841]: pam_unix(sshd:session): session closed for user root client # [ 76.294467] systemd[1]: sshd-vsock@4-5-3:22-2:4.service: Deactivated successfully. client # [ 76.298824] systemd[1]: session-6.scope: Deactivated successfully. client # [ 76.303038] systemd-logind[427]: Session 6 logged out. Waiting for processes to exit. client # [ 76.305537] systemd-logind[427]: Removed session 6. worker2 # [ 74.837922] nix-grpc-daemon[791]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 74.841059] nix-grpc-daemon[791]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 74.849511] nix-grpc-daemon[791]: ts=2026-11-12T09:19:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 77.708733] garage[898]: 2026-11-12T09:19:39.467937Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo lb # [ 77.713917] garage[898]: 2026-11-12T09:19:39.468463Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 74.868099] nix-grpc-daemon[791]: ts=2026-11-12T09:19:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43368 worker2 # [ 74.878953] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) worker2 # [ 74.902963] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) worker2 # [ 74.921829] nix-grpc-daemon[791]: ts=2026-11-12T09:19:40Z level=info event=niks3_push_started pid=992 worker2 # [ 75.197484] nix-grpc-daemon[992]: time=2026-11-12T09:19:40.469Z level=INFO msg="Configuring client TLS" cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker2.pem key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker2.key ca="" worker2 # [ 75.342028] nix-daemon[976]: accepted connection from pid 1005, user nix-grpc-daemon (trusted) worker2 # [ 75.371007] nix-daemon[976]: reaped child process 1008, status = succeeded lb # [ 78.231198] niks3-server[956]: 2026/11/12 09:19:39 INFO Received push request method=POST path=/api/pushes worker2 # [ 75.392059] nix-grpc-daemon[992]: time=2026-11-12T09:19:40.663Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 75.397064] nix-grpc-daemon[992]: time=2026-11-12T09:19:40.663Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 78.254176] garage[898]: 2026-11-12T09:19:40.013105Z INFO garage_api_common::generic_server: 192.168.1.4:44816 PUT /farm/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091940Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0c0e222338ea5007a1913699a09119cf00d9a7b03a5397be0c44b269bbfa5384 lb # [ 78.275924] garage[898]: 2026-11-12T09:19:40.013859Z INFO garage_api_common::generic_server: 192.168.1.4:44814 PUT /farm/nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091940Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a4545f83353dd72418adbbbc89b84c7012699f93f719f9bedc5495d906cb0d8e lb # [ 78.307830] garage[898]: 2026-11-12T09:19:40.049204Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst lb # [ 78.323669] niks3-server[956]: 2026/11/12 09:19:40 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign worker2 # [ 75.471528] nix-grpc-daemon[992]: time=2026-11-12T09:19:40.743Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.340611] niks3-server[956]: 2026/11/12 09:19:40 INFO Signed narinfos id=1 count=1 lb # [ 78.342002] niks3-server[956]: 2026/11/12 09:19:40 INFO Received complete push request method=POST path=/api/pushes/1/complete lb # [ 78.346384] niks3-server[956]: 2026/11/12 09:19:40 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst lb # [ 78.352782] garage[898]: 2026-11-12T09:19:40.085956Z INFO garage_api_common::generic_server: 192.168.1.4:44814 PUT /farm/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091940Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=67756ffb6f1481593498d95c234d466023626eb6547bee13e4ecf5c027f34ab9 lb # [ 78.367214] garage[898]: 2026-11-12T09:19:40.088410Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 78.370302] garage[898]: 2026-11-12T09:19:40.092839Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo lb # [ 78.373542] niks3-server[956]: 2026/11/12 09:19:40 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo lb # [ 78.378564] niks3-server[956]: 2026/11/12 09:19:40 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 78.381181] niks3-server[956]: 2026/11/12 09:19:40 INFO Completed push id=1 objects=3 duration=52.70016ms worker2 # [ 75.528261] nix-grpc-daemon[992]: time=2026-11-12T09:19:40.801Z level=INFO msg="Upload complete. (326ms)" worker2 # [ 75.536160] nix-grpc-daemon[791]: ts=2026-11-12T09:19:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43368 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 75.546528] nix-daemon[976]: reaped child process 988, status = succeeded worker1 # [ 77.100654] nix-grpc-daemon[485]: ts=2026-11-12T09:19:40Z level=debug event=want client=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker1 # [ 77.105047] nix-grpc-daemon[485]: ts=2026-11-12T09:19:40Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 77.109897] nix-grpc-daemon[485]: ts=2026-11-12T09:19:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 77.119756] systemd[1]: Started Nix Daemon. worker1 # [ 77.128254] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 77.142023] systemd[1]: Started SSH per-connection Daemon (vsock:2:9). worker1 # [ 77.277257] sshd-session[1060]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 77.287793] sshd-session[1060]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 77.299097] sshd-session[1060]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 77.311973] systemd-logind[539]: New session '12' of user 'root' with class 'user' and type 'tty'. worker1 # [ 77.321334] systemd[1]: Started Session 12 of User root. worker1 # [ 77.398739] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 77.418805] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 77.449789] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5) lb # [ 78.754803] garage[898]: 2026-11-12T09:19:40.514256Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/nix-cache-info lb # [ 78.760603] garage[898]: 2026-11-12T09:19:40.519561Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) GET /farm/nix-cache-info worker1 # [ 77.539723] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 2/5) worker1 # [ 77.612652] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 3/5) worker1 # [ 77.622625] sshd-session[1067]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 77.625239] sshd-session[1067]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 77.626704] sshd-session[1060]: pam_unix(sshd:session): session closed for user root worker1 # [ 77.631179] systemd[1]: sshd-vsock@9-10-5:22-2:9.service: Deactivated successfully. worker1 # [ 77.636384] systemd[1]: session-12.scope: Deactivated successfully. worker1 # [ 77.640811] systemd-logind[539]: Session 12 logged out. Waiting for processes to exit. worker1 # [ 77.643089] systemd-logind[539]: Removed session 12. worker1 # [ 77.675901] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 128 ms (attempt 4/5) worker1 # [ 77.806511] nix-grpc-daemon[485]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 77.810028] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 79.111046] garage[898]: 2026-11-12T09:19:40.870490Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo lb # [ 79.117231] garage[898]: 2026-11-12T09:19:40.876318Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) GET /farm/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker1 # [ 77.819319] nix-grpc-daemon[485]: copying path '/nix/store/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv' from 'http://lb:5751'... lb # [ 79.131926] garage[898]: 2026-11-12T09:19:40.891402Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst lb # [ 79.138727] garage[898]: 2026-11-12T09:19:40.897714Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) GET /farm/nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst worker1 # [ 77.853224] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 77.872234] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 79.696723] garage[898]: 2026-11-12T09:19:41.455424Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo lb # [ 79.701276] garage[898]: 2026-11-12T09:19:41.455831Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found [e2e] heartbeat t=30s worker1 # [ 78.694808] nix-grpc-daemon[485]: ts=2026-11-12T09:19:42Z level=info event=niks3_push_started pid=1104 worker1 # [ 78.707647] nix-daemon[1059]: reaped child process 1088, status = succeeded worker1 # [ 78.951311] nix-grpc-daemon[1104]: time=2026-11-12T09:19:42.744Z level=INFO msg="Configuring client TLS" cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker1.pem key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker1.key ca="" worker2 # [ 77.465462] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 77.474937] systemd[1]: Started SSH per-connection Daemon (vsock:2:4). worker2 # [ 77.485147] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 77.489466] systemd[1]: Started SSH per-connection Daemon (vsock:2:5). worker1 # [ 79.093218] nix-daemon[1059]: accepted connection from pid 1117, user nix-grpc-daemon (trusted) lb # [ 80.417051] niks3-server[956]: 2026/11/12 09:19:42 INFO Received push request method=POST path=/api/pushes worker1 # [ 79.119920] nix-daemon[1059]: reaped child process 1120, status = succeeded worker1 # [ 79.127234] nix-grpc-daemon[1104]: time=2026-11-12T09:19:42.919Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 79.131579] nix-grpc-daemon[1104]: time=2026-11-12T09:19:42.919Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 80.435959] garage[898]: 2026-11-12T09:19:42.195903Z INFO garage_api_common::generic_server: 192.168.1.3:32772 PUT /farm/yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091942Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5dd3e96ae41e56bc8ad4e65a2963fd85ac14d9209122d997634a5722b2d8e7a3 lb # [ 80.451730] garage[898]: 2026-11-12T09:19:42.205288Z INFO garage_api_common::generic_server: 192.168.1.3:60974 PUT /farm/nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091942Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0de875e5d494b9d24fa8c1e8b339fa4a20a6048b4264f49a74a014587d18eac2 worker1 # [ 79.166162] nix-grpc-daemon[1104]: time=2026-11-12T09:19:42.959Z level=INFO msg="Uploading 1 narinfos" lb # [ 80.464920] garage[898]: 2026-11-12T09:19:42.205677Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091942Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=66b4a99df3919355533ee25af0520361c7c65321312f028b3aab0538903892f2 lb # [ 80.483789] garage[898]: 2026-11-12T09:19:42.210028Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls worker2 # [ 77.643832] sshd-session[1010]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 80.497822] niks3-server[956]: 2026/11/12 09:19:42 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign lb # [ 80.500711] niks3-server[956]: 2026/11/12 09:19:42 INFO Signed narinfos id=2 count=1 worker1 # [ 79.201320] nix-grpc-daemon[1104]: time=2026-11-12T09:19:42.994Z level=INFO msg="Upload complete. (244ms)" lb # [ 80.502317] niks3-server[956]: 2026/11/12 09:19:42 INFO Received complete push request method=POST path=/api/pushes/2/complete worker2 # [ 77.650009] sshd-session[1011]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 80.504566] niks3-server[956]: 2026/11/12 09:19:42 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 80.508174] niks3-server[956]: 2026/11/12 09:19:42 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 80.511418] niks3-server[956]: 2026/11/12 09:19:42 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst worker2 # [ 77.659408] sshd-session[1010]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 80.514547] niks3-server[956]: 2026/11/12 09:19:42 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker2 # [ 77.664224] sshd-session[1011]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 80.517705] garage[898]: 2026-11-12T09:19:42.235001Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker1 # [ 79.212282] nix-grpc-daemon[485]: ts=2026-11-12T09:19:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=2 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 79.228251] nix-daemon[1059]: reaped child process 1086, status = succeeded worker2 # [ 77.675012] sshd-session[1010]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 80.522491] garage[898]: 2026-11-12T09:19:42.235577Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091942Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=53345772113fca03daa848ce4ea4f214837ddf3e2366161716d36e76be2c396a lb # [ 80.531279] garage[898]: 2026-11-12T09:19:42.241469Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst worker2 # [ 77.681702] nix-grpc-daemon[791]: ts=2026-11-12T09:19:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 80.536207] garage[898]: 2026-11-12T09:19:42.246036Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo lb # [ 80.542396] niks3-server[956]: 2026/11/12 09:19:42 INFO Completed push id=2 objects=4 duration=17.44044ms worker2 # [ 77.690468] sshd-session[1011]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 80.544415] garage[898]: 2026-11-12T09:19:42.300725Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker2 # [ 77.695068] nix-grpc-daemon[791]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... lb # [ 80.548000] garage[898]: 2026-11-12T09:19:42.301675Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) GET /farm/yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo lb # [ 80.553661] garage[898]: 2026-11-12T09:19:42.312939Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 80.558429] garage[898]: 2026-11-12T09:19:42.317587Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) GET /farm/nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst worker2 # [ 77.712869] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 77.723295] systemd-logind[515]: New session '6' of user 'root' with class 'user' and type 'tty'. worker2 # [ 77.730540] systemd-logind[515]: New session '7' of user 'root' with class 'user' and type 'tty'. worker1 # [ 79.299333] nix-grpc-daemon[485]: ts=2026-11-12T09:19:43Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36426 worker2 # [ 77.755036] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 79.308478] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker2 # [ 77.761181] systemd[1]: Starting User Manager for UID 0... worker1 # [ 79.321216] nix-grpc-daemon[485]: ts=2026-11-12T09:19:43Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 79.336399] nix-daemon[1059]: reaped child process 1122, status = succeeded worker2 # [ 77.789538] (systemd)[1025]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 77.795532] systemd-logind[515]: New session '8' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 77.894843] systemd[1025]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 77.998362] nix-grpc-daemon[791]: ts=2026-11-12T09:19:43Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43368 worker2 # [ 78.002107] systemd[1025]: Queued start job for default target Main User Target. worker1 # [ 79.555788] nix-grpc-daemon[485]: ts=2026-11-12T09:19:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 worker2 # [ 78.009007] systemd[1025]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 79.564049] nix-grpc-daemon[1104]: time=2026-11-12T09:19:43.357Z level=INFO msg="All 1 paths already cached" worker2 # [ 78.013329] systemd[1025]: Created slice User Application Slice. worker2 # [ 78.014414] systemd[1025]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 78.015495] systemd[1025]: Reached target Paths. worker2 # [ 78.024553] systemd[1025]: Reached target Timers. worker2 # [ 78.025388] nix-grpc-daemon[791]: ts=2026-11-12T09:19:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43368 worker2 # [ 78.027176] systemd[1025]: Starting D-Bus User Message Bus Socket... worker2 # [ 78.032494] systemd[1025]: Starting Create User Files and Directories... worker2 # [ 78.040683] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) lb # [ 80.912615] garage[898]: 2026-11-12T09:19:42.671254Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo lb # [ 80.918082] garage[898]: 2026-11-12T09:19:42.671699Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 78.073735] nix-grpc-daemon[992]: time=2026-11-12T09:19:43.346Z level=INFO msg="All 1 paths already cached" worker2 # [ 78.087193] nix-grpc-daemon[791]: ts=2026-11-12T09:19:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43368 worker2 # [ 78.100358] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) worker2 # [ 78.113784] systemd[1025]: Finished Create User Files and Directories. worker2 # [ 78.131658] systemd[1025]: Listening on D-Bus User Message Bus Socket. worker2 # [ 78.136280] systemd[1025]: Reached target Sockets. worker2 # [ 78.137105] systemd[1025]: Reached target Basic System. worker2 # [ 78.137885] systemd[1025]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 78.139325] systemd[1025]: Reached target Main User Target. worker2 # [ 78.142861] systemd[1025]: Startup finished in 316ms. worker2 # [ 78.144935] systemd[1]: Started User Manager for UID 0. worker2 # [ 78.150763] systemd[1]: Started Session 6 of User root. worker2 # [ 78.151704] systemd[1]: Started Session 7 of User root. worker2 # [ 78.239700] sshd-session[1043]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 78.246246] sshd-session[1043]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 78.247384] systemd[1]: sshd-vsock@4-5-6:22-2:4.service: Deactivated successfully. worker2 # [ 78.270264] sshd-session[1010]: pam_unix(sshd:session): session closed for user root worker2 # [ 78.271506] systemd[1]: session-6.scope: Deactivated successfully. worker2 # [ 78.282209] sshd-session[1044]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 78.283594] systemd-logind[515]: Session 6 logged out. Waiting for processes to exit. worker2 # [ 78.294359] sshd-session[1044]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 78.295980] systemd-logind[515]: Removed session 6. worker2 # [ 78.298088] sshd-session[1011]: pam_unix(sshd:session): session closed for user root worker2 # [ 78.300602] systemd[1]: sshd-vsock@5-6-6:22-2:5.service: Deactivated successfully. worker2 # [ 78.302712] systemd[1]: session-7.scope: Deactivated successfully. worker2 # [ 78.304182] systemd-logind[515]: Session 7 logged out. Waiting for processes to exit. worker2 # [ 78.305322] systemd-logind[515]: Removed session 7. worker2 # [ 78.379981] nix-daemon[976]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) lb # [ 81.257525] niks3-server[956]: 2026/11/12 09:19:43 INFO Received push request method=POST path=/api/pushes worker2 # [ 78.407245] nix-daemon[976]: reaped child process 1056, status = succeeded worker2 # [ 78.424912] nix-grpc-daemon[992]: time=2026-11-12T09:19:43.696Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 78.426773] nix-grpc-daemon[992]: time=2026-11-12T09:19:43.697Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 81.279007] garage[898]: 2026-11-12T09:19:43.038510Z INFO garage_api_common::generic_server: 192.168.1.4:44814 PUT /farm/nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091943Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b33e5be6c56c38a44fbd6594d7f72fd41838ec192b73aba28bc53feb9eea8336 worker2 # [ 78.439034] nix-grpc-daemon[992]: time=2026-11-12T09:19:43.711Z level=INFO msg="Uploading 1 narinfos" lb # [ 81.303218] garage[898]: 2026-11-12T09:19:43.049401Z INFO garage_api_common::generic_server: 192.168.1.4:44816 PUT /farm/r1jsr4b2g1qwly395z6idx3z2362ih8i.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091943Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bae1a396809587b505c6d816d71a35f129430f38224c656ad353580236760ce2 lb # [ 81.312373] garage[898]: 2026-11-12T09:19:43.052811Z INFO garage_api_common::generic_server: 192.168.1.4:44816 PUT /farm/r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091943Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bc4ec90bdb72528fb16435d8c8b4c584575092b45c9e17e3833ad63aeb3c453a worker2 # [ 78.468440] nix-grpc-daemon[992]: time=2026-11-12T09:19:43.741Z level=INFO msg="Upload complete. (343ms)" lb # [ 81.323878] garage[898]: 2026-11-12T09:19:43.053272Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/r1jsr4b2g1qwly395z6idx3z2362ih8i.ls worker2 # [ 78.476632] nix-grpc-daemon[791]: ts=2026-11-12T09:19:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43368 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 81.330494] garage[898]: 2026-11-12T09:19:43.055395Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst lb # [ 81.336279] garage[898]: 2026-11-12T09:19:43.061889Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker2 # [ 78.488646] nix-daemon[976]: reaped child process 1038, status = succeeded lb # [ 81.341000] niks3-server[956]: 2026/11/12 09:19:43 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign worker1 # [ 80.044743] nix-grpc-daemon[485]: ts=2026-11-12T09:19:43Z level=debug event=want client=2 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 lb # [ 81.346264] niks3-server[956]: 2026/11/12 09:19:43 INFO Signed narinfos id=3 count=1 lb # [ 81.349769] niks3-server[956]: 2026/11/12 09:19:43 INFO Received complete push request method=POST path=/api/pushes/3/complete lb # [ 81.352738] niks3-server[956]: 2026/11/12 09:19:43 INFO Completed push id=3 objects=6 duration=26.22888ms worker1 # [ 80.054134] nix-grpc-daemon[485]: ts=2026-11-12T09:19:43Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=1 lb # [ 81.354807] niks3-server[956]: 2026/11/12 09:19:43 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo lb # [ 81.357638] niks3-server[956]: 2026/11/12 09:19:43 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst lb # [ 81.360610] niks3-server[956]: 2026/11/12 09:19:43 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls worker1 # [ 80.064311] nix-grpc-daemon[485]: ts=2026-11-12T09:19:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 client # [ 80.063785] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 81.369416] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 80.069146] systemd[1]: Started SSH per-connection Daemon (vsock:2:5). worker1 # [ 80.073057] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 81.376319] systemd[1]: Started SSH per-connection Daemon (vsock:2:6). worker1 # [ 80.081781] nix-grpc-daemon[485]: copying path '/nix/store/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv' from 'http://lb:5751'... lb # [ 81.382094] garage[898]: 2026-11-12T09:19:43.138335Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo lb # [ 81.393185] garage[898]: 2026-11-12T09:19:43.139102Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) GET /farm/r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo lb # [ 81.397718] garage[898]: 2026-11-12T09:19:43.147056Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst worker1 # [ 80.099982] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 81.401392] garage[898]: 2026-11-12T09:19:43.152238Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) GET /farm/nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst worker1 # [ 80.116666] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) client # [ 80.169345] sshd-session[870]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 81.474967] sshd-session[1137]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 81.482406] sshd-session[1137]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 80.178929] sshd-session[870]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 81.489584] sshd-session[1137]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 80.187206] sshd-session[870]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 80.195413] systemd-logind[427]: New session '7' of user 'root' with class 'user' and type 'tty'. client # [ 80.204529] systemd[1]: Started Session 7 of User root. lb # [ 81.513041] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 81.549127] systemd-logind[499]: New session '8' of user 'root' with class 'user' and type 'tty'. lb # [ 81.559839] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 81.564903] systemd[1]: Starting User Manager for UID 0... lb # [ 81.593547] (systemd)[1146]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 81.599029] systemd-logind[499]: New session '9' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 80.347077] nix-daemon[813]: accepted connection from pid 878, user root (trusted) lb # [ 81.699726] systemd[1146]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 81.799206] systemd[1146]: Queued start job for default target Main User Target. lb # [ 81.809029] systemd[1146]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 81.815693] systemd[1146]: Created slice User Application Slice. lb # [ 81.817153] systemd[1146]: Started Daily Cleanup of User's Temporary Directories. lb # [ 81.818333] systemd[1146]: Reached target Paths. lb # [ 81.819025] systemd[1146]: Reached target Timers. lb # [ 81.822701] systemd[1146]: Starting D-Bus User Message Bus Socket... lb # [ 81.827787] systemd[1146]: Starting Create User Files and Directories... worker2 # [ 78.975143] nix-grpc-daemon[791]: ts=2026-11-12T09:19:44Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43368 worker2 # [ 78.990465] nix-grpc-daemon[791]: ts=2026-11-12T09:19:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 81.850745] garage[898]: 2026-11-12T09:19:43.609289Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/sihwf055ggcqjg1lzgbgk5wrkpn9i3l3.narinfo lb # [ 81.859578] garage[898]: 2026-11-12T09:19:43.609643Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 79.007315] nix-grpc-daemon[791]: ts=2026-11-12T09:19:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43368 worker2 # [ 79.019389] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) lb # [ 81.882894] systemd[1146]: Finished Create User Files and Directories. lb # [ 81.889513] systemd[1146]: Listening on D-Bus User Message Bus Socket. lb # [ 81.890621] systemd[1146]: Reached target Sockets. lb # [ 81.891351] systemd[1146]: Reached target Basic System. lb # [ 81.892374] systemd[1146]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 81.893992] systemd[1146]: Reached target Main User Target. lb # [ 81.894808] systemd[1146]: Startup finished in 270ms. lb # [ 81.895544] systemd[1]: Started User Manager for UID 0. lb # [ 81.899215] systemd[1]: Started Session 8 of User root. lb # [ 81.930351] sshd-session[1159]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 81.931843] sshd-session[1159]: Disconnected from user root UNKNOWN port 65535 lb # [ 81.934004] sshd-session[1137]: pam_unix(sshd:session): session closed for user root lb # [ 81.937937] systemd[1]: sshd-vsock@6-7-4:22-2:6.service: Deactivated successfully. lb # [ 81.942503] systemd[1]: session-8.scope: Deactivated successfully. lb # [ 81.945801] systemd[1]: session-8.scope: Consumed 25ms CPU time over 46ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 81.950510] systemd-logind[499]: Session 8 logged out. Waiting for processes to exit. lb # [ 81.951744] systemd-logind[499]: Removed session 8. worker2 # [ 79.178540] nix-daemon[976]: accepted connection from pid 1060, user nix-grpc-daemon (trusted) lb # [ 82.058057] niks3-server[956]: 2026/11/12 09:19:43 INFO Received push request method=POST path=/api/pushes worker2 # [ 79.207649] nix-daemon[976]: reaped child process 1063, status = succeeded worker2 # [ 79.214314] nix-grpc-daemon[992]: time=2026-11-12T09:19:44.486Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 79.216413] nix-grpc-daemon[992]: time=2026-11-12T09:19:44.486Z level=INFO msg="Uploading sihwf055ggcqjg1lzgbgk5wrkpn9i3l3-local-input-w1only (120B)" lb # [ 82.068668] garage[898]: 2026-11-12T09:19:43.827528Z INFO garage_api_common::generic_server: 192.168.1.4:44816 PUT /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091943Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=458d7e0c1befc671be082aed8ad54025dee78e8bf4a5f7fbad7b3b56ffa4140e worker2 # [ 79.232343] nix-grpc-daemon[992]: time=2026-11-12T09:19:44.505Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.093155] garage[898]: 2026-11-12T09:19:43.838759Z INFO garage_api_common::generic_server: 192.168.1.4:44814 PUT /farm/sihwf055ggcqjg1lzgbgk5wrkpn9i3l3.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091943Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e4339cbfd29996323ace32551f145eb1efc9dec9795cfbceca0460f041171b7 lb # [ 82.101596] garage[898]: 2026-11-12T09:19:43.841250Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker2 # [ 79.254298] nix-grpc-daemon[992]: time=2026-11-12T09:19:44.527Z level=INFO msg="Upload complete. (222ms)" lb # [ 82.107513] garage[898]: 2026-11-12T09:19:43.844163Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/sihwf055ggcqjg1lzgbgk5wrkpn9i3l3.ls worker2 # [ 79.260446] nix-grpc-daemon[791]: ts=2026-11-12T09:19:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43368 duration_s=0 paths=1 nar_bytes_in=120 lb # [ 82.113101] garage[898]: 2026-11-12T09:19:43.846432Z INFO garage_api_common::generic_server: 192.168.1.4:44814 PUT /farm/sihwf055ggcqjg1lzgbgk5wrkpn9i3l3.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091943Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fc3991c4b6a6ce2482e6f77a77bd8cb393a1b9d739afdbac2a67f8b2238b7a64 worker2 # [ 79.271844] nix-grpc-daemon[791]: ts=2026-11-12T09:19:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43368 worker2 # [ 79.274848] nix-daemon[976]: reaped child process 1058, status = succeeded lb # [ 82.125817] garage[898]: 2026-11-12T09:19:43.851677Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/sihwf055ggcqjg1lzgbgk5wrkpn9i3l3.narinfo lb # [ 82.133537] niks3-server[956]: 2026/11/12 09:19:43 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign lb # [ 82.136970] niks3-server[956]: 2026/11/12 09:19:43 INFO Signed narinfos id=4 count=1 lb # [ 82.139467] niks3-server[956]: 2026/11/12 09:19:43 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker2 # [ 79.286865] nix-grpc-daemon[791]: ts=2026-11-12T09:19:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 82.143134] niks3-server[956]: 2026/11/12 09:19:43 INFO Registered completed upload object_key=sihwf055ggcqjg1lzgbgk5wrkpn9i3l3.ls lb # [ 82.145828] niks3-server[956]: 2026/11/12 09:19:43 INFO Received complete push request method=POST path=/api/pushes/4/complete lb # [ 82.148075] niks3-server[956]: 2026/11/12 09:19:43 INFO Completed push id=4 objects=3 duration=18.13472ms worker2 # [ 79.295135] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) lb # [ 82.150053] niks3-server[956]: 2026/11/12 09:19:43 INFO Registered completed upload object_key=sihwf055ggcqjg1lzgbgk5wrkpn9i3l3.narinfo lb # [ 82.152600] garage[898]: 2026-11-12T09:19:43.884351Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo lb # [ 82.156346] garage[898]: 2026-11-12T09:19:43.885009Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 82.159482] garage[898]: 2026-11-12T09:19:43.890956Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/dksndlbsaxs7hh7wcajqjj5y5ng0k40k.narinfo lb # [ 82.163281] garage[898]: 2026-11-12T09:19:43.891432Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 79.312414] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) lb # [ 82.166200] garage[898]: 2026-11-12T09:19:43.892683Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/qac1cayk4mxz6c5bwdj4mblk7s0cira9.narinfo lb # [ 82.169939] garage[898]: 2026-11-12T09:19:43.893002Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 79.455444] nix-daemon[976]: accepted connection from pid 1069, user nix-grpc-daemon (trusted) lb # [ 82.339513] niks3-server[956]: 2026/11/12 09:19:44 INFO Received push request method=POST path=/api/pushes worker2 # [ 79.488480] nix-daemon[976]: reaped child process 1072, status = succeeded worker2 # [ 79.491261] nix-grpc-daemon[992]: time=2026-11-12T09:19:44.764Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 79.495954] nix-grpc-daemon[992]: time=2026-11-12T09:19:44.766Z level=INFO msg="Uploading qac1cayk4mxz6c5bwdj4mblk7s0cira9-local-input-w1only.drv (448B)" worker2 # [ 79.498281] nix-grpc-daemon[992]: time=2026-11-12T09:19:44.766Z level=INFO msg="Uploading dksndlbsaxs7hh7wcajqjj5y5ng0k40k-uses-input-w1onlya.drv (592B)" lb # [ 82.348114] garage[898]: 2026-11-12T09:19:44.107584Z INFO garage_api_common::generic_server: 192.168.1.4:44814 PUT /farm/nar/0gy3zc52ky54qs5jsrsxgnqp3jr10c3wij0h0586cjil9a9d9ida.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091944Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c6cb6ecda581fd0e1a70b548a624da3a842059c8396c1beec1c8694b713e429b worker2 # [ 79.537435] nix-grpc-daemon[992]: time=2026-11-12T09:19:44.809Z level=INFO msg="Uploading 2 narinfos" lb # [ 82.375933] garage[898]: 2026-11-12T09:19:44.117922Z INFO garage_api_common::generic_server: 192.168.1.4:44816 PUT /farm/nar/09m49hdsfgz8clfwkwmqvi51xx3454zydp7w0v9r20afhk8y3hx8.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091944Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=44070846524bc376d28d4b78c354d0387bc29c104da1d8a0c65c400199a72d94 worker2 # [ 79.553791] nix-grpc-daemon[992]: time=2026-11-12T09:19:44.826Z level=INFO msg="Upload complete. (234ms)" worker2 # [ 79.560187] nix-grpc-daemon[791]: ts=2026-11-12T09:19:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43368 duration_s=0 paths=2 nar_bytes_in=1040 lb # [ 82.407803] garage[898]: 2026-11-12T09:19:44.119913Z INFO garage_api_common::generic_server: 192.168.1.4:44836 PUT /farm/dksndlbsaxs7hh7wcajqjj5y5ng0k40k.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091944Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0317a9cc0b434f24e7b727d214c65a06d72c773a386c3b5c057670c98ea6ca88 worker2 # [ 79.571722] nix-daemon[976]: reaped child process 1065, status = succeeded lb # [ 82.418512] garage[898]: 2026-11-12T09:19:44.122041Z INFO garage_api_common::generic_server: 192.168.1.4:44832 PUT /farm/qac1cayk4mxz6c5bwdj4mblk7s0cira9.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091944Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=457cea284d185c4c41ff24be8377953f7d738e831bad6526105853eed8ceabda lb # [ 82.427950] garage[898]: 2026-11-12T09:19:44.126586Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/nar/0gy3zc52ky54qs5jsrsxgnqp3jr10c3wij0h0586cjil9a9d9ida.nar.zst lb # [ 82.435622] garage[898]: 2026-11-12T09:19:44.127021Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/nar/09m49hdsfgz8clfwkwmqvi51xx3454zydp7w0v9r20afhk8y3hx8.nar.zst worker1 # [ 81.137640] nix-grpc-daemon[485]: ts=2026-11-12T09:19:44Z level=debug event=want client=3 drv=dksndlbsaxs7hh7wcajqjj5y5ng0k40k-uses-input-w1onlya.drv cached=0 lb # [ 82.440431] niks3-server[956]: 2026/11/12 09:19:44 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign lb # [ 82.443260] niks3-server[956]: 2026/11/12 09:19:44 INFO Registered completed upload object_key=nar/09m49hdsfgz8clfwkwmqvi51xx3454zydp7w0v9r20afhk8y3hx8.nar.zst lb # [ 82.446750] niks3-server[956]: 2026/11/12 09:19:44 INFO Signed narinfos id=5 count=2 lb # [ 82.448333] niks3-server[956]: 2026/11/12 09:19:44 INFO Registered completed upload object_key=nar/0gy3zc52ky54qs5jsrsxgnqp3jr10c3wij0h0586cjil9a9d9ida.nar.zst lb # [ 82.452121] niks3-server[956]: 2026/11/12 09:19:44 INFO Registered completed upload object_key=dksndlbsaxs7hh7wcajqjj5y5ng0k40k.ls worker2 # [ 79.599314] nix-grpc-daemon[791]: ts=2026-11-12T09:19:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 82.454543] niks3-server[956]: 2026/11/12 09:19:44 INFO Registered completed upload object_key=qac1cayk4mxz6c5bwdj4mblk7s0cira9.ls lb # [ 82.456674] niks3-server[956]: 2026/11/12 09:19:44 INFO Received complete push request method=POST path=/api/pushes/5/complete lb # [ 82.458631] niks3-server[956]: 2026/11/12 09:19:44 INFO Completed push id=5 objects=6 duration=10.03718ms lb # [ 82.460274] niks3-server[956]: 2026/11/12 09:19:44 INFO Registered completed upload object_key=qac1cayk4mxz6c5bwdj4mblk7s0cira9.narinfo lb # [ 82.462425] niks3-server[956]: 2026/11/12 09:19:44 INFO Registered completed upload object_key=dksndlbsaxs7hh7wcajqjj5y5ng0k40k.narinfo worker2 # [ 79.609551] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) lb # [ 82.464604] garage[898]: 2026-11-12T09:19:44.148980Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/dksndlbsaxs7hh7wcajqjj5y5ng0k40k.ls worker1 # [ 81.143162] nix-grpc-daemon[485]: ts=2026-11-12T09:19:44Z level=debug event=assigned drv=dksndlbsaxs7hh7wcajqjj5y5ng0k40k-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 lb # [ 82.467756] garage[898]: 2026-11-12T09:19:44.151520Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/qac1cayk4mxz6c5bwdj4mblk7s0cira9.ls lb # [ 82.471177] garage[898]: 2026-11-12T09:19:44.151992Z INFO garage_api_common::generic_server: 192.168.1.4:44832 PUT /farm/dksndlbsaxs7hh7wcajqjj5y5ng0k40k.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091944Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31d0e3223b79efbdefb53b6d1fec90af00fe0af485cdbb1e51d237da7d492da6 worker2 # [ 79.624755] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) lb # [ 82.477786] garage[898]: 2026-11-12T09:19:44.153544Z INFO garage_api_common::generic_server: 192.168.1.4:44836 PUT /farm/qac1cayk4mxz6c5bwdj4mblk7s0cira9.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091944Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d5d3a5d52466a770ec57d2e6625fda3cc8d4b3df483ebe5ff6bae2d78cfd60ce lb # [ 82.484580] garage[898]: 2026-11-12T09:19:44.163294Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/qac1cayk4mxz6c5bwdj4mblk7s0cira9.narinfo lb # [ 82.487568] garage[898]: 2026-11-12T09:19:44.164729Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/dksndlbsaxs7hh7wcajqjj5y5ng0k40k.narinfo worker1 # [ 81.215717] nix-daemon[1059]: reaped child process 1132, status = succeeded worker1 # [ 81.293919] nix-daemon[1059]: accepted connection from pid 1150, user nix-grpc-daemon (trusted) worker1 # [ 81.320380] nix-daemon[1059]: reaped child process 1153, status = succeeded lb # [ 82.624727] niks3-server[956]: 2026/11/12 09:19:44 INFO Received push request method=POST path=/api/pushes worker1 # [ 81.332688] nix-grpc-daemon[1104]: time=2026-11-12T09:19:45.126Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 81.336202] nix-grpc-daemon[1104]: time=2026-11-12T09:19:45.128Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" worker1 # [ 81.353411] nix-grpc-daemon[1104]: time=2026-11-12T09:19:45.146Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.636217] garage[898]: 2026-11-12T09:19:44.395582Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091944Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=16780412278738259100e4cb373c9c67f4c030c10e672569cda441314ecaab61 lb # [ 82.663582] garage[898]: 2026-11-12T09:19:44.406060Z INFO garage_api_common::generic_server: 192.168.1.3:32772 PUT /farm/la6ryzsihag4zpxgxls54fsg34dvlalk.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091944Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e1bee853c25f5d2aa81420a4ece67bf6cce961b79d1f5ebd0820ee2555af4f0f lb # [ 82.672568] garage[898]: 2026-11-12T09:19:44.406594Z INFO garage_api_common::generic_server: 192.168.1.3:60974 PUT /farm/nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091944Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cc6313e0b3c076c8ec53491c9a0882eefb072f7b2af985434e47831142255f7d worker1 # [ 81.384755] nix-grpc-daemon[1104]: time=2026-11-12T09:19:45.178Z level=INFO msg="Upload complete. (252ms)" lb # [ 82.684940] garage[898]: 2026-11-12T09:19:44.410408Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker1 # [ 81.391349] nix-grpc-daemon[485]: ts=2026-11-12T09:19:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=2 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 82.690577] garage[898]: 2026-11-12T09:19:44.413511Z INFO garage_api_common::generic_server: 192.168.1.3:60974 PUT /farm/la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091944Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=65f770a7ea9f28bdedfb49403e5e3b3adbf66bd50251e7b17a69c653405011ac lb # [ 82.700297] garage[898]: 2026-11-12T09:19:44.413971Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/la6ryzsihag4zpxgxls54fsg34dvlalk.ls worker1 # [ 81.403970] nix-daemon[1059]: reaped child process 1130, status = succeeded lb # [ 82.705233] garage[898]: 2026-11-12T09:19:44.416670Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 82.710748] niks3-server[956]: 2026/11/12 09:19:44 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign worker1 # [ 81.411646] nix-grpc-daemon[485]: ts=2026-11-12T09:19:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 82.713614] niks3-server[956]: 2026/11/12 09:19:44 INFO Signed narinfos id=6 count=1 lb # [ 82.715804] niks3-server[956]: 2026/11/12 09:19:44 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv lb # [ 82.718583] niks3-server[956]: 2026/11/12 09:19:44 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 82.720895] niks3-server[956]: 2026/11/12 09:19:44 INFO Received complete push request method=POST path=/api/pushes/6/complete lb # [ 82.723078] niks3-server[956]: 2026/11/12 09:19:44 INFO Completed push id=6 objects=8 duration=23.54574ms lb # [ 82.725064] niks3-server[956]: 2026/11/12 09:19:44 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 82.727790] niks3-server[956]: 2026/11/12 09:19:44 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo lb # [ 82.730348] garage[898]: 2026-11-12T09:19:44.419178Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker1 # [ 81.449158] nix-grpc-daemon[485]: ts=2026-11-12T09:19:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 81.457525] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 81.467725] nix-grpc-daemon[485]: ts=2026-11-12T09:19:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 81.483871] nix-daemon[1059]: reaped child process 1155, status = succeeded worker1 # [ 81.743156] nix-grpc-daemon[485]: ts=2026-11-12T09:19:45Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 81.750598] nix-grpc-daemon[485]: ts=2026-11-12T09:19:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 81.768442] nix-grpc-daemon[1104]: time=2026-11-12T09:19:45.553Z level=INFO msg="All 2 paths already cached" worker2 # [ 80.214667] nix-grpc-daemon[791]: ts=2026-11-12T09:19:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43368 worker1 # [ 81.771247] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 81.777480] systemd[1]: Started SSH per-connection Daemon (vsock:2:10). worker2 # [ 80.226358] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) lb # [ 83.091967] garage[898]: 2026-11-12T09:19:44.851259Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo lb # [ 83.099388] garage[898]: 2026-11-12T09:19:44.852536Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 80.250865] nix-grpc-daemon[992]: time=2026-11-12T09:19:45.523Z level=INFO msg="All 2 paths already cached" worker2 # [ 80.259671] nix-grpc-daemon[791]: ts=2026-11-12T09:19:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43368 worker2 # [ 80.272380] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) worker1 # [ 81.860615] sshd-session[1157]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 81.869765] sshd-session[1157]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 81.878587] sshd-session[1157]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 81.888472] systemd-logind[539]: New session '13' of user 'root' with class 'user' and type 'tty'. worker1 # [ 81.897199] systemd[1]: Started Session 13 of User root. worker1 # [ 81.931988] sshd-session[1163]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 81.933501] sshd-session[1163]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 81.935476] sshd-session[1157]: pam_unix(sshd:session): session closed for user root worker1 # [ 81.939619] systemd[1]: sshd-vsock@10-11-5:22-2:10.service: Deactivated successfully. worker1 # [ 81.944786] systemd[1]: session-13.scope: Deactivated successfully. worker1 # [ 81.946648] systemd[1]: session-13.scope: Consumed 26ms CPU time over 49ms wall clock time, 3.1M memory peak, 16.6K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 81.953002] systemd-logind[539]: Session 13 logged out. Waiting for processes to exit. worker1 # [ 81.954279] systemd-logind[539]: Removed session 13. worker2 # [ 80.438733] nix-daemon[976]: accepted connection from pid 1089, user nix-grpc-daemon (trusted) lb # [ 83.320451] niks3-server[956]: 2026/11/12 09:19:45 INFO Received push request method=POST path=/api/pushes worker2 # [ 80.468921] nix-daemon[976]: reaped child process 1092, status = succeeded worker2 # [ 80.475064] nix-grpc-daemon[992]: time=2026-11-12T09:19:45.747Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 80.477123] nix-grpc-daemon[992]: time=2026-11-12T09:19:45.747Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 83.329265] garage[898]: 2026-11-12T09:19:45.088812Z INFO garage_api_common::generic_server: 192.168.1.4:44832 PUT /farm/aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091945Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=52d84db2a3d631118842e0fa3cda5706cf3a558c1e450099ba217020e5c97fbb worker2 # [ 80.484871] nix-grpc-daemon[992]: time=2026-11-12T09:19:45.757Z level=INFO msg="Uploading 1 narinfos" lb # [ 83.347755] garage[898]: 2026-11-12T09:19:45.094960Z INFO garage_api_common::generic_server: 192.168.1.4:44836 PUT /farm/nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091945Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f67b99ba0b3d76e048ec39d25f6089af0b1ce86e52402c346b8dfd34a2fb4119 worker2 # [ 80.501549] nix-grpc-daemon[992]: time=2026-11-12T09:19:45.774Z level=INFO msg="Upload complete. (214ms)" lb # [ 83.355522] garage[898]: 2026-11-12T09:19:45.098218Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst worker2 # [ 80.506743] nix-grpc-daemon[791]: ts=2026-11-12T09:19:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43368 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 83.360079] garage[898]: 2026-11-12T09:19:45.098667Z INFO garage_api_common::generic_server: 192.168.1.4:44836 PUT /farm/aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091945Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cc65d14ab3a71af4c74928e7dff13d29159759044e3061c6bc1da42701f23bd0 lb # [ 83.367026] garage[898]: 2026-11-12T09:19:45.100128Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls worker2 # [ 80.518702] nix-daemon[976]: reaped child process 1087, status = succeeded lb # [ 83.370755] garage[898]: 2026-11-12T09:19:45.103259Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo lb # [ 83.374065] niks3-server[956]: 2026/11/12 09:19:45 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign lb # [ 83.376807] niks3-server[956]: 2026/11/12 09:19:45 INFO Signed narinfos id=7 count=1 lb # [ 83.378524] niks3-server[956]: 2026/11/12 09:19:45 INFO Received complete push request method=POST path=/api/pushes/7/complete worker1 # [ 82.077929] nix-grpc-daemon[485]: ts=2026-11-12T09:19:45Z level=debug event=want client=4 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 lb # [ 83.380169] niks3-server[956]: 2026/11/12 09:19:45 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 83.382389] niks3-server[956]: 2026/11/12 09:19:45 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst worker1 # [ 82.082465] nix-grpc-daemon[485]: ts=2026-11-12T09:19:45Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=1 lb # [ 83.385139] niks3-server[956]: 2026/11/12 09:19:45 INFO Completed push id=7 objects=9 duration=10.83528ms lb # [ 83.386798] niks3-server[956]: 2026/11/12 09:19:45 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker1 # [ 82.088900] nix-grpc-daemon[485]: ts=2026-11-12T09:19:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 82.098332] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 83.409750] garage[898]: 2026-11-12T09:19:45.168836Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo lb # [ 83.414547] garage[898]: 2026-11-12T09:19:45.173585Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) GET /farm/aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker1 # [ 82.116396] nix-grpc-daemon[485]: copying path '/nix/store/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv' from 'http://lb:5751'... lb # [ 83.421524] garage[898]: 2026-11-12T09:19:45.180991Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst lb # [ 83.427140] garage[898]: 2026-11-12T09:19:45.186038Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) GET /farm/nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst worker1 # [ 82.134002] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 82.150210] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 83.478091] garage[898]: 2026-11-12T09:19:45.237525Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/2kk5g3c3d6w3xr4ycwzrvsimag0421xn.narinfo lb # [ 83.483295] garage[898]: 2026-11-12T09:19:45.237946Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 81.073667] nix-daemon[976]: reaped child process 1077, status = succeeded worker2 # [ 81.205290] nix-daemon[976]: accepted connection from pid 1103, user nix-grpc-daemon (trusted) lb # [ 84.077638] niks3-server[956]: 2026/11/12 09:19:45 INFO Received push request method=POST path=/api/pushes worker2 # [ 81.230309] nix-daemon[976]: reaped child process 1106, status = succeeded worker2 # [ 81.234250] nix-grpc-daemon[992]: time=2026-11-12T09:19:46.504Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" worker2 # [ 81.248786] nix-grpc-daemon[992]: time=2026-11-12T09:19:46.521Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.086675] garage[898]: 2026-11-12T09:19:45.846148Z INFO garage_api_common::generic_server: 192.168.1.4:44836 PUT /farm/2kk5g3c3d6w3xr4ycwzrvsimag0421xn.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091945Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b705736b5aa6f9183aa5caf10059dc9b46b43b41fca1eb04df424ddd8c14304e worker2 # [ 81.257617] nix-grpc-daemon[992]: time=2026-11-12T09:19:46.530Z level=INFO msg="Upload complete. (219ms)" lb # [ 84.111736] garage[898]: 2026-11-12T09:19:45.856587Z INFO garage_api_common::generic_server: 192.168.1.4:44832 PUT /farm/log/dksndlbsaxs7hh7wcajqjj5y5ng0k40k-uses-input-w1onlya.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091945Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a95c44765f3d3ec73cb19d6f5e894109af57691d187dc7e3b95ea9f876f9493c worker2 # [ 81.264575] nix-grpc-daemon[791]: ts=2026-11-12T09:19:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43368 duration_s=1 drv=dksndlbsaxs7hh7wcajqjj5y5ng0k40k-uses-input-w1onlya.drv assign_id=3 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 84.123151] garage[898]: 2026-11-12T09:19:45.859011Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/2kk5g3c3d6w3xr4ycwzrvsimag0421xn.ls worker2 # [ 81.275938] nix-daemon[976]: reaped child process 1075, status = succeeded lb # [ 84.128576] garage[898]: 2026-11-12T09:19:45.861949Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/log/dksndlbsaxs7hh7wcajqjj5y5ng0k40k-uses-input-w1onlya.drv lb # [ 84.134094] garage[898]: 2026-11-12T09:19:45.862583Z INFO garage_api_common::generic_server: 192.168.1.4:44832 PUT /farm/2kk5g3c3d6w3xr4ycwzrvsimag0421xn.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091945Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fb2c0b44b556bb997d29400bec9e72d300e880640eedd0baa5bf09956aa44727 worker2 # [ 81.291145] nix-grpc-daemon[791]: ts=2026-11-12T09:19:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 84.143924] garage[898]: 2026-11-12T09:19:45.867802Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/2kk5g3c3d6w3xr4ycwzrvsimag0421xn.narinfo lb # [ 84.150029] niks3-server[956]: 2026/11/12 09:19:45 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign lb # [ 84.152667] niks3-server[956]: 2026/11/12 09:19:45 INFO Signed narinfos id=8 count=1 lb # [ 84.154535] niks3-server[956]: 2026/11/12 09:19:45 INFO Registered completed upload object_key=2kk5g3c3d6w3xr4ycwzrvsimag0421xn.ls lb # [ 84.157347] niks3-server[956]: 2026/11/12 09:19:45 INFO Received complete push request method=POST path=/api/pushes/8/complete lb # [ 84.162648] niks3-server[956]: 2026/11/12 09:19:45 INFO Completed push id=8 objects=4 duration=5.3352ms lb # [ 84.165828] niks3-server[956]: 2026/11/12 09:19:45 INFO Registered completed upload object_key=log/dksndlbsaxs7hh7wcajqjj5y5ng0k40k-uses-input-w1onlya.drv lb # [ 84.169123] niks3-server[956]: 2026/11/12 09:19:45 INFO Registered completed upload object_key=2kk5g3c3d6w3xr4ycwzrvsimag0421xn.narinfo worker1 # [ 82.874867] nix-grpc-daemon[485]: ts=2026-11-12T09:19:46Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 82.885365] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 84.206959] garage[898]: 2026-11-12T09:19:45.966018Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker1 # [ 82.906279] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 1/5) lb # [ 84.212196] garage[898]: 2026-11-12T09:19:45.966492Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 82.973755] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 2/5) worker1 # [ 83.032963] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 306 ms (attempt 3/5) worker1 # [ 83.181023] nix-daemon[1059]: reaped child process 1176, status = succeeded worker1 # [ 83.301143] nix-daemon[1059]: accepted connection from pid 1199, user nix-grpc-daemon (trusted) lb # [ 84.623628] niks3-server[956]: 2026/11/12 09:19:46 INFO Received push request method=POST path=/api/pushes worker1 # [ 83.325835] nix-daemon[1059]: reaped child process 1202, status = succeeded worker1 # [ 83.332791] nix-grpc-daemon[1104]: time=2026-11-12T09:19:47.126Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 83.336739] nix-grpc-daemon[1104]: time=2026-11-12T09:19:47.126Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" worker1 # [ 83.342845] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 94 ms (attempt 4/5) worker1 # [ 83.350925] nix-grpc-daemon[1104]: time=2026-11-12T09:19:47.144Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.636478] garage[898]: 2026-11-12T09:19:46.395798Z INFO garage_api_common::generic_server: 192.168.1.3:60974 PUT /farm/log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091946Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8f9410742b6be5d2ab8f995962c43af7a3bf5300b4261b8baabbeebba8553270 lb # [ 84.658964] garage[898]: 2026-11-12T09:19:46.406685Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/39qxwzy2zkij70y9zvbr59pb0df38w5h.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091946Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2aaf2a9e94d5fc1981cdd853d52048fad081e340045838418b10782ab8f04cb4 lb # [ 84.668752] garage[898]: 2026-11-12T09:19:46.407072Z INFO garage_api_common::generic_server: 192.168.1.3:32772 PUT /farm/nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091946Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9dd953f7432871f3400faf7d4a7cda3892113b73ce9c3d9d857fa9215eafa1f8 worker1 # [ 83.380208] nix-grpc-daemon[1104]: time=2026-11-12T09:19:47.174Z level=INFO msg="Upload complete. (216ms)" worker1 # [ 83.388253] nix-grpc-daemon[485]: ts=2026-11-12T09:19:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=4 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 84.682185] garage[898]: 2026-11-12T09:19:46.410915Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091946Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=77856aa228ea844e7766b2bd5b9fcc613d407b74ff4cb3d00bce38739a9e14ea lb # [ 84.692426] garage[898]: 2026-11-12T09:19:46.412353Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker1 # [ 83.398400] nix-daemon[1059]: reaped child process 1174, status = succeeded lb # [ 84.697460] garage[898]: 2026-11-12T09:19:46.412764Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 84.702545] garage[898]: 2026-11-12T09:19:46.413275Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 84.707900] niks3-server[956]: 2026/11/12 09:19:46 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign worker2 # [ 81.855257] nix-grpc-daemon[791]: ts=2026-11-12T09:19:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 84.710413] niks3-server[956]: 2026/11/12 09:19:46 INFO Signed narinfos id=9 count=1 lb # [ 84.711978] niks3-server[956]: 2026/11/12 09:19:46 INFO Received complete push request method=POST path=/api/pushes/9/complete lb # [ 84.716854] niks3-server[956]: 2026/11/12 09:19:46 INFO Completed push id=9 objects=12 duration=24.76854ms lb # [ 84.721060] niks3-server[956]: 2026/11/12 09:19:46 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker2 # [ 81.868958] nix-grpc-daemon[791]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... lb # [ 84.723658] niks3-server[956]: 2026/11/12 09:19:46 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo lb # [ 84.726240] niks3-server[956]: 2026/11/12 09:19:46 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 84.730381] niks3-server[956]: 2026/11/12 09:19:46 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 84.734105] garage[898]: 2026-11-12T09:19:46.417255Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker2 # [ 81.883364] nix-grpc-daemon[791]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... lb # [ 84.737945] garage[898]: 2026-11-12T09:19:46.475010Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo lb # [ 84.741714] garage[898]: 2026-11-12T09:19:46.476010Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker1 # [ 83.443457] nix-grpc-daemon[485]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 83.446457] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 84.746169] garage[898]: 2026-11-12T09:19:46.479579Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo lb # [ 84.750961] garage[898]: 2026-11-12T09:19:46.480338Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo lb # [ 84.756813] garage[898]: 2026-11-12T09:19:46.489718Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst worker1 # [ 83.461571] nix-grpc-daemon[485]: copying path '/nix/store/2kk5g3c3d6w3xr4ycwzrvsimag0421xn-uses-input-w1onlya' from 'http://lb:5751'... worker2 # [ 81.926181] nix-grpc-daemon[791]: ts=2026-11-12T09:19:47Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43368 worker1 # [ 83.476072] nix-grpc-daemon[485]: ts=2026-11-12T09:19:47Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=0 paths=1 nar_bytes_out=120 lb # [ 84.760426] garage[898]: 2026-11-12T09:19:46.490717Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 84.763988] garage[898]: 2026-11-12T09:19:46.505841Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 84.770796] garage[898]: 2026-11-12T09:19:46.510158Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 84.774681] garage[898]: 2026-11-12T09:19:46.515672Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/2kk5g3c3d6w3xr4ycwzrvsimag0421xn.narinfo lb # [ 84.778641] garage[898]: 2026-11-12T09:19:46.516318Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/2kk5g3c3d6w3xr4ycwzrvsimag0421xn.narinfo lb # [ 84.781933] garage[898]: 2026-11-12T09:19:46.529724Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 84.784784] garage[898]: 2026-11-12T09:19:46.530306Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker2 # [ 81.934607] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) worker1 # [ 83.491653] nix-daemon[1059]: reaped child process 1184, status = succeeded worker2 # [ 81.944991] nix-grpc-daemon[791]: ts=2026-11-12T09:19:47Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43368 duration_s=0 paths=1 nar_bytes_out=232 worker2 # [ 81.959307] nix-daemon[976]: reaped child process 1110, status = succeeded client # [ 83.550794] nix-daemon[813]: reaped child process 881, status = succeeded client # [ 83.579253] sshd-session[876]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 83.580973] sshd-session[876]: Disconnected from user root UNKNOWN port 65535 client # [ 83.582444] sshd-session[870]: pam_unix(sshd:session): session closed for user root client # [ 83.586717] nix-daemon[813]: reaped child process 819, status = succeeded client # [ 83.590735] sshd-session[794]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 83.592402] sshd-session[794]: Disconnected from user root UNKNOWN port 65535 client # [ 83.596653] sshd-session[775]: pam_unix(sshd:session): session closed for user root client # [ 83.598270] systemd[1]: sshd-vsock@5-6-3:22-2:5.service: Deactivated successfully. client # [ 83.602381] systemd[1]: session-7.scope: Deactivated successfully. client # [ 83.606707] systemd-logind[427]: Session 7 logged out. Waiting for processes to exit. client # [ 83.609677] systemd-logind[427]: Removed session 7. client # [ 83.613944] systemd[1]: sshd-vsock@1-2-3:22-2:1.service: Deactivated successfully. client # [ 83.618574] systemd[1]: session-4.scope: Deactivated successfully. client # [ 83.623152] systemd-logind[427]: Session 4 logged out. Waiting for processes to exit. client # [ 83.626005] systemd-logind[427]: Removed session 4. client # [ 83.875432] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 83.884340] systemd[1]: Started SSH per-connection Daemon (vsock:2:6). client # [ 83.891358] systemd[1]: Started SSH per-connection Daemon (vsock:2:7). client # [ 84.028986] sshd-session[916]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 84.039748] sshd-session[916]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 84.045706] sshd-session[917]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 84.053716] sshd-session[916]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 84.064465] sshd-session[917]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 84.067497] systemd-logind[427]: New session '8' of user 'root' with class 'user' and type 'tty'. client # [ 84.074186] systemd[1]: Started Session 8 of User root. client # [ 84.081856] sshd-session[917]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 84.096168] systemd-logind[427]: New session '9' of user 'root' with class 'user' and type 'tty'. client # [ 84.105754] systemd[1]: Started Session 9 of User root. client # [ 84.142528] sshd-session[931]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 84.145832] sshd-session[931]: Disconnected from user root UNKNOWN port 65535 client # [ 84.147623] sshd-session[917]: pam_unix(sshd:session): session closed for user root client # [ 84.153430] systemd[1]: sshd-vsock@7-8-3:22-2:7.service: Deactivated successfully. client # [ 84.158829] systemd[1]: session-9.scope: Deactivated successfully. client # [ 84.165817] systemd-logind[427]: Session 9 logged out. Waiting for processes to exit. client # [ 84.169796] systemd-logind[427]: Removed session 9. client # [ 84.178659] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 84.193771] systemd[1]: Started SSH per-connection Daemon (vsock:2:8). client # [ 84.349239] sshd-session[936]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 84.373898] sshd-session[936]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 84.396663] sshd-session[936]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 84.410037] systemd-logind[427]: New session '10' of user 'root' with class 'user' and type 'tty'. worker1 # [ 84.413408] nix-grpc-daemon[485]: ts=2026-11-12T09:19:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36426 client # [ 84.416549] systemd[1]: Started Session 10 of User root. worker1 # [ 84.420950] nix-grpc-daemon[485]: ts=2026-11-12T09:19:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 85.727725] garage[898]: 2026-11-12T09:19:47.485536Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo lb # [ 85.727897] garage[898]: 2026-11-12T09:19:47.486259Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 85.737197] garage[898]: 2026-11-12T09:19:47.496399Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo lb # [ 85.743258] garage[898]: 2026-11-12T09:19:47.496811Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 85.747391] garage[898]: 2026-11-12T09:19:47.502119Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo lb # [ 85.752813] garage[898]: 2026-11-12T09:19:47.502461Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 84.453933] nix-grpc-daemon[485]: ts=2026-11-12T09:19:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 85.758493] garage[898]: 2026-11-12T09:19:47.518017Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo lb # [ 85.763326] garage[898]: 2026-11-12T09:19:47.518424Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 85.768067] garage[898]: 2026-11-12T09:19:47.527319Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo lb # [ 85.772417] garage[898]: 2026-11-12T09:19:47.527670Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 84.480953] nix-grpc-daemon[485]: ts=2026-11-12T09:19:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 85.786420] garage[898]: 2026-11-12T09:19:47.545662Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo lb # [ 85.792274] garage[898]: 2026-11-12T09:19:47.546092Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 85.796326] garage[898]: 2026-11-12T09:19:47.551530Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo lb # [ 85.801561] garage[898]: 2026-11-12T09:19:47.551871Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 82.949738] nix-grpc-daemon[791]: ts=2026-11-12T09:19:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 85.808700] garage[898]: 2026-11-12T09:19:47.568224Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo lb # [ 85.813571] garage[898]: 2026-11-12T09:19:47.568628Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 85.818262] garage[898]: 2026-11-12T09:19:47.577479Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo lb # [ 85.823740] garage[898]: 2026-11-12T09:19:47.577844Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 82.976690] nix-grpc-daemon[791]: ts=2026-11-12T09:19:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 85.836242] garage[898]: 2026-11-12T09:19:47.595636Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.narinfo lb # [ 85.842849] garage[898]: 2026-11-12T09:19:47.596716Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 85.846474] garage[898]: 2026-11-12T09:19:47.601530Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/z8kadp39h0myij9ln0hpxb61ldn71h4i.narinfo lb # [ 85.851353] garage[898]: 2026-11-12T09:19:47.601860Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 84.556875] nix-grpc-daemon[485]: ts=2026-11-12T09:19:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 85.855436] garage[898]: 2026-11-12T09:19:47.601994Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/knvx2sz45j0sdqm3fnbdrv7m887k7a6x.narinfo lb # [ 85.860159] garage[898]: 2026-11-12T09:19:47.602161Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 84.559974] nix-daemon[813]: accepted connection from pid 952, user root (trusted) worker1 # [ 84.568390] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 84.589945] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 84.728122] nix-daemon[1059]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) worker2 # [ 83.180932] nix-grpc-daemon[791]: ts=2026-11-12T09:19:48Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43368 worker2 # [ 83.185905] nix-grpc-daemon[791]: ts=2026-11-12T09:19:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43368 worker2 # [ 83.193533] nix-grpc-daemon[992]: time=2026-11-12T09:19:48.465Z level=INFO msg="All 1 paths already cached" worker1 # [ 84.753434] nix-daemon[1059]: reaped child process 1212, status = succeeded worker2 # [ 83.203373] nix-grpc-daemon[791]: ts=2026-11-12T09:19:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 86.059530] niks3-server[956]: 2026/11/12 09:19:47 INFO Received push request method=POST path=/api/pushes worker2 # [ 83.213564] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) worker1 # [ 84.768525] nix-grpc-daemon[1104]: time=2026-11-12T09:19:48.560Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker1 # [ 84.770231] nix-grpc-daemon[1104]: time=2026-11-12T09:19:48.560Z level=INFO msg="Uploading knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv (752B)" worker1 # [ 84.771929] nix-grpc-daemon[1104]: time=2026-11-12T09:19:48.560Z level=INFO msg="Uploading z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv (624B)" lb # [ 86.068286] garage[898]: 2026-11-12T09:19:47.827734Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/nar/0lpagyrngav67x80d1hq0njjlkmqdkvqawraz8dsp36ag50v6iwf.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091947Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5c5cb5de732b519a3ddc862382ec3ab071d6c3ad9764ffddb71a7910cbf59b4d worker1 # [ 84.775906] nix-grpc-daemon[1104]: time=2026-11-12T09:19:48.560Z level=INFO msg="Uploading 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv (512B)" worker2 # [ 83.241396] nix-grpc-daemon[992]: time=2026-11-12T09:19:48.514Z level=INFO msg="All 1 paths already cached" lb # [ 86.100310] garage[898]: 2026-11-12T09:19:47.838667Z INFO garage_api_common::generic_server: 192.168.1.3:60974 PUT /farm/nar/13mhmmy2qay13imbbdi287vhryz1hwnyg0w6agd9s0ph37wnsqll.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091947Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=04d0a1f1faf909c1f49eda43aed2eb3293ef67da382b643e3be04cbe98935f56 worker1 # [ 84.813057] nix-grpc-daemon[1104]: time=2026-11-12T09:19:48.606Z level=INFO msg="Uploading 3 narinfos" worker1 # [ 84.820109] nix-grpc-daemon[485]: ts=2026-11-12T09:19:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 84.832325] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 86.132714] garage[898]: 2026-11-12T09:19:47.839267Z INFO garage_api_common::generic_server: 192.168.1.3:32772 PUT /farm/nar/0cnhkgsbmxv5hj7zw3fa59qfxikw6251mlhz2gz1v6pgn8c8shwp.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091947Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8908516734c6a73026ab2791743c8263cdd04f322458fbccefb69fe389ca2bfb worker1 # [ 84.846157] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 1/5) lb # [ 86.143159] garage[898]: 2026-11-12T09:19:47.841019Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/knvx2sz45j0sdqm3fnbdrv7m887k7a6x.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091947Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1835b6c55535e867b2cb9202e114beeb8a03bf46036f763d2bc66ac0f69d9289 lb # [ 86.150447] garage[898]: 2026-11-12T09:19:47.841478Z INFO garage_api_common::generic_server: 192.168.1.3:33728 PUT /farm/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091947Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ae72653956c9e53dd9d9a8287832619f87185b2c480b49162ec89b822d44e60 worker1 # [ 84.858740] nix-grpc-daemon[1104]: time=2026-11-12T09:19:48.652Z level=INFO msg="Upload complete. (259ms)" lb # [ 86.158875] niks3-server[956]: 2026/11/12 09:19:47 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign lb # [ 86.161459] niks3-server[956]: 2026/11/12 09:19:47 INFO Registered completed upload object_key=nar/0lpagyrngav67x80d1hq0njjlkmqdkvqawraz8dsp36ag50v6iwf.nar.zst lb # [ 86.164620] niks3-server[956]: 2026/11/12 09:19:47 INFO Signed narinfos id=10 count=3 lb # [ 86.166824] niks3-server[956]: 2026/11/12 09:19:47 INFO Registered completed upload object_key=nar/13mhmmy2qay13imbbdi287vhryz1hwnyg0w6agd9s0ph37wnsqll.nar.zst lb # [ 86.169800] niks3-server[956]: 2026/11/12 09:19:47 INFO Registered completed upload object_key=nar/0cnhkgsbmxv5hj7zw3fa59qfxikw6251mlhz2gz1v6pgn8c8shwp.nar.zst worker1 # [ 84.869454] nix-grpc-daemon[485]: ts=2026-11-12T09:19:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=0 paths=3 nar_bytes_in=1888 lb # [ 86.172261] niks3-server[956]: 2026/11/12 09:19:47 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.ls lb # [ 86.174480] niks3-server[956]: 2026/11/12 09:19:47 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.ls lb # [ 86.177564] niks3-server[956]: 2026/11/12 09:19:47 INFO Received complete push request method=POST path=/api/pushes/10/complete lb # [ 86.179937] niks3-server[956]: 2026/11/12 09:19:47 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.narinfo worker1 # [ 84.881245] nix-grpc-daemon[485]: ts=2026-11-12T09:19:48Z level=debug event=want client=5 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv cached=0 lb # [ 86.182726] niks3-server[956]: 2026/11/12 09:19:47 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.narinfo worker1 # [ 84.884597] nix-grpc-daemon[485]: ts=2026-11-12T09:19:48Z level=debug event=assigned drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv worker=192.168.1.4:50051 clients=1 lb # [ 86.185819] niks3-server[956]: 2026/11/12 09:19:47 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.narinfo worker1 # [ 84.887638] nix-daemon[1059]: reaped child process 1205, status = succeeded lb # [ 86.187958] niks3-server[956]: 2026/11/12 09:19:47 INFO Completed push id=10 objects=9 duration=28.45736ms worker2 # [ 83.333581] nix-grpc-daemon[791]: ts=2026-11-12T09:19:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 86.189750] garage[898]: 2026-11-12T09:19:47.843094Z INFO garage_api_common::generic_server: 192.168.1.3:33726 PUT /farm/z8kadp39h0myij9ln0hpxb61ldn71h4i.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091947Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=295fe083603c4252d4356531668ad0ad70ffcd05b57cac1d831e5aa84eaf6d7c worker2 # [ 83.342313] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) lb # [ 86.195938] garage[898]: 2026-11-12T09:19:47.843588Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/5yw9j67byng77vij4238qbzaknsdpfxc.narinfo lb # [ 86.199064] garage[898]: 2026-11-12T09:19:47.843773Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 86.201389] garage[898]: 2026-11-12T09:19:47.855100Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/nar/0lpagyrngav67x80d1hq0njjlkmqdkvqawraz8dsp36ag50v6iwf.nar.zst lb # [ 86.204455] garage[898]: 2026-11-12T09:19:47.859970Z INFO garage_api_common::generic_server: 127.0.0.1:35122 (key GK0123456789abcdef01234567) HEAD /farm/nar/13mhmmy2qay13imbbdi287vhryz1hwnyg0w6agd9s0ph37wnsqll.nar.zst lb # [ 86.208795] garage[898]: 2026-11-12T09:19:47.872629Z INFO garage_api_common::generic_server: 127.0.0.1:42990 (key GK0123456789abcdef01234567) HEAD /farm/nar/0cnhkgsbmxv5hj7zw3fa59qfxikw6251mlhz2gz1v6pgn8c8shwp.nar.zst worker2 # [ 83.361152] nix-grpc-daemon[791]: copying path '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' from 'http://lb:5751'... lb # [ 86.213090] garage[898]: 2026-11-12T09:19:47.872989Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/z8kadp39h0myij9ln0hpxb61ldn71h4i.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091947Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7b848e097adf2da25ce879d3ef69d6f8da98136850c54c505b5c3e265a04b21c lb # [ 86.220472] niks3-server[956]: 2026/11/12 09:19:47 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.ls lb # [ 86.222261] garage[898]: 2026-11-12T09:19:47.875795Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/knvx2sz45j0sdqm3fnbdrv7m887k7a6x.ls lb # [ 86.224877] garage[898]: 2026-11-12T09:19:47.876427Z INFO garage_api_common::generic_server: 192.168.1.3:33726 PUT /farm/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091947Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3c0dd23a16af85e1ae8b2491de7bb4bb6eda8e2025addaba40fa038738857735 worker2 # [ 83.376585] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) lb # [ 86.230462] garage[898]: 2026-11-12T09:19:47.878965Z INFO garage_api_common::generic_server: 192.168.1.3:33728 PUT /farm/knvx2sz45j0sdqm3fnbdrv7m887k7a6x.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091947Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7d4a0cd6c780b16688272e14dc4d68b33e981f14e767a8a962b1a617a63be9bf lb # [ 86.236130] garage[898]: 2026-11-12T09:19:47.881590Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/z8kadp39h0myij9ln0hpxb61ldn71h4i.ls lb # [ 86.238665] garage[898]: 2026-11-12T09:19:47.885846Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.ls lb # [ 86.241924] garage[898]: 2026-11-12T09:19:47.886308Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/knvx2sz45j0sdqm3fnbdrv7m887k7a6x.narinfo lb # [ 86.244588] garage[898]: 2026-11-12T09:19:47.886657Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.narinfo worker2 # [ 83.392271] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) lb # [ 86.247293] garage[898]: 2026-11-12T09:19:47.891263Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/z8kadp39h0myij9ln0hpxb61ldn71h4i.narinfo lb # [ 86.250059] garage[898]: 2026-11-12T09:19:47.968229Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.narinfo lb # [ 86.252687] garage[898]: 2026-11-12T09:19:47.972479Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) GET /farm/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.narinfo lb # [ 86.255340] garage[898]: 2026-11-12T09:19:47.979369Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/nar/13mhmmy2qay13imbbdi287vhryz1hwnyg0w6agd9s0ph37wnsqll.nar.zst lb # [ 86.258381] garage[898]: 2026-11-12T09:19:47.979927Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) GET /farm/nar/13mhmmy2qay13imbbdi287vhryz1hwnyg0w6agd9s0ph37wnsqll.nar.zst lb # [ 86.326075] envoy[897]: conn peer=[2001:db8:1::1]:40960 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=841 tx=487 ms=287 lb # [ 86.328904] envoy[897]: conn peer=[2001:db8:1::1]:40972 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=334 ms=36 lb # [ 86.331459] envoy[897]: conn peer=[2001:db8:1::1]:40962 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2969 tx=1955 ms=3361 lb # [ 86.334370] envoy[897]: conn peer=[2001:db8:1::1]:34718 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=40 lb # [ 86.336882] envoy[897]: conn peer=[2001:db8:1::1]:40986 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3278 tx=2084 ms=1934 lb # [ 86.339359] envoy[897]: conn peer=[2001:db8:1::1]:34736 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=330 ms=633 lb # [ 86.341983] envoy[897]: conn peer=[2001:db8:1::1]:40992 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3822 tx=2009 ms=2981 lb # [ 86.344497] envoy[897]: conn peer=[2001:db8:1::1]:34740 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=407 ms=44 lb # [ 86.346907] envoy[897]: conn peer=[2001:db8:1::1]:34734 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3635 tx=2317 ms=1782 worker1 # [ 85.070913] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 2/5) worker1 # [ 85.153255] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 342 ms (attempt 3/5) worker1 # [ 85.497670] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 469 ms (attempt 4/5) worker1 # [ 85.969643] nix-grpc-daemon[485]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 85.971861] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 87.280755] garage[898]: 2026-11-12T09:19:49.039431Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/qac1cayk4mxz6c5bwdj4mblk7s0cira9.narinfo lb # [ 87.286335] garage[898]: 2026-11-12T09:19:49.045645Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) GET /farm/qac1cayk4mxz6c5bwdj4mblk7s0cira9.narinfo worker1 # [ 85.993476] nix-grpc-daemon[485]: copying path '/nix/store/qac1cayk4mxz6c5bwdj4mblk7s0cira9-local-input-w1only.drv' from 'http://lb:5751'... lb # [ 87.299911] garage[898]: 2026-11-12T09:19:49.059395Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/nar/0gy3zc52ky54qs5jsrsxgnqp3jr10c3wij0h0586cjil9a9d9ida.nar.zst lb # [ 87.306783] garage[898]: 2026-11-12T09:19:49.065737Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) GET /farm/nar/0gy3zc52ky54qs5jsrsxgnqp3jr10c3wij0h0586cjil9a9d9ida.nar.zst worker1 # [ 86.018307] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) client # [ 86.079802] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 86.086371] systemd[1]: Started SSH per-connection Daemon (vsock:2:9). client # [ 86.181066] sshd-session[969]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 86.186783] nix-daemon[1059]: accepted connection from pid 1226, user nix-grpc-daemon (trusted) client # [ 86.191213] sshd-session[969]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 86.200129] sshd-session[969]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 87.511417] niks3-server[956]: 2026/11/12 09:19:49 INFO Received push request method=POST path=/api/pushes client # [ 86.208839] systemd-logind[427]: New session '11' of user 'root' with class 'user' and type 'tty'. worker1 # [ 86.217327] nix-daemon[1059]: reaped child process 1229, status = succeeded worker1 # [ 86.220388] nix-grpc-daemon[1104]: time=2026-11-12T09:19:50.013Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 86.222727] nix-grpc-daemon[1104]: time=2026-11-12T09:19:50.016Z level=INFO msg="Uploading 5yw9j67byng77vij4238qbzaknsdpfxc-uses-input-w1onlyb.drv (592B)" client # [ 86.220600] systemd[1]: Started Session 11 of User root. lb # [ 87.523090] garage[898]: 2026-11-12T09:19:49.282579Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/nar/06mfk0b36bdw1yczflqq648panf71hgzriaa2yws4g5m45z7khnr.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091949Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=02a230b54cf4b50dd3da83038f4cd8bf269fa8cd9bad23875e95bac16519faf7 worker1 # [ 86.239078] nix-grpc-daemon[1104]: time=2026-11-12T09:19:50.032Z level=INFO msg="Uploading 1 narinfos" client # [ 86.245228] sshd-session[975]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 86.247992] sshd-session[975]: Disconnected from user root UNKNOWN port 65535 client # [ 86.249755] sshd-session[969]: pam_unix(sshd:session): session closed for user root lb # [ 87.548225] garage[898]: 2026-11-12T09:19:49.293335Z INFO garage_api_common::generic_server: 192.168.1.3:33726 PUT /farm/5yw9j67byng77vij4238qbzaknsdpfxc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091949Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=66a2034df40db266107e0a5afd7cc889296156632c9167b3adc8915d2694f625 client # [ 86.254490] systemd[1]: sshd-vsock@9-10-3:22-2:9.service: Deactivated successfully. worker1 # [ 86.258329] nix-grpc-daemon[1104]: time=2026-11-12T09:19:50.052Z level=INFO msg="Upload complete. (227ms)" client # [ 86.258658] systemd[1]: session-11.scope: Deactivated successfully. lb # [ 87.558597] garage[898]: 2026-11-12T09:19:49.296475Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/nar/06mfk0b36bdw1yczflqq648panf71hgzriaa2yws4g5m45z7khnr.nar.zst worker1 # [ 86.264260] nix-grpc-daemon[485]: ts=2026-11-12T09:19:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=1 paths=1 nar_bytes_in=592 lb # [ 87.565176] garage[898]: 2026-11-12T09:19:49.298588Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/5yw9j67byng77vij4238qbzaknsdpfxc.ls client # [ 86.265454] systemd-logind[427]: Session 11 logged out. Waiting for processes to exit. client # [ 86.268979] systemd-logind[427]: Removed session 11. worker1 # [ 86.275638] nix-daemon[1059]: reaped child process 1215, status = succeeded lb # [ 87.572846] garage[898]: 2026-11-12T09:19:49.299088Z INFO garage_api_common::generic_server: 192.168.1.3:33726 PUT /farm/5yw9j67byng77vij4238qbzaknsdpfxc.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091949Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=818061a6b18009484f99c201ccb452d76ef0f3d2fadea5db27fe67a73681e698 lb # [ 87.583035] garage[898]: 2026-11-12T09:19:49.305358Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/5yw9j67byng77vij4238qbzaknsdpfxc.narinfo lb # [ 87.590078] niks3-server[956]: 2026/11/12 09:19:49 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign worker1 # [ 86.291050] nix-grpc-daemon[485]: ts=2026-11-12T09:19:50Z level=debug event=want client=6 drv=5yw9j67byng77vij4238qbzaknsdpfxc-uses-input-w1onlyb.drv cached=0 lb # [ 87.593228] niks3-server[956]: 2026/11/12 09:19:49 INFO Signed narinfos id=11 count=1 worker1 # [ 86.295140] nix-grpc-daemon[485]: ts=2026-11-12T09:19:50Z level=debug event=assigned drv=5yw9j67byng77vij4238qbzaknsdpfxc-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 lb # [ 87.595709] niks3-server[956]: 2026/11/12 09:19:49 INFO Registered completed upload object_key=5yw9j67byng77vij4238qbzaknsdpfxc.ls lb # [ 87.599641] niks3-server[956]: 2026/11/12 09:19:49 INFO Received complete push request method=POST path=/api/pushes/11/complete worker1 # [ 86.300855] nix-grpc-daemon[485]: ts=2026-11-12T09:19:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 87.602670] niks3-server[956]: 2026/11/12 09:19:49 INFO Registered completed upload object_key=nar/06mfk0b36bdw1yczflqq648panf71hgzriaa2yws4g5m45z7khnr.nar.zst lb # [ 87.605767] niks3-server[956]: 2026/11/12 09:19:49 INFO Completed push id=11 objects=6 duration=15.2246ms lb # [ 87.607596] niks3-server[956]: 2026/11/12 09:19:49 INFO Registered completed upload object_key=5yw9j67byng77vij4238qbzaknsdpfxc.narinfo worker1 # [ 86.309947] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 87.610066] garage[898]: 2026-11-12T09:19:49.331578Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo lb # [ 87.613951] garage[898]: 2026-11-12T09:19:49.332064Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 86.322844] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) test farm::independent::build_hook_through_nix_daemon ... ok worker2 # [ 85.035296] nix-daemon[976]: reaped child process 1120, status = succeeded worker2 # [ 85.162675] nix-daemon[976]: accepted connection from pid 1136, user nix-grpc-daemon (trusted) lb # [ 88.036251] niks3-server[956]: 2026/11/12 09:19:49 INFO Received push request method=POST path=/api/pushes worker2 # [ 85.187023] nix-daemon[976]: reaped child process 1139, status = succeeded worker2 # [ 85.190710] nix-grpc-daemon[992]: time=2026-11-12T09:19:50.462Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 85.192926] nix-grpc-daemon[992]: time=2026-11-12T09:19:50.462Z level=INFO msg="Uploading 2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a (128B)" lb # [ 88.044436] garage[898]: 2026-11-12T09:19:49.803817Z INFO garage_api_common::generic_server: 192.168.1.4:44832 PUT /farm/log/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091949Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6e5e3d274cdd8cb2e3267eed4d4ceb3bb13e8760975e297aea3cc76d4385aae9 worker2 # [ 85.206378] nix-grpc-daemon[992]: time=2026-11-12T09:19:50.479Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.061123] garage[898]: 2026-11-12T09:19:49.814524Z INFO garage_api_common::generic_server: 192.168.1.4:44816 PUT /farm/2ykckkv44ccpw95ad66fm21ggp6krwj9.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091949Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1dc364955fe92d97ccca96c195e661edb6851f2691aa9e161ea77766931ea4dc worker2 # [ 85.226826] nix-grpc-daemon[992]: time=2026-11-12T09:19:50.499Z level=INFO msg="Upload complete. (221ms)" lb # [ 88.077367] garage[898]: 2026-11-12T09:19:49.815339Z INFO garage_api_common::generic_server: 192.168.1.4:44836 PUT /farm/nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091949Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8edc4ae3d6a5ec26e603aa90171f5a72ab65b2d7371924cac7857a9fce2525bb worker2 # [ 85.236802] nix-grpc-daemon[791]: ts=2026-11-12T09:19:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43368 duration_s=1 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv assign_id=5 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 88.089888] garage[898]: 2026-11-12T09:19:49.820054Z INFO garage_api_common::generic_server: 192.168.1.4:44836 PUT /farm/2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091949Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5785837c64319df094cb443fbe2e0bcc994f6722d3e24841441495106b129d2c worker2 # [ 85.245613] nix-daemon[976]: reaped child process 1118, status = succeeded lb # [ 88.099231] garage[898]: 2026-11-12T09:19:49.820615Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/2ykckkv44ccpw95ad66fm21ggp6krwj9.ls lb # [ 88.104142] niks3-server[956]: 2026/11/12 09:19:49 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign lb # [ 88.107020] niks3-server[956]: 2026/11/12 09:19:49 INFO Signed narinfos id=12 count=1 lb # [ 88.109582] niks3-server[956]: 2026/11/12 09:19:49 INFO Received complete push request method=POST path=/api/pushes/12/complete lb # [ 88.114789] niks3-server[956]: 2026/11/12 09:19:49 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst worker1 # [ 86.815975] nix-grpc-daemon[485]: ts=2026-11-12T09:19:50Z level=debug event=want client=5 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv cached=0 lb # [ 88.118548] niks3-server[956]: 2026/11/12 09:19:49 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.ls worker1 # [ 86.820089] nix-grpc-daemon[485]: ts=2026-11-12T09:19:50Z level=debug event=assigned drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv worker=192.168.1.4:50051 clients=1 lb # [ 88.123133] niks3-server[956]: 2026/11/12 09:19:49 INFO Registered completed upload object_key=log/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv worker2 # [ 85.270047] nix-grpc-daemon[791]: ts=2026-11-12T09:19:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 88.126443] niks3-server[956]: 2026/11/12 09:19:49 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo lb # [ 88.131906] niks3-server[956]: 2026/11/12 09:19:49 INFO Completed push id=12 objects=4 duration=8.18864ms worker2 # [ 85.279562] nix-grpc-daemon[791]: copying path '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' from 'http://lb:5751'... lb # [ 88.134419] garage[898]: 2026-11-12T09:19:49.830122Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/log/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv lb # [ 88.138754] garage[898]: 2026-11-12T09:19:49.830588Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 88.143686] garage[898]: 2026-11-12T09:19:49.835911Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo lb # [ 88.150052] garage[898]: 2026-11-12T09:19:49.889829Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/z8kadp39h0myij9ln0hpxb61ldn71h4i.narinfo lb # [ 88.154160] garage[898]: 2026-11-12T09:19:49.890784Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) GET /farm/z8kadp39h0myij9ln0hpxb61ldn71h4i.narinfo worker2 # [ 85.303401] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) lb # [ 88.157706] garage[898]: 2026-11-12T09:19:49.908383Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/nar/0cnhkgsbmxv5hj7zw3fa59qfxikw6251mlhz2gz1v6pgn8c8shwp.nar.zst lb # [ 88.161668] garage[898]: 2026-11-12T09:19:49.909175Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) GET /farm/nar/0cnhkgsbmxv5hj7zw3fa59qfxikw6251mlhz2gz1v6pgn8c8shwp.nar.zst worker2 # [ 85.318131] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) lb # [ 88.214970] garage[898]: 2026-11-12T09:19:49.974249Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/n0cysx1k72ii6xg52038fi9231fbf9dr.narinfo lb # [ 88.220225] garage[898]: 2026-11-12T09:19:49.974675Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 87.388760] nix-daemon[1059]: reaped child process 1236, status = succeeded worker1 # [ 87.493575] nix-daemon[1059]: accepted connection from pid 1254, user nix-grpc-daemon (trusted) lb # [ 88.816439] niks3-server[956]: 2026/11/12 09:19:50 INFO Received push request method=POST path=/api/pushes worker1 # [ 87.519118] nix-daemon[1059]: reaped child process 1257, status = succeeded worker1 # [ 87.528598] nix-grpc-daemon[1104]: time=2026-11-12T09:19:51.318Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 88.826313] garage[898]: 2026-11-12T09:19:50.585141Z INFO garage_api_common::generic_server: 192.168.1.3:33726 PUT /farm/n0cysx1k72ii6xg52038fi9231fbf9dr.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091950Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c1f0d2d5e64606981df170f425dd0e169e655e9199cc5bb9e6b5f8bf8ad3a063 worker1 # [ 87.542254] nix-grpc-daemon[1104]: time=2026-11-12T09:19:51.335Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.850784] garage[898]: 2026-11-12T09:19:50.596588Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/log/5yw9j67byng77vij4238qbzaknsdpfxc-uses-input-w1onlyb.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091950Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fb6f29600336c946119d6cee853532061306e17da7962380aa69aa07c900993b worker1 # [ 87.561292] nix-grpc-daemon[1104]: time=2026-11-12T09:19:51.355Z level=INFO msg="Upload complete. (228ms)" lb # [ 88.861016] garage[898]: 2026-11-12T09:19:50.599053Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/n0cysx1k72ii6xg52038fi9231fbf9dr.ls lb # [ 88.866331] garage[898]: 2026-11-12T09:19:50.601910Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/log/5yw9j67byng77vij4238qbzaknsdpfxc-uses-input-w1onlyb.drv worker1 # [ 87.568148] nix-grpc-daemon[485]: ts=2026-11-12T09:19:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=1 drv=5yw9j67byng77vij4238qbzaknsdpfxc-uses-input-w1onlyb.drv assign_id=6 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 88.871723] garage[898]: 2026-11-12T09:19:50.602400Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/n0cysx1k72ii6xg52038fi9231fbf9dr.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091950Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bb7911bd6d68d9f0799fd0677ce3d093e2765cc15b38de8a912efac593e61ac8 worker1 # [ 87.581649] nix-daemon[1059]: reaped child process 1234, status = succeeded lb # [ 88.881865] garage[898]: 2026-11-12T09:19:50.607133Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/n0cysx1k72ii6xg52038fi9231fbf9dr.narinfo lb # [ 88.887459] niks3-server[956]: 2026/11/12 09:19:50 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign worker1 # [ 87.588655] nix-grpc-daemon[485]: ts=2026-11-12T09:19:51Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 88.890623] niks3-server[956]: 2026/11/12 09:19:50 INFO Signed narinfos id=13 count=1 lb # [ 88.893108] niks3-server[956]: 2026/11/12 09:19:50 INFO Registered completed upload object_key=n0cysx1k72ii6xg52038fi9231fbf9dr.ls lb # [ 88.895581] niks3-server[956]: 2026/11/12 09:19:50 INFO Received complete push request method=POST path=/api/pushes/13/complete lb # [ 88.898046] niks3-server[956]: 2026/11/12 09:19:50 INFO Registered completed upload object_key=log/5yw9j67byng77vij4238qbzaknsdpfxc-uses-input-w1onlyb.drv lb # [ 88.901045] niks3-server[956]: 2026/11/12 09:19:50 INFO Registered completed upload object_key=n0cysx1k72ii6xg52038fi9231fbf9dr.narinfo lb # [ 88.904196] niks3-server[956]: 2026/11/12 09:19:50 INFO Completed push id=13 objects=4 duration=15.40712ms worker1 # [ 87.615937] nix-grpc-daemon[485]: ts=2026-11-12T09:19:51Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 87.624634] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 87.634737] nix-grpc-daemon[485]: ts=2026-11-12T09:19:51Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=0 paths=1 nar_bytes_out=120 worker1 # [ 87.649051] nix-daemon[1059]: reaped child process 1259, status = succeeded client # [ 87.693190] nix-daemon[813]: reaped child process 955, status = succeeded client # [ 87.704547] sshd-session[950]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 87.708383] sshd-session[950]: Disconnected from user root UNKNOWN port 65535 client # [ 87.711630] sshd-session[936]: pam_unix(sshd:session): session closed for user root client # [ 87.718116] systemd[1]: sshd-vsock@8-9-3:22-2:8.service: Deactivated successfully. client # [ 87.724764] systemd[1]: session-10.scope: Deactivated successfully. client # [ 87.730960] systemd-logind[427]: Session 10 logged out. Waiting for processes to exit. client # [ 87.734752] systemd-logind[427]: Removed session 10. lb # [ 89.134795] garage[898]: 2026-11-12T09:19:50.894127Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo lb # [ 89.140074] garage[898]: 2026-11-12T09:19:50.894562Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 87.975010] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 87.983997] systemd[1]: Started SSH per-connection Daemon (vsock:2:10). client # [ 88.090039] sshd-session[988]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 88.100701] sshd-session[988]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 86.559677] nix-daemon[976]: reaped child process 1145, status = succeeded client # [ 88.110139] sshd-session[988]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 88.119170] systemd-logind[427]: New session '12' of user 'root' with class 'user' and type 'tty'. client # [ 88.125619] systemd[1]: Started Session 12 of User root. worker2 # [ 86.668907] nix-daemon[976]: accepted connection from pid 1161, user nix-grpc-daemon (trusted) lb # [ 89.545891] niks3-server[956]: 2026/11/12 09:19:51 INFO Received push request method=POST path=/api/pushes worker2 # [ 86.696197] nix-daemon[976]: reaped child process 1164, status = succeeded worker2 # [ 86.700507] nix-grpc-daemon[992]: time=2026-11-12T09:19:51.972Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 86.702130] nix-grpc-daemon[992]: time=2026-11-12T09:19:51.972Z level=INFO msg="Uploading h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b (176B)" client # [ 88.261939] nix-daemon[813]: accepted connection from pid 996, user root (trusted) worker2 # [ 86.719312] nix-grpc-daemon[992]: time=2026-11-12T09:19:51.992Z level=INFO msg="Uploading 1 narinfos" lb # [ 89.558799] garage[898]: 2026-11-12T09:19:51.318245Z INFO garage_api_common::generic_server: 192.168.1.4:44836 PUT /farm/log/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091951Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b762fc317ebedb2df8d585e57a6cf27e6687e430e82c103025fb9338adb51c7f lb # [ 89.583995] garage[898]: 2026-11-12T09:19:51.328720Z INFO garage_api_common::generic_server: 192.168.1.4:44832 PUT /farm/h1r17djqpb9gp4y7v8nzx65ns9vdr50c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091951Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=60a72b029cb783c7b10752fa4ecfd61ec724d7d98b70b29327974f8f3303384b lb # [ 89.592776] garage[898]: 2026-11-12T09:19:51.329125Z INFO garage_api_common::generic_server: 192.168.1.4:44816 PUT /farm/nar/0f75gpfkjj0g9xi2113yvvpdw0l16spc2f1xik1ifnzfbrvx4pfk.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091951Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=701d1a0b0006ebd5310b21038fc15b6fb0ee9deeb9cbad8a4b29aaf2a5013698 worker2 # [ 86.750248] nix-grpc-daemon[992]: time=2026-11-12T09:19:52.023Z level=INFO msg="Upload complete. (219ms)" lb # [ 89.604110] garage[898]: 2026-11-12T09:19:51.333047Z INFO garage_api_common::generic_server: 192.168.1.4:44832 PUT /farm/h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091951Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=49fb2ac4230794ca81a17f2ae0a404d94456bbeef9b07bc84a9aef2f8134cc91 lb # [ 89.613307] garage[898]: 2026-11-12T09:19:51.333530Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/h1r17djqpb9gp4y7v8nzx65ns9vdr50c.ls lb # [ 89.618156] garage[898]: 2026-11-12T09:19:51.333866Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/nar/0f75gpfkjj0g9xi2113yvvpdw0l16spc2f1xik1ifnzfbrvx4pfk.nar.zst worker2 # [ 86.760784] nix-grpc-daemon[791]: ts=2026-11-12T09:19:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43368 duration_s=1 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv assign_id=7 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 86.771827] nix-daemon[976]: reaped child process 1143, status = succeeded lb # [ 89.623555] garage[898]: 2026-11-12T09:19:51.336843Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/log/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv lb # [ 89.628562] niks3-server[956]: 2026/11/12 09:19:51 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign lb # [ 89.631726] niks3-server[956]: 2026/11/12 09:19:51 INFO Signed narinfos id=14 count=1 lb # [ 89.634713] niks3-server[956]: 2026/11/12 09:19:51 INFO Received complete push request method=POST path=/api/pushes/14/complete worker1 # [ 88.336388] nix-grpc-daemon[485]: ts=2026-11-12T09:19:52Z level=debug event=want client=5 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv cached=0 lb # [ 89.637833] niks3-server[956]: 2026/11/12 09:19:51 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.ls worker1 # [ 88.339945] nix-grpc-daemon[485]: ts=2026-11-12T09:19:52Z level=debug event=assigned drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv worker=192.168.1.4:50051 clients=1 lb # [ 89.641259] niks3-server[956]: 2026/11/12 09:19:51 INFO Registered completed upload object_key=nar/0f75gpfkjj0g9xi2113yvvpdw0l16spc2f1xik1ifnzfbrvx4pfk.nar.zst worker2 # [ 86.788466] nix-grpc-daemon[791]: ts=2026-11-12T09:19:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 89.644544] niks3-server[956]: 2026/11/12 09:19:51 INFO Registered completed upload object_key=log/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv lb # [ 89.649492] niks3-server[956]: 2026/11/12 09:19:51 INFO Completed push id=14 objects=8 duration=25.5991ms lb # [ 89.652437] niks3-server[956]: 2026/11/12 09:19:51 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo lb # [ 89.655032] garage[898]: 2026-11-12T09:19:51.341699Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo lb # [ 89.658548] garage[898]: 2026-11-12T09:19:51.407787Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/knvx2sz45j0sdqm3fnbdrv7m887k7a6x.narinfo worker2 # [ 86.807021] nix-grpc-daemon[791]: copying path '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' from 'http://lb:5751'... lb # [ 89.662186] garage[898]: 2026-11-12T09:19:51.408734Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/knvx2sz45j0sdqm3fnbdrv7m887k7a6x.narinfo lb # [ 89.667363] garage[898]: 2026-11-12T09:19:51.425946Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/nar/0lpagyrngav67x80d1hq0njjlkmqdkvqawraz8dsp36ag50v6iwf.nar.zst lb # [ 89.670829] garage[898]: 2026-11-12T09:19:51.426751Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/nar/0lpagyrngav67x80d1hq0njjlkmqdkvqawraz8dsp36ag50v6iwf.nar.zst worker2 # [ 86.819849] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) worker2 # [ 86.834447] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) worker1 # [ 88.427516] nix-grpc-daemon[485]: ts=2026-11-12T09:19:52Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 88.432567] nix-grpc-daemon[485]: ts=2026-11-12T09:19:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 88.436834] nix-grpc-daemon[1104]: time=2026-11-12T09:19:52.229Z level=INFO msg="All 1 paths already cached" worker1 # [ 88.442869] nix-grpc-daemon[485]: ts=2026-11-12T09:19:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 88.452323] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 89.763615] garage[898]: 2026-11-12T09:19:51.522769Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/b76gs1nlm4402j3x75lncjgj4i78z95w.narinfo lb # [ 89.769829] garage[898]: 2026-11-12T09:19:51.523218Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 88.474306] nix-grpc-daemon[1104]: time=2026-11-12T09:19:52.268Z level=INFO msg="All 1 paths already cached" worker1 # [ 88.480940] nix-grpc-daemon[485]: ts=2026-11-12T09:19:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 88.491281] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 88.644932] nix-daemon[1059]: accepted connection from pid 1267, user nix-grpc-daemon (trusted) worker1 # [ 88.671911] nix-daemon[1059]: reaped child process 1270, status = succeeded lb # [ 89.976346] niks3-server[956]: 2026/11/12 09:19:51 INFO Received push request method=POST path=/api/pushes worker1 # [ 88.683898] nix-grpc-daemon[1104]: time=2026-11-12T09:19:52.476Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 88.685892] nix-grpc-daemon[1104]: time=2026-11-12T09:19:52.476Z level=INFO msg="Uploading b76gs1nlm4402j3x75lncjgj4i78z95w-uses-input-w1onlyc.drv (592B)" lb # [ 89.984681] garage[898]: 2026-11-12T09:19:51.743380Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/nar/0nv5g6ain5qaddbc4ydi0mggwqlns9jay6bgnn8q4vrv3spinljz.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091951Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9045793f93cc6028f3f90693a096edfe36742ac3e03e9d786ec14926b173a8be worker1 # [ 88.698249] nix-grpc-daemon[1104]: time=2026-11-12T09:19:52.491Z level=INFO msg="Uploading 1 narinfos" worker1 # [ 88.708621] nix-grpc-daemon[1104]: time=2026-11-12T09:19:52.502Z level=INFO msg="Upload complete. (204ms)" lb # [ 90.008336] garage[898]: 2026-11-12T09:19:51.754892Z INFO garage_api_common::generic_server: 192.168.1.3:33726 PUT /farm/b76gs1nlm4402j3x75lncjgj4i78z95w.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091951Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dddee8bb82e6eb9b1fed260ab7e88757e05b3fb3f96ebf54958c831157f8573b worker1 # [ 88.716305] nix-grpc-daemon[485]: ts=2026-11-12T09:19:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=0 paths=1 nar_bytes_in=592 worker1 # [ 88.723199] nix-daemon[1059]: reaped child process 1265, status = succeeded lb # [ 90.018759] garage[898]: 2026-11-12T09:19:51.758204Z INFO garage_api_common::generic_server: 192.168.1.3:33726 PUT /farm/b76gs1nlm4402j3x75lncjgj4i78z95w.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091951Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1b02a434a5ba4a5b4b517b4b684094114115b81b4b0673bcd1fdc1e946363f98 lb # [ 90.028712] garage[898]: 2026-11-12T09:19:51.760042Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/nar/0nv5g6ain5qaddbc4ydi0mggwqlns9jay6bgnn8q4vrv3spinljz.nar.zst lb # [ 90.033806] garage[898]: 2026-11-12T09:19:51.760482Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/b76gs1nlm4402j3x75lncjgj4i78z95w.ls worker1 # [ 88.740962] nix-grpc-daemon[485]: ts=2026-11-12T09:19:52Z level=debug event=want client=7 drv=b76gs1nlm4402j3x75lncjgj4i78z95w-uses-input-w1onlyc.drv cached=0 lb # [ 90.039688] garage[898]: 2026-11-12T09:19:51.763318Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/b76gs1nlm4402j3x75lncjgj4i78z95w.narinfo worker1 # [ 88.743742] nix-grpc-daemon[485]: ts=2026-11-12T09:19:52Z level=debug event=assigned drv=b76gs1nlm4402j3x75lncjgj4i78z95w-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 lb # [ 90.045252] niks3-server[956]: 2026/11/12 09:19:51 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign lb # [ 90.048821] niks3-server[956]: 2026/11/12 09:19:51 INFO Signed narinfos id=15 count=1 worker1 # [ 88.749847] nix-grpc-daemon[485]: ts=2026-11-12T09:19:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 90.050710] niks3-server[956]: 2026/11/12 09:19:51 INFO Received complete push request method=POST path=/api/pushes/15/complete lb # [ 90.053756] niks3-server[956]: 2026/11/12 09:19:51 INFO Registered completed upload object_key=nar/0nv5g6ain5qaddbc4ydi0mggwqlns9jay6bgnn8q4vrv3spinljz.nar.zst lb # [ 90.057014] niks3-server[956]: 2026/11/12 09:19:51 INFO Registered completed upload object_key=b76gs1nlm4402j3x75lncjgj4i78z95w.ls worker1 # [ 88.758126] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 90.059448] niks3-server[956]: 2026/11/12 09:19:51 INFO Completed push id=15 objects=6 duration=6.82584ms lb # [ 90.061447] niks3-server[956]: 2026/11/12 09:19:51 INFO Registered completed upload object_key=b76gs1nlm4402j3x75lncjgj4i78z95w.narinfo worker1 # [ 88.771130] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 90.154798] garage[898]: 2026-11-12T09:19:51.914201Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo lb # [ 90.159773] garage[898]: 2026-11-12T09:19:51.914634Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 87.677057] nix-daemon[976]: reaped child process 1170, status = succeeded lb # [ 90.533111] garage[898]: 2026-11-12T09:19:52.292227Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/0wlmri7p6mpwggy6pfpbai7qgzhcs1ds.narinfo lb # [ 90.537944] garage[898]: 2026-11-12T09:19:52.292681Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 87.799947] nix-daemon[976]: accepted connection from pid 1186, user nix-grpc-daemon (trusted) lb # [ 90.674636] niks3-server[956]: 2026/11/12 09:19:52 INFO Received push request method=POST path=/api/pushes worker2 # [ 87.826864] nix-daemon[976]: reaped child process 1189, status = succeeded worker2 # [ 87.830166] nix-grpc-daemon[992]: time=2026-11-12T09:19:53.101Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 87.831850] nix-grpc-daemon[992]: time=2026-11-12T09:19:53.101Z level=INFO msg="Uploading 4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top (232B)" lb # [ 90.684071] garage[898]: 2026-11-12T09:19:52.443552Z INFO garage_api_common::generic_server: 192.168.1.4:44832 PUT /farm/log/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091952Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=08414d580091971082da1d3a62657b6cab6f15df2e5e8a8a0e7bc28dfad38be0 worker2 # [ 87.845751] nix-grpc-daemon[992]: time=2026-11-12T09:19:53.118Z level=INFO msg="Uploading 1 narinfos" lb # [ 90.699980] garage[898]: 2026-11-12T09:19:52.453550Z INFO garage_api_common::generic_server: 192.168.1.4:44836 PUT /farm/4s2wbz2hg55lpb7s5vn3ynd342bs09lw.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091952Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=faa78f51ef0d888fbd9f1a4ec0007838d34e98ef7cb6578dec0aa9dfb642fb60 lb # [ 90.713609] garage[898]: 2026-11-12T09:19:52.454142Z INFO garage_api_common::generic_server: 192.168.1.4:44816 PUT /farm/nar/07ar364rwqqniwi2nkdpqlgv7ws7702n5lqz703ackfmssrh40v8.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091952Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=897f93b12885c7d0f89b935eed8de46e0edab04ed0a2797440757d67f417c2ed lb # [ 90.725145] garage[898]: 2026-11-12T09:19:52.459284Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/nar/07ar364rwqqniwi2nkdpqlgv7ws7702n5lqz703ackfmssrh40v8.nar.zst worker2 # [ 87.882659] nix-grpc-daemon[992]: time=2026-11-12T09:19:53.155Z level=INFO msg="Upload complete. (235ms)" lb # [ 90.735409] niks3-server[956]: 2026/11/12 09:19:52 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign lb # [ 90.738707] niks3-server[956]: 2026/11/12 09:19:52 INFO Signed narinfos id=16 count=1 lb # [ 90.741440] niks3-server[956]: 2026/11/12 09:19:52 INFO Received complete push request method=POST path=/api/pushes/16/complete lb # [ 90.744852] niks3-server[956]: 2026/11/12 09:19:52 INFO Registered completed upload object_key=log/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv lb # [ 90.748267] niks3-server[956]: 2026/11/12 09:19:52 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.ls worker2 # [ 87.892798] nix-grpc-daemon[791]: ts=2026-11-12T09:19:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43368 duration_s=1 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv assign_id=8 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 90.751417] niks3-server[956]: 2026/11/12 09:19:52 INFO Registered completed upload object_key=nar/07ar364rwqqniwi2nkdpqlgv7ws7702n5lqz703ackfmssrh40v8.nar.zst lb # [ 90.754781] niks3-server[956]: 2026/11/12 09:19:52 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo worker2 # [ 87.904885] nix-daemon[976]: reaped child process 1168, status = succeeded lb # [ 90.757484] garage[898]: 2026-11-12T09:19:52.468986Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/4s2wbz2hg55lpb7s5vn3ynd342bs09lw.ls lb # [ 90.761694] garage[898]: 2026-11-12T09:19:52.469522Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/log/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv lb # [ 90.765828] garage[898]: 2026-11-12T09:19:52.469797Z INFO garage_api_common::generic_server: 192.168.1.4:44816 PUT /farm/4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091952Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b67b3f9b27b639e7c3789a69e00a0f3592d45c726b983a050776ac83773fcaae client # [ 89.468992] sshd-session[928]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 89.472398] sshd-session[928]: Disconnected from user root UNKNOWN port 65535 lb # [ 90.773844] garage[898]: 2026-11-12T09:19:52.486960Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo lb # [ 90.779071] niks3-server[956]: 2026/11/12 09:19:52 INFO Completed push id=16 objects=12 duration=24.4964ms client # [ 89.475383] sshd-session[916]: pam_unix(sshd:session): session closed for user root client # [ 89.482226] systemd[1]: sshd-vsock@6-7-3:22-2:6.service: Deactivated successfully. client # [ 89.488964] systemd[1]: session-8.scope: Deactivated successfully. client # [ 89.494329] systemd[1]: session-8.scope: Consumed 215ms CPU time over 5.418s wall clock time, 42.3M memory peak, 12.7K incoming IP traffic, 13.6K outgoing IP traffic. client # [ 89.501798] systemd-logind[427]: Session 8 logged out. Waiting for processes to exit. client # [ 89.504811] systemd-logind[427]: Removed session 8. worker1 # [ 89.601739] nix-daemon[1059]: reaped child process 1277, status = succeeded worker1 # [ 89.744100] nix-daemon[1059]: accepted connection from pid 1293, user nix-grpc-daemon (trusted) lb # [ 91.064719] niks3-server[956]: 2026/11/12 09:19:52 INFO Received push request method=POST path=/api/pushes worker1 # [ 89.770085] nix-daemon[1059]: reaped child process 1296, status = succeeded worker1 # [ 89.772477] nix-grpc-daemon[1104]: time=2026-11-12T09:19:53.565Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 91.075664] garage[898]: 2026-11-12T09:19:52.834516Z INFO garage_api_common::generic_server: 192.168.1.3:33726 PUT /farm/0wlmri7p6mpwggy6pfpbai7qgzhcs1ds.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091952Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a21996f888035b28c552df2522c5b117c7e9e30486be00de1c95367333455bbf worker1 # [ 89.789926] nix-grpc-daemon[1104]: time=2026-11-12T09:19:53.583Z level=INFO msg="Uploading 1 narinfos" lb # [ 91.099357] garage[898]: 2026-11-12T09:19:52.845877Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/log/b76gs1nlm4402j3x75lncjgj4i78z95w-uses-input-w1onlyc.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091952Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fdf8fcb38ad98af253f9fc00faa78d16614e2e3088a28ed911fbb25ebe3a519c worker1 # [ 89.810412] nix-grpc-daemon[1104]: time=2026-11-12T09:19:53.603Z level=INFO msg="Upload complete. (229ms)" lb # [ 91.109491] garage[898]: 2026-11-12T09:19:52.849417Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/0wlmri7p6mpwggy6pfpbai7qgzhcs1ds.ls lb # [ 91.114854] garage[898]: 2026-11-12T09:19:52.849956Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/log/b76gs1nlm4402j3x75lncjgj4i78z95w-uses-input-w1onlyc.drv worker1 # [ 89.817142] nix-grpc-daemon[485]: ts=2026-11-12T09:19:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=1 drv=b76gs1nlm4402j3x75lncjgj4i78z95w-uses-input-w1onlyc.drv assign_id=9 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 91.120621] garage[898]: 2026-11-12T09:19:52.850230Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/0wlmri7p6mpwggy6pfpbai7qgzhcs1ds.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T091952Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b41034a393b1eb952831cd2e8920c4b3d2067e143312b3bda05a522ac1ef870 worker1 # [ 89.830513] nix-daemon[1059]: reaped child process 1275, status = succeeded lb # [ 91.130269] garage[898]: 2026-11-12T09:19:52.855153Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/0wlmri7p6mpwggy6pfpbai7qgzhcs1ds.narinfo lb # [ 91.136487] niks3-server[956]: 2026/11/12 09:19:52 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign worker2 # [ 88.283795] nix-grpc-daemon[791]: ts=2026-11-12T09:19:53Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 91.139436] niks3-server[956]: 2026/11/12 09:19:52 INFO Signed narinfos id=17 count=1 lb # [ 91.141441] niks3-server[956]: 2026/11/12 09:19:52 INFO Received complete push request method=POST path=/api/pushes/17/complete lb # [ 91.146518] niks3-server[956]: 2026/11/12 09:19:52 INFO Registered completed upload object_key=0wlmri7p6mpwggy6pfpbai7qgzhcs1ds.ls worker2 # [ 88.294320] nix-grpc-daemon[791]: copying path '/nix/store/0wlmri7p6mpwggy6pfpbai7qgzhcs1ds-uses-input-w1onlyc' from 'http://lb:5751'... lb # [ 91.149140] niks3-server[956]: 2026/11/12 09:19:52 INFO Registered completed upload object_key=log/b76gs1nlm4402j3x75lncjgj4i78z95w-uses-input-w1onlyc.drv lb # [ 91.151949] niks3-server[956]: 2026/11/12 09:19:52 INFO Completed push id=17 objects=4 duration=14.94192ms lb # [ 91.154540] niks3-server[956]: 2026/11/12 09:19:52 INFO Registered completed upload object_key=0wlmri7p6mpwggy6pfpbai7qgzhcs1ds.narinfo lb # [ 91.159240] garage[898]: 2026-11-12T09:19:52.904634Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/0wlmri7p6mpwggy6pfpbai7qgzhcs1ds.narinfo lb # [ 91.164165] garage[898]: 2026-11-12T09:19:52.905655Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/0wlmri7p6mpwggy6pfpbai7qgzhcs1ds.narinfo lb # [ 91.167957] garage[898]: 2026-11-12T09:19:52.917407Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 91.172476] garage[898]: 2026-11-12T09:19:52.918298Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker2 # [ 88.333820] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 89.887133] nix-grpc-daemon[485]: ts=2026-11-12T09:19:53Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36426 worker2 # [ 88.342439] systemd[1025]: Activating special unit Exit the Session... worker1 # [ 89.895860] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker2 # [ 88.348899] systemd[1025]: Stopped target Main User Target. worker2 # [ 88.350404] systemd[1025]: Stopped target Basic System. worker2 # [ 88.353869] systemd[1025]: Stopped target Paths. worker1 # [ 89.905915] nix-grpc-daemon[485]: ts=2026-11-12T09:19:53Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=0 paths=1 nar_bytes_out=120 worker2 # [ 88.355158] systemd[1025]: Stopped target Sockets. worker2 # [ 88.356692] systemd[1025]: Stopped target Timers. worker2 # [ 88.358656] systemd[1025]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 88.361589] systemd[1025]: Closed D-Bus User Message Bus Socket. client # [ 89.911054] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 88.363208] systemd[1025]: Stopped Create User Files and Directories. worker2 # [ 88.365035] systemd[1025]: Removed slice User Application Slice. worker2 # [ 88.366440] systemd[1025]: Reached target Shutdown. worker1 # [ 89.920181] nix-daemon[1059]: reaped child process 1298, status = succeeded worker2 # [ 88.367821] systemd[1025]: Finished Exit the Session. worker2 # [ 88.369187] systemd[1025]: Reached target Exit the Session. client # [ 89.924336] systemd[1]: Started SSH per-connection Daemon (vsock:2:11). worker2 # [ 88.384633] systemd-logind[515]: Removed session 8. worker2 # [ 88.393754] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 88.396985] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 88.418451] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 90.005157] nix-daemon[813]: reaped child process 999, status = succeeded worker2 # [ 88.461212] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 88.466300] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 88.471789] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 90.028626] sshd-session[994]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 90.030068] sshd-session[994]: Disconnected from user root UNKNOWN port 65535 client # [ 90.036950] sshd-session[988]: pam_unix(sshd:session): session closed for user root client # [ 90.041658] systemd[1]: sshd-vsock@10-11-3:22-2:10.service: Deactivated successfully. client # [ 90.047933] systemd[1]: session-12.scope: Deactivated successfully. client # [ 90.053652] systemd-logind[427]: Session 12 logged out. Waiting for processes to exit. client # [ 90.057295] systemd-logind[427]: Removed session 12. test farm::independent::an_input_only_one_worker_has_still_reaches_the_builder ... ok client # [ 90.062883] sshd-session[1016]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 90.070489] sshd-session[1016]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 90.077288] sshd-session[1016]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 90.086294] systemd-logind[427]: New session '13' of user 'root' with class 'user' and type 'tty'. client # [ 90.092511] systemd[1]: Started Session 13 of User root. client # [ 90.232633] sshd-session[1027]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 90.234522] sshd-session[1027]: Disconnected from user root UNKNOWN port 65535 client # [ 90.236792] sshd-session[1016]: pam_unix(sshd:session): session closed for user root client # [ 90.240904] systemd[1]: sshd-vsock@11-12-3:22-2:11.service: Deactivated successfully. client # [ 90.246170] systemd[1]: session-13.scope: Deactivated successfully. client # [ 90.250469] systemd-logind[427]: Session 13 logged out. Waiting for processes to exit. client # [ 90.252945] systemd-logind[427]: Removed session 13. client # [ 90.524901] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 90.533016] systemd[1]: Started SSH per-connection Daemon (vsock:2:12). client # [ 90.625734] sshd-session[1034]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 90.636218] sshd-session[1034]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 90.645471] sshd-session[1034]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 90.655208] systemd-logind[427]: New session '14' of user 'root' with class 'user' and type 'tty'. client # [ 90.664551] systemd[1]: Started Session 14 of User root. lb # [ 92.056792] systemd[1]: Stopping User Manager for UID 0... lb # [ 92.064994] systemd[1146]: Activating special unit Exit the Session... lb # [ 92.070824] systemd[1146]: Stopped target Main User Target. lb # [ 92.073619] systemd[1146]: Stopped target Basic System. lb # [ 92.074871] systemd[1146]: Stopped target Paths. lb # [ 92.075936] systemd[1146]: Stopped target Sockets. lb # [ 92.077532] systemd[1146]: Stopped target Timers. lb # [ 92.078618] systemd[1146]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 92.080358] systemd[1146]: Closed D-Bus User Message Bus Socket. lb # [ 92.081695] systemd[1146]: Stopped Create User Files and Directories. lb # [ 92.083108] systemd[1146]: Removed slice User Application Slice. lb # [ 92.084758] systemd[1146]: Reached target Shutdown. lb # [ 92.086013] systemd[1146]: Finished Exit the Session. lb # [ 92.087168] systemd[1146]: Reached target Exit the Session. worker1 # [ 90.810369] nix-grpc-daemon[485]: ts=2026-11-12T09:19:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:34526 lb # [ 92.114248] systemd-logind[499]: Removed session 9. lb # [ 92.125943] garage[898]: 2026-11-12T09:19:53.879522Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo lb # [ 92.137634] garage[898]: 2026-11-12T09:19:53.884335Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo lb # [ 92.142365] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 90.845128] nix-grpc-daemon[485]: ts=2026-11-12T09:19:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:34526 lb # [ 92.143763] garage[898]: 2026-11-12T09:19:53.894290Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo worker1 # [ 90.849818] nix-grpc-daemon[485]: copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'http://lb:5751'... lb # [ 92.152350] garage[898]: 2026-11-12T09:19:53.894831Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo lb # [ 92.162247] garage[898]: 2026-11-12T09:19:53.895389Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo lb # [ 92.168464] garage[898]: 2026-11-12T09:19:53.896577Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) GET /farm/2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo worker1 # [ 90.871337] nix-grpc-daemon[485]: copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'http://lb:5751'... lb # [ 92.172785] systemd[1]: Stopped User Manager for UID 0. lb # [ 92.173908] garage[898]: 2026-11-12T09:19:53.921578Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 92.178387] garage[898]: 2026-11-12T09:19:53.927270Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 92.186112] garage[898]: 2026-11-12T09:19:53.944526Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/nar/0f75gpfkjj0g9xi2113yvvpdw0l16spc2f1xik1ifnzfbrvx4pfk.nar.zst worker1 # [ 90.889208] nix-grpc-daemon[485]: copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'http://lb:5751'... lb # [ 92.190255] garage[898]: 2026-11-12T09:19:53.945309Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/nar/0f75gpfkjj0g9xi2113yvvpdw0l16spc2f1xik1ifnzfbrvx4pfk.nar.zst lb # [ 92.196513] garage[898]: 2026-11-12T09:19:53.955718Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/nar/07ar364rwqqniwi2nkdpqlgv7ws7702n5lqz703ackfmssrh40v8.nar.zst lb # [ 92.201288] garage[898]: 2026-11-12T09:19:53.960479Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/nar/07ar364rwqqniwi2nkdpqlgv7ws7702n5lqz703ackfmssrh40v8.nar.zst lb # [ 92.210281] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 90.924909] sshd-session[1040]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 90.927096] sshd-session[1040]: Disconnected from user root UNKNOWN port 65535 client # [ 90.930070] sshd-session[1034]: pam_unix(sshd:session): session closed for user root client # [ 90.935826] systemd[1]: sshd-vsock@12-13-3:22-2:12.service: Deactivated successfully. lb # [ 92.245618] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 90.942728] systemd[1]: session-14.scope: Deactivated successfully. lb # [ 92.249652] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 92.252654] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 90.948547] systemd[1]: session-14.scope: Consumed 136ms CPU time over 280ms wall clock time, 23.8M memory peak, 7.4K incoming IP traffic, 5.1K outgoing IP traffic. client # [ 90.952617] systemd-logind[427]: Session 14 logged out. Waiting for processes to exit. client # [ 90.955660] systemd-logind[427]: Removed session 14. client # [ 91.782871] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 91.790798] systemd[1]: Started SSH per-connection Daemon (vsock:2:13). client # [ 91.887943] sshd-session[1054]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 91.897761] sshd-session[1054]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 91.906375] sshd-session[1054]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 91.915164] systemd-logind[427]: New session '15' of user 'root' with class 'user' and type 'tty'. client # [ 91.920528] systemd[1]: Started Session 15 of User root. worker1 # [ 92.041089] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 92.047038] systemd[1016]: Activating special unit Exit the Session... worker1 # [ 92.051642] systemd[1016]: Stopped target Main User Target. worker1 # [ 92.056715] systemd[1016]: Stopped target Basic System. worker1 # [ 92.058015] systemd[1016]: Stopped target Paths. worker1 # [ 92.059250] systemd[1016]: Stopped target Sockets. worker1 # [ 92.062005] systemd[1016]: Stopped target Timers. worker1 # [ 92.063215] systemd[1016]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 92.065270] systemd[1016]: Closed D-Bus User Message Bus Socket. worker1 # [ 92.066716] systemd[1016]: Stopped Create User Files and Directories. worker1 # [ 92.068341] systemd[1016]: Removed slice User Application Slice. worker2 # [ 90.513410] nix-grpc-daemon[791]: ts=2026-11-12T09:19:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:44636 worker1 # [ 92.069688] systemd[1016]: Reached target Shutdown. worker1 # [ 92.070788] systemd[1016]: Finished Exit the Session. worker1 # [ 92.071982] systemd[1016]: Reached target Exit the Session. worker2 # [ 90.520677] nix-grpc-daemon[791]: ts=2026-11-12T09:19:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:44636 worker1 # [ 92.089960] systemd-logind[539]: Removed session 10. client # [ 92.088933] sshd-session[1060]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 92.090412] sshd-session[1060]: Disconnected from user root UNKNOWN port 65535 client # [ 92.092505] sshd-session[1054]: pam_unix(sshd:session): session closed for user root worker1 # [ 92.098200] systemd[1]: user@0.service: Deactivated successfully. client # [ 92.096952] systemd[1]: sshd-vsock@13-14-3:22-2:13.service: Deactivated successfully. worker1 # [ 92.103545] systemd[1]: Stopped User Manager for UID 0. client # [ 92.101744] systemd[1]: session-15.scope: Deactivated successfully. client # [ 92.103428] systemd[1]: session-15.scope: Consumed 131ms CPU time over 182ms wall clock time, 23.6M memory peak, 7.2K incoming IP traffic, 5.2K outgoing IP traffic. client # [ 92.108756] systemd-logind[427]: Session 15 logged out. Waiting for processes to exit. client # [ 92.110930] systemd-logind[427]: Removed session 15. worker1 # [ 92.122616] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 92.162422] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 92.167475] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 92.173104] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 94.279154] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 94.286937] systemd[1]: Started SSH per-connection Daemon (vsock:2:14). client # [ 94.378615] sshd-session[1074]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 94.387196] sshd-session[1074]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 94.395129] sshd-session[1074]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 94.403739] systemd-logind[427]: New session '16' of user 'root' with class 'user' and type 'tty'. client # [ 94.412559] systemd[1]: Started Session 16 of User root. client # [ 94.583274] sshd-session[1080]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 94.585168] sshd-session[1080]: Disconnected from user root UNKNOWN port 65535 client # [ 94.586886] sshd-session[1074]: pam_unix(sshd:session): session closed for user root client # [ 94.590567] systemd[1]: sshd-vsock@14-15-3:22-2:14.service: Deactivated successfully. client # [ 94.596104] systemd[1]: session-16.scope: Deactivated successfully. client # [ 94.600250] systemd-logind[427]: Session 16 logged out. Waiting for processes to exit. client # [ 94.602460] systemd-logind[427]: Removed session 16. lb # [ 96.326783] envoy[897]: conn peer=[2001:db8:1::1]:34774 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=422 tx=329 ms=34 lb # [ 96.331007] envoy[897]: conn peer=[2001:db8:1::1]:34766 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3267 tx=2044 ms=2913 lb # [ 96.333754] envoy[897]: conn peer=[2001:db8:1::1]:34756 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=6324 tx=3964 ms=5067 lb # [ 96.336342] envoy[897]: conn peer=[2001:db8:1::1]:34778 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=329 ms=44 lb # [ 96.339001] envoy[897]: conn peer=[2001:db8:1::1]:34776 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3294 tx=2020 ms=1505 client # [ 95.731870] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 95.739186] systemd[1]: Started SSH per-connection Daemon (vsock:2:15). client # [ 95.837623] sshd-session[1087]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 95.847463] sshd-session[1087]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 95.856244] sshd-session[1087]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 95.867724] systemd-logind[427]: New session '17' of user 'root' with class 'user' and type 'tty'. client # [ 95.873565] systemd[1]: Started Session 17 of User root. worker2 # [ 94.490615] nix-grpc-daemon[791]: ts=2026-11-12T09:19:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43368 worker1 # [ 96.052773] nix-grpc-daemon[485]: ts=2026-11-12T09:19:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 96.061236] nix-grpc-daemon[1104]: time=2026-11-12T09:19:59.853Z level=INFO msg="All 1 paths already cached" worker2 # [ 94.510060] nix-grpc-daemon[791]: ts=2026-11-12T09:19:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43368 worker2 # [ 94.516226] nix-grpc-daemon[791]: ts=2026-11-12T09:19:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43368 worker1 # [ 96.080810] nix-grpc-daemon[485]: ts=2026-11-12T09:19:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 96.110257] nix-grpc-daemon[485]: ts=2026-11-12T09:19:59Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36426 worker2 # [ 94.556108] nix-grpc-daemon[791]: ts=2026-11-12T09:19:59Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43368 worker2 # [ 94.561137] nix-grpc-daemon[791]: ts=2026-11-12T09:19:59Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43368 worker1 # [ 96.118925] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker2 # [ 94.572722] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) worker1 # [ 96.129257] nix-grpc-daemon[485]: ts=2026-11-12T09:19:59Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 94.580872] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) worker2 # [ 94.588232] nix-grpc-daemon[791]: ts=2026-11-12T09:19:59Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43368 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 96.143858] nix-daemon[1059]: reaped child process 1307, status = succeeded worker2 # [ 94.611322] nix-grpc-daemon[791]: ts=2026-11-12T09:19:59Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43368 duration_s=0 paths=1 nar_bytes_out=232 worker2 # [ 94.625777] nix-daemon[976]: reaped child process 1197, status = succeeded worker2 # [ 94.627840] nix-daemon[976]: reaped child process 1199, status = succeeded client # [ 96.192726] sshd-session[1093]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 96.196626] sshd-session[1093]: Disconnected from user root UNKNOWN port 65535 client # [ 96.199421] sshd-session[1087]: pam_unix(sshd:session): session closed for user root client # [ 96.204745] systemd[1]: sshd-vsock@15-16-3:22-2:15.service: Deactivated successfully. client # [ 96.211662] systemd[1]: session-17.scope: Deactivated successfully. client # [ 96.214406] systemd[1]: session-17.scope: Consumed 199ms CPU time over 341ms wall clock time, 52.1M memory peak, 25.6K incoming IP traffic, 16.9K outgoing IP traffic. client # [ 96.223169] systemd-logind[427]: Session 17 logged out. Waiting for processes to exit. client # [ 96.225311] systemd-logind[427]: Removed session 17. test farm::independent::outputs_carry_the_cache_signature ... ok test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 60 filtered out; finished in 48.81s [142.08s] (finished: subtest: independent builds, in 48.91 seconds) [142.08s] subtest: scheduler and lifecycle running 22 tests test farm::serial::a_deploy_mid_build_drains_and_the_new_generation_takes_over ... lb # [ 98.629337] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 98.636998] systemd[1]: Started SSH per-connection Daemon (vsock:2:7). lb # [ 98.737928] sshd-session[1173]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 98.747840] sshd-session[1173]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 98.756589] sshd-session[1173]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 98.788510] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 98.823189] systemd-logind[499]: New session '10' of user 'root' with class 'user' and type 'tty'. lb # [ 98.835121] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 98.842514] systemd[1]: Starting User Manager for UID 0... lb # [ 98.869857] (systemd)[1182]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 98.876255] systemd-logind[499]: New session '11' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 98.972892] systemd[1182]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 99.072911] systemd[1182]: Queued start job for default target Main User Target. lb # [ 99.077009] systemd[1182]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 99.081238] systemd[1182]: Created slice User Application Slice. lb # [ 99.082250] systemd[1182]: Started Daily Cleanup of User's Temporary Directories. lb # [ 99.083318] systemd[1182]: Reached target Paths. lb # [ 99.083993] systemd[1182]: Reached target Timers. lb # [ 99.087419] systemd[1182]: Starting D-Bus User Message Bus Socket... lb # [ 99.092205] systemd[1182]: Starting Create User Files and Directories... lb # [ 99.136396] systemd[1182]: Listening on D-Bus User Message Bus Socket. lb # [ 99.138164] systemd[1182]: Finished Create User Files and Directories. lb # [ 99.139138] systemd[1182]: Reached target Sockets. lb # [ 99.144411] systemd[1182]: Reached target Basic System. lb # [ 99.145359] systemd[1182]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 99.146778] systemd[1182]: Reached target Main User Target. lb # [ 99.147573] systemd[1182]: Startup finished in 249ms. lb # [ 99.148521] systemd[1]: Started User Manager for UID 0. lb # [ 99.153033] systemd[1]: Started Session 10 of User root. lb # [ 99.170140] sshd-session[1195]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 99.172728] sshd-session[1195]: Disconnected from user root UNKNOWN port 65535 lb # [ 99.174053] sshd-session[1173]: pam_unix(sshd:session): session closed for user root lb # [ 99.178253] systemd[1]: sshd-vsock@7-8-4:22-2:7.service: Deactivated successfully. lb # [ 99.182709] systemd[1]: session-10.scope: Deactivated successfully. lb # [ 99.187184] systemd-logind[499]: Session 10 logged out. Waiting for processes to exit. lb # [ 99.189966] systemd-logind[499]: Removed session 10. lb # [ 100.826422] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 100.835062] systemd[1]: Started SSH per-connection Daemon (vsock:2:8). lb # [ 100.942423] sshd-session[1200]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 100.952911] sshd-session[1200]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 100.962201] sshd-session[1200]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 100.971921] systemd-logind[499]: New session '12' of user 'root' with class 'user' and type 'tty'. lb # [ 100.978424] systemd[1]: Started Session 12 of User root. lb # [ 101.014752] sshd-session[1206]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 101.016591] sshd-session[1206]: Disconnected from user root UNKNOWN port 65535 lb # [ 101.018490] sshd-session[1200]: pam_unix(sshd:session): session closed for user root lb # [ 101.022301] systemd[1]: sshd-vsock@8-9-4:22-2:8.service: Deactivated successfully. lb # [ 101.027704] systemd[1]: session-12.scope: Deactivated successfully. lb # [ 101.029811] systemd[1]: session-12.scope: Consumed 29ms CPU time over 52ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 101.035613] systemd-logind[499]: Session 12 logged out. Waiting for processes to exit. lb # [ 101.037149] systemd-logind[499]: Removed session 12. lb # [ 101.749138] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 101.758117] systemd[1]: Started SSH per-connection Daemon (vsock:2:9). lb # [ 101.859843] sshd-session[1211]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 101.869049] sshd-session[1211]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 101.877279] sshd-session[1211]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 101.887496] systemd-logind[499]: New session '13' of user 'root' with class 'user' and type 'tty'. lb # [ 101.892901] systemd[1]: Started Session 13 of User root. lb # [ 101.929304] sshd-session[1217]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 101.931774] sshd-session[1217]: Disconnected from user root UNKNOWN port 65535 lb # [ 101.933878] sshd-session[1211]: pam_unix(sshd:session): session closed for user root lb # [ 101.937856] systemd[1]: sshd-vsock@9-10-4:22-2:9.service: Deactivated successfully. lb # [ 101.942363] systemd[1]: session-13.scope: Deactivated successfully. lb # [ 101.944207] systemd[1]: session-13.scope: Consumed 28ms CPU time over 51ms wall clock time, 4.8M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 101.949519] systemd-logind[499]: Session 13 logged out. Waiting for processes to exit. lb # [ 101.951642] systemd-logind[499]: Removed session 13. worker1 # [ 101.230106] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 101.239674] systemd[1]: Started SSH per-connection Daemon (vsock:2:11). worker1 # [ 101.335321] sshd-session[1309]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 101.344842] sshd-session[1309]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 101.353688] sshd-session[1309]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 101.372741] systemd-logind[539]: New session '14' of user 'root' with class 'user' and type 'tty'. worker1 # [ 101.379128] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 101.414342] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 101.423254] systemd[1]: Starting User Manager for UID 0... worker1 # [ 101.450485] (systemd)[1317]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 101.457099] systemd-logind[539]: New session '15' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 101.545872] systemd[1317]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 101.645424] systemd[1317]: Queued start job for default target Main User Target. worker1 # [ 101.653032] systemd[1317]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 101.657310] systemd[1317]: Created slice User Application Slice. worker1 # [ 101.658323] systemd[1317]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 101.659395] systemd[1317]: Reached target Paths. worker1 # [ 101.662799] systemd[1317]: Reached target Timers. worker1 # [ 101.665093] systemd[1317]: Starting D-Bus User Message Bus Socket... worker1 # [ 101.666147] systemd[1317]: Starting Create User Files and Directories... worker1 # [ 101.706822] systemd[1317]: Finished Create User Files and Directories. worker1 # [ 101.711390] systemd[1317]: Listening on D-Bus User Message Bus Socket. worker1 # [ 101.713877] systemd[1317]: Reached target Sockets. worker1 # [ 101.714649] systemd[1317]: Reached target Basic System. worker1 # [ 101.715440] systemd[1317]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 101.719744] systemd[1317]: Reached target Main User Target. worker1 # [ 101.720888] systemd[1317]: Startup finished in 240ms. worker1 # [ 101.721752] systemd[1]: Started User Manager for UID 0. worker1 # [ 101.725560] systemd[1]: Started Session 14 of User root. worker1 # [ 101.741155] sshd-session[1330]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 101.743509] sshd-session[1330]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 101.745130] sshd-session[1309]: pam_unix(sshd:session): session closed for user root worker1 # [ 101.749810] systemd[1]: sshd-vsock@11-12-5:22-2:11.service: Deactivated successfully. worker1 # [ 101.754595] systemd[1]: session-14.scope: Deactivated successfully. worker1 # [ 101.759326] systemd-logind[539]: Session 14 logged out. Waiting for processes to exit. worker1 # [ 101.761919] systemd-logind[539]: Removed session 14. worker1 # [ 103.097591] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 103.105720] systemd[1]: Started SSH per-connection Daemon (vsock:2:12). worker1 # [ 103.219499] sshd-session[1335]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 103.228381] sshd-session[1335]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 103.240442] sshd-session[1335]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 103.252965] systemd-logind[539]: New session '16' of user 'root' with class 'user' and type 'tty'. worker1 # [ 103.265704] systemd[1]: Started Session 16 of User root. worker1 # [ 103.302940] sshd-session[1341]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 103.305924] sshd-session[1341]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 103.307738] sshd-session[1335]: pam_unix(sshd:session): session closed for user root worker1 # [ 103.312573] systemd[1]: sshd-vsock@12-13-5:22-2:12.service: Deactivated successfully. worker1 # [ 103.318561] systemd[1]: session-16.scope: Deactivated successfully. worker1 # [ 103.321800] systemd[1]: session-16.scope: Consumed 31ms CPU time over 59ms wall clock time, 3.1M memory peak, 19.3K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 103.326986] systemd-logind[539]: Session 16 logged out. Waiting for processes to exit. worker1 # [ 103.328438] systemd-logind[539]: Removed session 16. worker1 # [ 103.852260] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 103.861648] systemd[1]: Started SSH per-connection Daemon (vsock:2:13). worker1 # [ 103.953838] sshd-session[1346]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 103.963720] sshd-session[1346]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 103.972798] sshd-session[1346]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 103.983371] systemd-logind[539]: New session '17' of user 'root' with class 'user' and type 'tty'. worker1 # [ 103.989973] systemd[1]: Started Session 17 of User root. worker1 # [ 104.023528] sshd-session[1352]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 104.025517] sshd-session[1352]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 104.026898] sshd-session[1346]: pam_unix(sshd:session): session closed for user root worker1 # [ 104.031046] systemd[1]: sshd-vsock@13-14-5:22-2:13.service: Deactivated successfully. worker1 # [ 104.036686] systemd[1]: session-17.scope: Deactivated successfully. worker1 # [ 104.040938] systemd-logind[539]: Session 17 logged out. Waiting for processes to exit. worker1 # [ 104.043394] systemd-logind[539]: Removed session 17. worker2 # [ 102.891238] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 102.900149] systemd[1]: Started SSH per-connection Daemon (vsock:2:6). worker2 # [ 102.996988] sshd-session[1201]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 103.005602] sshd-session[1201]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 103.016213] sshd-session[1201]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 103.036439] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 103.046060] systemd-logind[515]: New session '9' of user 'root' with class 'user' and type 'tty'. worker2 # [ 103.078264] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 103.089294] systemd[1]: Starting User Manager for UID 0... worker2 # [ 103.115494] (systemd)[1209]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 103.121682] systemd-logind[515]: New session '10' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 103.218081] systemd[1209]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 103.320400] systemd[1209]: Queued start job for default target Main User Target. worker2 # [ 103.329011] systemd[1209]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 103.333365] systemd[1209]: Created slice User Application Slice. worker2 # [ 103.334400] systemd[1209]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 103.335476] systemd[1209]: Reached target Paths. worker2 # [ 103.339951] systemd[1209]: Reached target Timers. worker2 # [ 103.344230] systemd[1209]: Starting D-Bus User Message Bus Socket... worker2 # [ 103.345234] systemd[1209]: Starting Create User Files and Directories... worker2 # [ 103.378642] systemd[1209]: Finished Create User Files and Directories. worker2 # [ 103.382991] systemd[1209]: Listening on D-Bus User Message Bus Socket. worker2 # [ 103.385511] systemd[1209]: Reached target Sockets. worker2 # [ 103.386300] systemd[1209]: Reached target Basic System. worker2 # [ 103.387110] systemd[1209]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 103.390663] systemd[1209]: Reached target Main User Target. worker2 # [ 103.391562] systemd[1209]: Startup finished in 245ms. worker2 # [ 103.393080] systemd[1]: Started User Manager for UID 0. worker2 # [ 103.399268] systemd[1]: Started Session 9 of User root. worker2 # [ 103.415267] sshd-session[1222]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 103.417918] sshd-session[1222]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 103.419756] sshd-session[1201]: pam_unix(sshd:session): session closed for user root worker2 # [ 103.423732] systemd[1]: sshd-vsock@6-7-6:22-2:6.service: Deactivated successfully. worker2 # [ 103.428680] systemd[1]: session-9.scope: Deactivated successfully. worker2 # [ 103.433064] systemd-logind[515]: Session 9 logged out. Waiting for processes to exit. worker2 # [ 103.434948] systemd-logind[515]: Removed session 9. lb # [ 106.328579] envoy[897]: conn peer=[2001:db8:1::1]:45412 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=330 ms=34 lb # [ 106.328864] envoy[897]: conn peer=[2001:db8:1::1]:45408 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=382 tx=376 ms=49 lb # [ 106.328922] envoy[897]: conn peer=[2001:db8:1::1]:45418 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=384 tx=410 ms=69 lb # [ 106.329147] envoy[897]: conn peer=[2001:db8:1::1]:45394 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2889 ms=140 client # [ 106.394274] systemd[1]: Stopping User Manager for UID 0... client # [ 106.400795] systemd[757]: Activating special unit Exit the Session... client # [ 106.406432] systemd[757]: Stopped target Main User Target. client # [ 106.407744] systemd[757]: Stopped target Basic System. client # [ 106.411719] systemd[757]: Stopped target Paths. client # [ 106.413163] systemd[757]: Stopped target Sockets. client # [ 106.414198] systemd[757]: Stopped target Timers. client # [ 106.415082] systemd[757]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 106.416560] systemd[757]: Closed D-Bus User Message Bus Socket. client # [ 106.417665] systemd[757]: Stopped Create User Files and Directories. client # [ 106.418751] systemd[757]: Removed slice User Application Slice. client # [ 106.419772] systemd[757]: Reached target Shutdown. client # [ 106.420989] systemd[757]: Finished Exit the Session. client # [ 106.422003] systemd[757]: Reached target Exit the Session. client # [ 106.437691] systemd-logind[427]: Removed session 2. client # [ 106.444527] systemd[1]: user@0.service: Deactivated successfully. client # [ 106.448311] systemd[1]: Stopped User Manager for UID 0. client # [ 106.511564] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 106.545609] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 106.551837] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 106.556790] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 105.087780] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 105.096732] systemd[1]: Started SSH per-connection Daemon (vsock:2:7). worker2 # [ 105.213571] sshd-session[1227]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 105.224719] sshd-session[1227]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 105.234589] sshd-session[1227]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 105.244530] systemd-logind[515]: New session '11' of user 'root' with class 'user' and type 'tty'. worker2 # [ 105.257546] systemd[1]: Started Session 11 of User root. worker2 # [ 105.295156] sshd-session[1233]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 105.298351] sshd-session[1233]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 105.300452] sshd-session[1227]: pam_unix(sshd:session): session closed for user root worker2 # [ 105.304545] systemd[1]: sshd-vsock@7-8-6:22-2:7.service: Deactivated successfully. worker2 # [ 105.310407] systemd[1]: session-11.scope: Deactivated successfully. worker2 # [ 105.314618] systemd-logind[515]: Session 11 logged out. Waiting for processes to exit. worker2 # [ 105.317980] systemd-logind[515]: Removed session 11. lb # [ 108.653579] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 108.662016] systemd[1]: Started SSH per-connection Daemon (vsock:2:10). lb # [ 108.761703] sshd-session[1223]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 108.772146] sshd-session[1223]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 108.781008] sshd-session[1223]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 108.792458] systemd-logind[499]: New session '14' of user 'root' with class 'user' and type 'tty'. lb # [ 108.800975] systemd[1]: Started Session 14 of User root. lb # [ 108.841764] sshd-session[1229]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 108.844429] sshd-session[1229]: Disconnected from user root UNKNOWN port 65535 lb # [ 108.846029] sshd-session[1223]: pam_unix(sshd:session): session closed for user root lb # [ 108.850518] systemd[1]: sshd-vsock@10-11-4:22-2:10.service: Deactivated successfully. lb # [ 108.855529] systemd[1]: session-14.scope: Deactivated successfully. lb # [ 108.858904] systemd[1]: session-14.scope: Consumed 33ms CPU time over 56ms wall clock time, 5.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 108.863421] systemd-logind[499]: Session 14 logged out. Waiting for processes to exit. lb # [ 108.864737] systemd-logind[499]: Removed session 14. worker1 # [ 108.631086] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 108.634181] systemd[1]: Started SSH per-connection Daemon (vsock:2:14). worker1 # [ 108.731689] sshd-session[1358]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 108.740344] sshd-session[1358]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 108.751538] sshd-session[1358]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 108.761457] systemd-logind[539]: New session '18' of user 'root' with class 'user' and type 'tty'. worker1 # [ 108.769534] systemd[1]: Started Session 18 of User root. worker1 # [ 108.805088] sshd-session[1364]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 108.806717] sshd-session[1364]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 108.808383] sshd-session[1358]: pam_unix(sshd:session): session closed for user root worker1 # [ 108.812982] systemd[1]: sshd-vsock@14-15-5:22-2:14.service: Deactivated successfully. worker1 # [ 108.818261] systemd[1]: session-18.scope: Deactivated successfully. worker1 # [ 108.822351] systemd[1]: session-18.scope: Consumed 27ms CPU time over 50ms wall clock time, 4.8M memory peak, 19.3K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 108.826596] systemd-logind[539]: Session 18 logged out. Waiting for processes to exit. worker1 # [ 108.828858] systemd-logind[539]: Removed session 18. client # [ 110.104880] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 110.111237] systemd[1]: Started SSH per-connection Daemon (vsock:2:16). client # [ 110.208925] sshd-session[1116]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 110.218832] sshd-session[1116]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 110.227959] sshd-session[1116]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 110.256475] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 110.285771] systemd-logind[427]: New session '18' of user 'root' with class 'user' and type 'tty'. client # [ 110.302357] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 110.308258] systemd[1]: Starting User Manager for UID 0... client # [ 110.334175] (systemd)[1125]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 110.340321] systemd-logind[427]: New session '19' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 110.427825] systemd[1125]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 110.526804] systemd[1125]: Queued start job for default target Main User Target. client # [ 110.533109] systemd[1125]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 110.535919] systemd[1125]: Created slice User Application Slice. client # [ 110.538486] systemd[1125]: Started Daily Cleanup of User's Temporary Directories. client # [ 110.539643] systemd[1125]: Reached target Paths. client # [ 110.542536] systemd[1125]: Reached target Timers. client # [ 110.543298] systemd[1125]: Starting D-Bus User Message Bus Socket... client # [ 110.548205] systemd[1125]: Starting Create User Files and Directories... client # [ 110.590451] systemd[1125]: Finished Create User Files and Directories. client # [ 110.593340] systemd[1125]: Listening on D-Bus User Message Bus Socket. client # [ 110.594396] systemd[1125]: Reached target Sockets. client # [ 110.595120] systemd[1125]: Reached target Basic System. client # [ 110.595943] systemd[1125]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 110.602189] systemd[1125]: Reached target Main User Target. client # [ 110.603123] systemd[1125]: Startup finished in 237ms. client # [ 110.603886] systemd[1]: Started User Manager for UID 0. client # [ 110.606504] systemd[1]: Started Session 18 of User root. client # [ 110.623227] sshd-session[1138]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 110.626314] sshd-session[1138]: Disconnected from user root UNKNOWN port 65535 client # [ 110.628383] sshd-session[1116]: pam_unix(sshd:session): session closed for user root client # [ 110.633131] systemd[1]: sshd-vsock@16-17-3:22-2:16.service: Deactivated successfully. client # [ 110.638637] systemd[1]: session-18.scope: Deactivated successfully. client # [ 110.644005] systemd-logind[427]: Session 18 logged out. Waiting for processes to exit. client # [ 110.646762] systemd-logind[427]: Removed session 18. client # [ 111.765869] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 111.773998] systemd[1]: Started SSH per-connection Daemon (vsock:2:17). client # [ 111.875019] sshd-session[1143]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 111.885417] sshd-session[1143]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 111.894518] sshd-session[1143]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 111.905491] systemd-logind[427]: New session '20' of user 'root' with class 'user' and type 'tty'. client # [ 111.913400] systemd[1]: Started Session 20 of User root. client # [ 111.951774] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.pem&client-key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.key" --eval-store auto -f /nix/store/v7sckhacjvxxq8xv667z4hgvbaqhw2dd-slow.nix --argstr tag sw. client # [ 111.972186] sshd-session[1149]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 111.973641] sshd-session[1149]: Disconnected from user root UNKNOWN port 65535 client # [ 111.974661] sshd-session[1143]: pam_unix(sshd:session): session closed for user root client # [ 111.980488] systemd[1]: sshd-vsock@17-18-3:22-2:17.service: Deactivated successfully. client # [ 111.982416] systemd[1]: session-20.scope: Deactivated successfully. client # [ 111.989872] systemd-logind[427]: Session 20 logged out. Waiting for processes to exit. client # [ 111.993135] systemd-logind[427]: Removed session 20. worker2 # [ 110.611901] nix-grpc-daemon[791]: ts=2026-11-12T09:20:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43368 client # [ 112.167791] nix[1152]: don't know how to build these paths: client # [ 112.169087] nix[1152]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 110.618846] nix-grpc-daemon[791]: ts=2026-11-12T09:20:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 113.477954] garage[898]: 2026-11-12T09:20:15.237222Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo lb # [ 113.484137] garage[898]: 2026-11-12T09:20:15.243144Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 112.192902] nix-grpc-daemon[485]: ts=2026-11-12T09:20:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 113.498318] garage[898]: 2026-11-12T09:20:15.257504Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo lb # [ 113.504838] garage[898]: 2026-11-12T09:20:15.257937Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 113.508445] garage[898]: 2026-11-12T09:20:15.263836Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo lb # [ 113.513456] garage[898]: 2026-11-12T09:20:15.264263Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 110.665365] nix-grpc-daemon[791]: ts=2026-11-12T09:20:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 113.524635] garage[898]: 2026-11-12T09:20:15.283978Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo lb # [ 113.530034] garage[898]: 2026-11-12T09:20:15.284435Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 112.232138] nix[1152]: copying 1 paths to 'lb:50051'... worker1 # [ 112.237382] nix-grpc-daemon[485]: ts=2026-11-12T09:20:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36426 client # [ 112.234767] nix[1152]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker1 # [ 112.248864] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 112.265549] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 112.433047] nix-daemon[1059]: accepted connection from pid 1373, user nix-grpc-daemon (trusted) worker1 # [ 112.461327] nix-daemon[1059]: reaped child process 1376, status = succeeded lb # [ 113.765314] niks3-server[956]: 2026/11/12 09:20:15 INFO Received push request method=POST path=/api/pushes worker1 # [ 112.476399] nix-grpc-daemon[1104]: time=2026-11-12T09:20:16.269Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 112.478250] nix-grpc-daemon[1104]: time=2026-11-12T09:20:16.269Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" worker1 # [ 112.493860] nix-grpc-daemon[1104]: time=2026-11-12T09:20:16.287Z level=INFO msg="Uploading 1 narinfos" lb # [ 113.776564] garage[898]: 2026-11-12T09:20:15.535802Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092015Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=068786372c9ffd221c3a54ce2b1ff021696c91fce74701317d34a26bf44a66af lb # [ 113.802605] garage[898]: 2026-11-12T09:20:15.546040Z INFO garage_api_common::generic_server: 192.168.1.3:33726 PUT /farm/x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092015Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=53b7df97d6c430ab9d87cee6a571e6545791ba57a544b52ebb16eed6a99b0bac lb # [ 113.815986] garage[898]: 2026-11-12T09:20:15.549859Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 113.820368] garage[898]: 2026-11-12T09:20:15.553341Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst worker1 # [ 112.526180] nix-grpc-daemon[1104]: time=2026-11-12T09:20:16.319Z level=INFO msg="Upload complete. (247ms)" worker1 # [ 112.532445] nix-grpc-daemon[485]: ts=2026-11-12T09:20:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 113.828394] garage[898]: 2026-11-12T09:20:15.553870Z INFO garage_api_common::generic_server: 192.168.1.3:33726 PUT /farm/x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092015Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=02db5891820c01d08eb317c7e06ac78343c2b89a1221930306ebce5992cfdfdd lb # [ 113.839585] garage[898]: 2026-11-12T09:20:15.560523Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker1 # [ 112.544729] nix-daemon[1059]: reaped child process 1369, status = succeeded lb # [ 113.845463] niks3-server[956]: 2026/11/12 09:20:15 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign lb # [ 113.848359] niks3-server[956]: 2026/11/12 09:20:15 INFO Signed narinfos id=18 count=1 lb # [ 113.850294] niks3-server[956]: 2026/11/12 09:20:15 INFO Received complete push request method=POST path=/api/pushes/18/complete lb # [ 113.855274] niks3-server[956]: 2026/11/12 09:20:15 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls worker1 # [ 112.556674] nix-grpc-daemon[485]: ts=2026-11-12T09:20:16Z level=debug event=want client=8 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 lb # [ 113.858645] niks3-server[956]: 2026/11/12 09:20:15 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker1 # [ 112.559837] nix-grpc-daemon[485]: ts=2026-11-12T09:20:16Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=1 lb # [ 113.862394] niks3-server[956]: 2026/11/12 09:20:15 INFO Completed push id=18 objects=3 duration=28.87426ms worker2 # [ 111.009805] nix-grpc-daemon[791]: ts=2026-11-12T09:20:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43368 lb # [ 113.864498] niks3-server[956]: 2026/11/12 09:20:15 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst worker2 # [ 111.019563] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) lb # [ 113.885436] garage[898]: 2026-11-12T09:20:15.644771Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker2 # [ 111.039256] nix-grpc-daemon[791]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' from 'http://lb:5751'... lb # [ 113.891339] garage[898]: 2026-11-12T09:20:15.650420Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo lb # [ 113.899093] garage[898]: 2026-11-12T09:20:15.658654Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst lb # [ 113.905367] garage[898]: 2026-11-12T09:20:15.664504Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) GET /farm/nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst worker2 # [ 111.057931] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) client # [ 112.621845] nix[1152]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker2 # [ 111.073124] nix-daemon[976]: accepted connection from pid 791, user nix-grpc-daemon (trusted) worker1 # [ 113.173818] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 113.185002] systemd[1]: Started SSH per-connection Daemon (vsock:2:15). worker1 # [ 113.279632] sshd-session[1380]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 113.288295] sshd-session[1380]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 113.298211] sshd-session[1380]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 113.307915] systemd-logind[539]: New session '19' of user 'root' with class 'user' and type 'tty'. worker1 # [ 113.317787] systemd[1]: Started Session 19 of User root. worker1 # [ 113.361705] sshd-session[1386]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 113.364639] sshd-session[1386]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 113.366272] sshd-session[1380]: pam_unix(sshd:session): session closed for user root worker1 # [ 113.371488] systemd[1]: sshd-vsock@15-16-5:22-2:15.service: Deactivated successfully. worker1 # [ 113.377439] systemd[1]: session-19.scope: Deactivated successfully. worker1 # [ 113.382704] systemd-logind[539]: Session 19 logged out. Waiting for processes to exit. worker1 # [ 113.385700] systemd-logind[539]: Removed session 19. lb # [ 114.743604] garage[898]: 2026-11-12T09:20:16.502273Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo lb # [ 114.743831] garage[898]: 2026-11-12T09:20:16.502704Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 112.031755] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 112.037615] systemd[1]: Started SSH per-connection Daemon (vsock:2:8). worker2 # [ 112.165596] sshd-session[1254]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 112.179875] sshd-session[1254]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 112.191147] sshd-session[1254]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 112.203418] systemd-logind[515]: New session '12' of user 'root' with class 'user' and type 'tty'. worker2 # [ 112.210825] systemd[1]: Started Session 12 of User root. worker2 # [ 112.469448] sshd-session[1267]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 112.470912] sshd-session[1267]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 112.476647] sshd-session[1254]: pam_unix(sshd:session): session closed for user root worker2 # [ 112.514580] systemd[1]: sshd-vsock@8-9-6:22-2:8.service: Deactivated successfully. worker2 # [ 112.515909] systemd[1]: session-12.scope: Deactivated successfully. worker2 # [ 112.518850] systemd-logind[515]: Session 12 logged out. Waiting for processes to exit. worker2 # [ 112.524340] systemd-logind[515]: Removed session 12. lb # [ 119.056664] systemd[1]: Stopping User Manager for UID 0... lb # [ 119.066502] systemd[1182]: Activating special unit Exit the Session... lb # [ 119.070507] systemd[1182]: Stopped target Main User Target. lb # [ 119.071911] systemd[1182]: Stopped target Basic System. lb # [ 119.075567] systemd[1182]: Stopped target Paths. lb # [ 119.077339] systemd[1182]: Stopped target Sockets. lb # [ 119.078478] systemd[1182]: Stopped target Timers. lb # [ 119.079591] systemd[1182]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 119.081595] systemd[1182]: Closed D-Bus User Message Bus Socket. lb # [ 119.082940] systemd[1182]: Stopped Create User Files and Directories. lb # [ 119.084504] systemd[1182]: Removed slice User Application Slice. lb # [ 119.085959] systemd[1182]: Reached target Shutdown. lb # [ 119.087089] systemd[1182]: Finished Exit the Session. lb # [ 119.089323] systemd[1182]: Reached target Exit the Session. lb # [ 119.117867] systemd-logind[499]: Removed session 11. lb # [ 119.125456] systemd[1]: user@0.service: Deactivated successfully. lb # [ 119.128347] systemd[1]: Stopped User Manager for UID 0. lb # [ 119.191566] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 119.234710] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 119.238680] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 119.241325] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 118.997716] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 119.007695] systemd[1]: Started SSH per-connection Daemon (vsock:2:16). worker1 # [ 119.107131] sshd-session[1391]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 119.116304] sshd-session[1391]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 119.126664] sshd-session[1391]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 119.137133] systemd-logind[539]: New session '20' of user 'root' with class 'user' and type 'tty'. worker1 # [ 119.147115] systemd[1]: Started Session 20 of User root. worker1 # [ 119.179812] sshd-session[1397]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 119.182642] sshd-session[1397]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 119.184123] sshd-session[1391]: pam_unix(sshd:session): session closed for user root worker1 # [ 119.188556] systemd[1]: sshd-vsock@16-17-5:22-2:16.service: Deactivated successfully. worker1 # [ 119.194389] systemd[1]: session-20.scope: Deactivated successfully. worker1 # [ 119.198902] systemd-logind[539]: Session 20 logged out. Waiting for processes to exit. worker1 # [ 119.201321] systemd-logind[539]: Removed session 20. worker2 # [ 118.091690] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 118.095937] systemd[1]: Started SSH per-connection Daemon (vsock:2:9). worker2 # [ 118.229502] sshd-session[1272]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 118.240149] sshd-session[1272]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 118.256104] sshd-session[1272]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 118.268995] systemd-logind[515]: New session '13' of user 'root' with class 'user' and type 'tty'. worker2 # [ 118.275520] systemd[1]: Started Session 13 of User root. worker2 # [ 118.469609] sshd-session[1278]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 118.471045] sshd-session[1278]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 118.476500] sshd-session[1272]: pam_unix(sshd:session): session closed for user root worker2 # [ 118.512566] systemd[1]: sshd-vsock@9-10-6:22-2:9.service: Deactivated successfully. worker2 # [ 118.513839] systemd[1]: session-13.scope: Deactivated successfully. worker2 # [ 118.518533] systemd-logind[515]: Session 13 logged out. Waiting for processes to exit. worker2 # [ 118.519951] systemd-logind[515]: Removed session 13. worker2 # [ 120.324089] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 120.327637] systemd[1]: Started SSH per-connection Daemon (vsock:2:10). worker2 # [ 120.454529] sshd-session[1283]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 120.469719] sshd-session[1283]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 120.484903] sshd-session[1283]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 120.497783] systemd-logind[515]: New session '14' of user 'root' with class 'user' and type 'tty'. worker2 # [ 120.507614] systemd[1]: Started Session 14 of User root. client # [ 122.144829] systemd[1]: Stopping User Manager for UID 0... client # [ 122.151988] systemd[1125]: Activating special unit Exit the Session... client # [ 122.155650] systemd[1125]: Stopped target Main User Target. client # [ 122.162205] systemd[1125]: Stopped target Basic System. client # [ 122.163545] systemd[1125]: Stopped target Paths. client # [ 122.164770] systemd[1125]: Stopped target Sockets. client # [ 122.166047] systemd[1125]: Stopped target Timers. client # [ 122.167179] systemd[1125]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 122.169339] systemd[1125]: Closed D-Bus User Message Bus Socket. client # [ 122.170698] systemd[1125]: Stopped Create User Files and Directories. client # [ 122.173215] systemd[1125]: Removed slice User Application Slice. client # [ 122.174597] systemd[1125]: Reached target Shutdown. client # [ 122.175724] systemd[1125]: Finished Exit the Session. client # [ 122.177016] systemd[1125]: Reached target Exit the Session. client # [ 122.197777] systemd-logind[427]: Removed session 19. client # [ 122.205375] systemd[1]: user@0.service: Deactivated successfully. client # [ 122.208272] systemd[1]: Stopped User Manager for UID 0. client # [ 122.266678] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 122.301902] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 122.306353] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 122.309657] systemd[1]: Stopped User Runtime Directory /run/user/0. [e2e] heartbeat t=30s worker1 # [ 129.289777] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 129.296961] systemd[1317]: Activating special unit Exit the Session... worker1 # [ 129.307518] systemd[1317]: Stopped target Main User Target. worker1 # [ 129.309126] systemd[1317]: Stopped target Basic System. worker1 # [ 129.310317] systemd[1317]: Stopped target Paths. worker1 # [ 129.311429] systemd[1317]: Stopped target Sockets. worker1 # [ 129.313037] systemd[1317]: Stopped target Timers. worker1 # [ 129.314263] systemd[1317]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 129.316395] systemd[1317]: Closed D-Bus User Message Bus Socket. worker1 # [ 129.317758] systemd[1317]: Stopped Create User Files and Directories. worker1 # [ 129.319122] systemd[1317]: Removed slice User Application Slice. worker1 # [ 129.320482] systemd[1317]: Reached target Shutdown. worker1 # [ 129.321583] systemd[1317]: Finished Exit the Session. worker1 # [ 129.322677] systemd[1317]: Reached target Exit the Session. worker1 # [ 129.328934] systemd-logind[539]: Removed session 15. worker1 # [ 129.337449] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 129.340361] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 129.358577] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 129.401368] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 129.406269] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 129.411634] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 128.418636] nixos[1292]: switching to system configuration /nix/store/9j02jnz911k9rq0nk3qsa8j6g1807zdr-nixos-system-worker2-test worker2 # [ 128.424546] systemd[1]: Stopped target Local File Systems. worker2 # [ 128.425646] systemd[1]: Stopped target Remote File Systems. worker2 # [ 131.366118] systemd[1]: Reload requested from client PID 1292 ('.switch-to-conf') (unit session-14.scope)... worker2 # [ 131.366310] systemd[1]: Reloading... worker2 # [ 136.295650] systemd[1]: Reloading finished in 4915 ms. worker2 # [ 136.378425] systemd[1209]: Created slice User Core Session Slice. worker2 # [ 136.385702] systemd[1209]: Starting D-Bus User Message Bus... worker2 # [ 136.752694] dbus-broker-launch[1366]: Ignoring duplicate name 'org.freedesktop.import1' in service file '/nix/store/yl4pqpd5szm31fm2gs1ihxvf90c0knfl-system-path/share/dbus-1/services/org.freedesktop.import1.service' worker2 # [ 136.760342] dbus-broker-launch[1366]: Ignoring duplicate name 'org.freedesktop.machine1' in service file '/nix/store/yl4pqpd5szm31fm2gs1ihxvf90c0knfl-system-path/share/dbus-1/services/org.freedesktop.machine1.service' worker2 # [ 136.768086] dbus-broker-launch[1366]: Ignoring duplicate name 'org.freedesktop.portable1' in service file '/nix/store/yl4pqpd5szm31fm2gs1ihxvf90c0knfl-system-path/share/dbus-1/services/org.freedesktop.portable1.service' worker2 # [ 136.778340] dbus-broker-launch[1366]: Ignoring duplicate name 'org.freedesktop.systemd1' in service file '/nix/store/yl4pqpd5szm31fm2gs1ihxvf90c0knfl-system-path/share/dbus-1/services/org.freedesktop.systemd1.service' worker2 # [ 136.781781] dbus-broker-launch[1366]: Policy to allow eavesdropping in /etc/dbus-1/session.conf +27: Eavesdropping is deprecated and ignored worker2 # [ 136.783581] dbus-broker-launch[1366]: Policy to allow eavesdropping in /etc/dbus-1/session.conf +29: Eavesdropping is deprecated and ignored worker2 # [ 136.797899] systemd[1209]: Started D-Bus User Message Bus. worker2 # [ 136.798774] dbus-broker-launch[1366]: Ready worker2 # [ 138.011372] systemd[1209]: Reexecution requested from client PID 1365 ('switch-to-confi')... worker2 # [ 138.011533] systemd[1209]: Reexecuting. worker2 # [ 138.287279] systemd[1209]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 139.724418] systemd[1209]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 139.727197] systemd[1209]: Reload requested from client PID 1365 ('switch-to-confi')... worker2 # [ 139.729805] systemd[1209]: Reloading... worker2 # [ 141.112529] systemd[1209]: Reloading finished in 1378 ms. worker2 # [ 141.131174] systemd[1209]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 141.136287] systemd[1209]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 141.140238] systemd[1209]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 141.206769] systemd[1]: Starting Re-setup tmpfiles on a system that is already running.... worker2 # [ 141.367511] systemd[1]: Finished Re-setup tmpfiles on a system that is already running.. worker2 # [ 141.371856] systemd[1]: Reached target Reactivate sysinit units. worker2 # [ 141.386720] systemd[1]: Reloading D-Bus System Message Bus... worker2 # [ 141.395694] dbus-broker-launch[494]: Caught SIGHUP, trigger reload. worker2 # [ 141.399938] systemd[1]: Reloading Nix worker-protocol over gRPC... worker2 # [ 141.406820] dbus-broker-launch[494]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 141.419971] dbus-broker-launch[494]: NSS returned no entry for 'systemd-timesync' worker2 # [ 141.424460] dbus-broker-launch[494]: Invalid user-name in /nix/store/yl4pqpd5szm31fm2gs1ihxvf90c0knfl-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 141.434970] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker2 # [ 141.450782] systemd[1]: Reloaded D-Bus System Message Bus. worker2 # [ 141.458858] systemd[1]: Reached target Local File Systems. worker2 # [ 141.464270] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 141.476415] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 141.477458] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 141.478773] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 141.496214] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 141.497967] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 141.499321] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 141.504473] systemd[1]: Reached target Remote File Systems. worker2 # [ 141.505371] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 141.512934] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 141.864650] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 141.865882] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 141.876115] systemd[1]: Starting linger-users.service... worker2 # [ 141.877125] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 141.919322] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 141.924250] systemd[1]: Finished linger-users.service. worker2 # [ 142.175679] nixos[1292]: finished switching to system configuration /nix/store/9j02jnz911k9rq0nk3qsa8j6g1807zdr-nixos-system-worker2-test worker2 # [ 142.205354] sshd-session[1289]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 142.206704] sshd-session[1289]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 142.212936] sshd-session[1283]: pam_unix(sshd:session): session closed for user root worker2 # [ 142.248408] systemd[1]: sshd-vsock@10-11-6:22-2:10.service: Deactivated successfully. worker2 # [ 142.253612] systemd[1]: session-14.scope: Deactivated successfully. worker2 # [ 142.260459] systemd-logind[515]: Session 14 logged out. Waiting for processes to exit. worker2 # [ 142.261724] systemd-logind[515]: Removed session 14. worker2 # [ 142.368750] nix-grpc-daemon[791]: ts=2026-11-12T09:20:47Z level=info event=draining worker2 # [ 142.535305] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 142.539704] systemd[1]: Started SSH per-connection Daemon (vsock:2:11). worker2 # [ 142.663363] sshd-session[1449]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 142.674695] sshd-session[1449]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 142.687659] sshd-session[1449]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 142.704115] systemd-logind[515]: New session '15' of user 'root' with class 'user' and type 'tty'. worker2 # [ 142.711679] systemd[1]: Started Session 15 of User root. worker2 # [ 142.936352] sshd-session[1455]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 142.937820] sshd-session[1455]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 142.938831] sshd-session[1449]: pam_unix(sshd:session): session closed for user root worker2 # [ 142.989448] systemd[1]: sshd-vsock@11-12-6:22-2:11.service: Deactivated successfully. worker2 # [ 142.990693] systemd[1]: session-15.scope: Deactivated successfully. worker2 # [ 142.996550] systemd-logind[515]: Session 15 logged out. Waiting for processes to exit. worker2 # [ 142.997860] systemd-logind[515]: Removed session 15. client # [ 145.040857] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 145.048707] systemd[1]: Started SSH per-connection Daemon (vsock:2:18). client # [ 145.149966] sshd-session[1170]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 145.158593] sshd-session[1170]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 145.169514] sshd-session[1170]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 145.200592] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 145.233606] systemd-logind[427]: New session '21' of user 'root' with class 'user' and type 'tty'. client # [ 145.266647] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 145.274563] systemd[1]: Starting User Manager for UID 0... client # [ 145.305338] (systemd)[1179]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 145.312183] systemd-logind[427]: New session '22' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 145.404536] systemd[1179]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 145.505384] systemd[1179]: Queued start job for default target Main User Target. client # [ 145.513332] systemd[1179]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 145.518585] systemd[1179]: Created slice User Application Slice. client # [ 145.519568] systemd[1179]: Started Daily Cleanup of User's Temporary Directories. client # [ 145.523038] systemd[1179]: Reached target Paths. client # [ 145.523757] systemd[1179]: Reached target Timers. client # [ 145.526071] systemd[1179]: Starting D-Bus User Message Bus Socket... client # [ 145.527047] systemd[1179]: Starting Create User Files and Directories... client # [ 145.571629] systemd[1179]: Finished Create User Files and Directories. client # [ 145.576291] systemd[1179]: Listening on D-Bus User Message Bus Socket. client # [ 145.581750] systemd[1179]: Reached target Sockets. client # [ 145.582982] systemd[1179]: Reached target Basic System. client # [ 145.583974] systemd[1179]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 145.585732] systemd[1179]: Reached target Main User Target. client # [ 145.586569] systemd[1179]: Startup finished in 249ms. client # [ 145.587309] systemd[1]: Started User Manager for UID 0. client # [ 145.591751] systemd[1]: Started Session 21 of User root. worker1 # [ 145.787463] nix-grpc-daemon[485]: ts=2026-11-12T09:20:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 145.795774] nix-grpc-daemon[485]: ts=2026-11-12T09:20:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 147.102942] garage[898]: 2026-11-12T09:20:48.860927Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/42c24pndjip9nvdj8j25mkv0650griqf.narinfo lb # [ 147.109379] garage[898]: 2026-11-12T09:20:48.861411Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 147.114739] garage[898]: 2026-11-12T09:20:48.868388Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/daks7y2c761g04qpzsjx25629wigr8js.narinfo lb # [ 147.120199] garage[898]: 2026-11-12T09:20:48.868832Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 147.124196] garage[898]: 2026-11-12T09:20:48.873706Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo lb # [ 147.129164] garage[898]: 2026-11-12T09:20:48.874131Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 145.830313] nix-grpc-daemon[485]: ts=2026-11-12T09:20:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 147.135088] garage[898]: 2026-11-12T09:20:48.894555Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo lb # [ 147.140293] garage[898]: 2026-11-12T09:20:48.894991Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 147.145407] garage[898]: 2026-11-12T09:20:48.904345Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo lb # [ 147.150743] garage[898]: 2026-11-12T09:20:48.904874Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 145.856631] nix-grpc-daemon[485]: ts=2026-11-12T09:20:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 147.161188] garage[898]: 2026-11-12T09:20:48.920457Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/daks7y2c761g04qpzsjx25629wigr8js.narinfo lb # [ 147.166246] garage[898]: 2026-11-12T09:20:48.921040Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 147.171773] garage[898]: 2026-11-12T09:20:48.930694Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/daks7y2c761g04qpzsjx25629wigr8js.narinfo lb # [ 147.177428] garage[898]: 2026-11-12T09:20:48.931098Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 145.883226] nix-grpc-daemon[485]: ts=2026-11-12T09:20:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 147.187717] garage[898]: 2026-11-12T09:20:48.947184Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/42c24pndjip9nvdj8j25mkv0650griqf.narinfo lb # [ 147.193257] garage[898]: 2026-11-12T09:20:48.947622Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 147.198728] garage[898]: 2026-11-12T09:20:48.957743Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/42c24pndjip9nvdj8j25mkv0650griqf.narinfo lb # [ 147.204275] garage[898]: 2026-11-12T09:20:48.958147Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 145.910318] nix-grpc-daemon[485]: ts=2026-11-12T09:20:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 147.214999] garage[898]: 2026-11-12T09:20:48.974474Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/lbk8wy49c881163x07gb8z669j2fg1ff.narinfo lb # [ 147.222095] garage[898]: 2026-11-12T09:20:48.974909Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 147.225576] garage[898]: 2026-11-12T09:20:48.980603Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo lb # [ 147.230690] garage[898]: 2026-11-12T09:20:48.981035Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 145.936077] nix-grpc-daemon[485]: ts=2026-11-12T09:20:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 147.234614] garage[898]: 2026-11-12T09:20:48.981391Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/k3l35rf796jrnjns08398p1l8fcx178a.narinfo lb # [ 147.239290] garage[898]: 2026-11-12T09:20:48.981631Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 145.944851] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 145.968737] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 146.119909] nix-daemon[1059]: accepted connection from pid 1412, user nix-grpc-daemon (trusted) worker1 # [ 146.142475] nix-daemon[1059]: reaped child process 1415, status = succeeded lb # [ 147.449642] niks3-server[956]: 2026/11/12 09:20:49 INFO Received push request method=POST path=/api/pushes worker1 # [ 146.159937] nix-grpc-daemon[1104]: time=2026-11-12T09:20:49.952Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker1 # [ 146.162080] nix-grpc-daemon[1104]: time=2026-11-12T09:20:49.952Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" worker1 # [ 146.163862] nix-grpc-daemon[1104]: time=2026-11-12T09:20:49.952Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" worker1 # [ 146.165878] nix-grpc-daemon[1104]: time=2026-11-12T09:20:49.952Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 147.459553] garage[898]: 2026-11-12T09:20:49.218791Z INFO garage_api_common::generic_server: 192.168.1.3:33726 PUT /farm/nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092049Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ad72abe4e660adbcd661991e8e038eb3e7481f889d5df381c1d4a20bc9ce4dad worker1 # [ 146.179703] nix-grpc-daemon[1104]: time=2026-11-12T09:20:49.973Z level=INFO msg="Uploading 3 narinfos" lb # [ 147.488763] garage[898]: 2026-11-12T09:20:49.230424Z INFO garage_api_common::generic_server: 192.168.1.3:33718 PUT /farm/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092049Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dda02b63b4f0b98264931c15950bba8b71690379357077e698cd8ede93a843d2 lb # [ 147.515540] garage[898]: 2026-11-12T09:20:49.230883Z INFO garage_api_common::generic_server: 192.168.1.3:60990 PUT /farm/nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092049Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=60f10e718318102301165f4633b1173043360d17f059aacea2de0c71615628ff lb # [ 147.527828] garage[898]: 2026-11-12T09:20:49.231211Z INFO garage_api_common::generic_server: 192.168.1.3:33728 PUT /farm/nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092049Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=21e53bb5f13cc87b5a9d4ac8cb50138ad74c44f98355cb4a835cf0d03080f888 lb # [ 147.535909] garage[898]: 2026-11-12T09:20:49.231464Z INFO garage_api_common::generic_server: 192.168.1.3:60974 PUT /farm/lbk8wy49c881163x07gb8z669j2fg1ff.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092049Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=09602b4090669b448badca8315f413da16ce07fba383432b645681d656e51789 lb # [ 147.543513] niks3-server[956]: 2026/11/12 09:20:49 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign lb # [ 147.545746] niks3-server[956]: 2026/11/12 09:20:49 INFO Signed narinfos id=19 count=3 lb # [ 147.547026] niks3-server[956]: 2026/11/12 09:20:49 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst lb # [ 147.550770] niks3-server[956]: 2026/11/12 09:20:49 INFO Received complete push request method=POST path=/api/pushes/19/complete lb # [ 147.553686] niks3-server[956]: 2026/11/12 09:20:49 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls worker1 # [ 146.253917] nix-grpc-daemon[1104]: time=2026-11-12T09:20:50.047Z level=INFO msg="Upload complete. (272ms)" lb # [ 147.555517] niks3-server[956]: 2026/11/12 09:20:49 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst lb # [ 147.558825] niks3-server[956]: 2026/11/12 09:20:49 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls worker1 # [ 146.260374] nix-grpc-daemon[485]: ts=2026-11-12T09:20:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=0 paths=3 nar_bytes_in=1936 lb # [ 147.561794] niks3-server[956]: 2026/11/12 09:20:49 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst lb # [ 147.564150] niks3-server[956]: 2026/11/12 09:20:49 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo lb # [ 147.566301] niks3-server[956]: 2026/11/12 09:20:49 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls lb # [ 147.568411] niks3-server[956]: 2026/11/12 09:20:49 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo lb # [ 147.570585] garage[898]: 2026-11-12T09:20:49.231709Z INFO garage_api_common::generic_server: 192.168.1.3:32772 PUT /farm/k3l35rf796jrnjns08398p1l8fcx178a.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092049Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f883592dad8f83c86855abacf829bc8525a25f2848e51981dc9a4dbd5113ba8f lb # [ 147.578364] garage[898]: 2026-11-12T09:20:49.235946Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/k3l35rf796jrnjns08398p1l8fcx178a.ls worker1 # [ 146.280178] nix-grpc-daemon[485]: ts=2026-11-12T09:20:50Z level=debug event=want client=9 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 lb # [ 147.582191] garage[898]: 2026-11-12T09:20:49.239105Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/lbk8wy49c881163x07gb8z669j2fg1ff.ls worker1 # [ 146.284318] nix-grpc-daemon[485]: ts=2026-11-12T09:20:50Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=1 lb # [ 147.586273] garage[898]: 2026-11-12T09:20:49.239709Z INFO garage_api_common::generic_server: 127.0.0.1:49684 (key GK0123456789abcdef01234567) HEAD /farm/nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst lb # [ 147.589676] garage[898]: 2026-11-12T09:20:49.239966Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst worker1 # [ 146.292505] nix-grpc-daemon[485]: ts=2026-11-12T09:20:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 146.295471] nix-daemon[1059]: reaped child process 1408, status = succeeded lb # [ 147.593083] garage[898]: 2026-11-12T09:20:49.241313Z INFO garage_api_common::generic_server: 192.168.1.3:33728 PUT /farm/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092049Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae7019a500dcc4b8ccae96ce42c9fb1ad52d77c628e4faa2ae214a460c23d429 lb # [ 147.598720] niks3-server[956]: 2026/11/12 09:20:49 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo lb # [ 147.600423] niks3-server[956]: 2026/11/12 09:20:49 INFO Completed push id=19 objects=9 duration=52.97342ms worker1 # [ 146.302123] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 147.601842] garage[898]: 2026-11-12T09:20:49.241630Z INFO garage_api_common::generic_server: 192.168.1.3:32772 PUT /farm/k3l35rf796jrnjns08398p1l8fcx178a.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092049Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=741cb6ff5b5af3ee305e1007c8204ccef66d298ff162fdd1f3ea40098ab8f75c lb # [ 147.607251] garage[898]: 2026-11-12T09:20:49.244910Z INFO garage_api_common::generic_server: 192.168.1.3:60974 PUT /farm/lbk8wy49c881163x07gb8z669j2fg1ff.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092049Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7733f7f9fd4d358c4dce660d7f60e4b317c3e19e7f00dbbd1b9035ca5b7f4554 worker1 # [ 146.311837] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 147.613611] garage[898]: 2026-11-12T09:20:49.260879Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst lb # [ 147.616582] garage[898]: 2026-11-12T09:20:49.264166Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls lb # [ 147.619547] garage[898]: 2026-11-12T09:20:49.268505Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo lb # [ 147.622765] garage[898]: 2026-11-12T09:20:49.272368Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/lbk8wy49c881163x07gb8z669j2fg1ff.narinfo lb # [ 147.625593] garage[898]: 2026-11-12T09:20:49.273003Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/k3l35rf796jrnjns08398p1l8fcx178a.narinfo lb # [ 148.720877] garage[898]: 2026-11-12T09:20:50.479711Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker1 # [ 147.764314] nix-daemon[1059]: reaped child process 1422, status = succeeded worker1 # [ 147.883594] nix-daemon[1059]: accepted connection from pid 1438, user nix-grpc-daemon (trusted) worker1 # [ 147.907384] nix-daemon[1059]: reaped child process 1441, status = succeeded lb # [ 148.726270] garage[898]: 2026-11-12T09:20:50.481155Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 149.211224] niks3-server[956]: 2026/11/12 09:20:50 INFO Received push request method=POST path=/api/pushes worker1 # [ 147.922607] nix-grpc-daemon[1104]: time=2026-11-12T09:20:51.715Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 147.924376] nix-grpc-daemon[1104]: time=2026-11-12T09:20:51.715Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 149.222759] garage[898]: 2026-11-12T09:20:50.981977Z INFO garage_api_common::generic_server: 192.168.1.3:32772 PUT /farm/log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092050Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4a97c7c128da44869902d2917ea1e22f6d2ad44b81db94776ce37a1eef4a4aaf worker1 # [ 147.941941] nix-grpc-daemon[1104]: time=2026-11-12T09:20:51.735Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.243458] garage[898]: 2026-11-12T09:20:50.982554Z INFO garage_api_common::generic_server: 192.168.1.3:33728 PUT /farm/42c24pndjip9nvdj8j25mkv0650griqf.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092050Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=00c4407591af43e2de7c33069413781cc252224c40c3a909fc6d1dab256ca1dc lb # [ 149.259372] garage[898]: 2026-11-12T09:20:50.991903Z INFO garage_api_common::generic_server: 192.168.1.3:60974 PUT /farm/nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092050Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c28f2f20d87874c5519738774dbb7b19766711b6cb8cd5f9af76fd47eff75e83 worker1 # [ 147.969906] nix-grpc-daemon[1104]: time=2026-11-12T09:20:51.763Z level=INFO msg="Upload complete. (244ms)" lb # [ 149.270011] garage[898]: 2026-11-12T09:20:50.995558Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 149.276709] garage[898]: 2026-11-12T09:20:50.996576Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/42c24pndjip9nvdj8j25mkv0650griqf.ls worker1 # [ 147.977749] nix-grpc-daemon[485]: ts=2026-11-12T09:20:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=11 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 149.281802] garage[898]: 2026-11-12T09:20:50.998926Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 149.286534] garage[898]: 2026-11-12T09:20:51.001806Z INFO garage_api_common::generic_server: 192.168.1.3:60974 PUT /farm/42c24pndjip9nvdj8j25mkv0650griqf.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092050Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6650790f2b6fd0b7eb148bb669d3ff84963788ce108a6b99ae8275ffd8dfdb15 worker1 # [ 147.995391] nix-daemon[1059]: reaped child process 1420, status = succeeded lb # [ 149.295667] garage[898]: 2026-11-12T09:20:51.017023Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/42c24pndjip9nvdj8j25mkv0650griqf.narinfo lb # [ 149.300315] niks3-server[956]: 2026/11/12 09:20:50 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign lb # [ 149.304070] niks3-server[956]: 2026/11/12 09:20:51 INFO Signed narinfos id=20 count=1 worker1 # [ 148.004468] nix-grpc-daemon[485]: ts=2026-11-12T09:20:51Z level=debug event=want client=9 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 lb # [ 149.305923] niks3-server[956]: 2026/11/12 09:20:51 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst worker1 # [ 148.008523] nix-grpc-daemon[485]: ts=2026-11-12T09:20:51Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=1 lb # [ 149.309530] niks3-server[956]: 2026/11/12 09:20:51 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 149.313232] niks3-server[956]: 2026/11/12 09:20:51 INFO Received complete push request method=POST path=/api/pushes/20/complete worker1 # [ 148.014229] nix-grpc-daemon[485]: ts=2026-11-12T09:20:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 149.315444] niks3-server[956]: 2026/11/12 09:20:51 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 149.318033] niks3-server[956]: 2026/11/12 09:20:51 INFO Completed push id=20 objects=4 duration=14.8935ms lb # [ 149.320095] niks3-server[956]: 2026/11/12 09:20:51 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker1 # [ 148.023677] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 148.035889] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 150.054423] garage[898]: 2026-11-12T09:20:51.813194Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/daks7y2c761g04qpzsjx25629wigr8js.narinfo worker1 # [ 149.080640] nix-daemon[1059]: reaped child process 1448, status = succeeded worker1 # [ 149.203136] nix-daemon[1059]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) lb # [ 150.059648] garage[898]: 2026-11-12T09:20:51.813639Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 150.525769] niks3-server[956]: 2026/11/12 09:20:52 INFO Received push request method=POST path=/api/pushes worker1 # [ 149.230301] nix-daemon[1059]: reaped child process 1467, status = succeeded worker1 # [ 149.239519] nix-grpc-daemon[1104]: time=2026-11-12T09:20:53.030Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 149.241412] nix-grpc-daemon[1104]: time=2026-11-12T09:20:53.030Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 150.539036] garage[898]: 2026-11-12T09:20:52.298183Z INFO garage_api_common::generic_server: 192.168.1.3:60974 PUT /farm/log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092052Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=170b1aa6557cf584d1dbd7736d6bd2c19ba52d668df3140eba751a5ab09017c3 worker1 # [ 149.259902] nix-grpc-daemon[1104]: time=2026-11-12T09:20:53.053Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.559558] garage[898]: 2026-11-12T09:20:52.298814Z INFO garage_api_common::generic_server: 192.168.1.3:33728 PUT /farm/daks7y2c761g04qpzsjx25629wigr8js.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092052Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=87f74fd327cbea3723ff3625583436d1dd9480a42b14e3fad09a9c3e85666f90 lb # [ 150.574741] garage[898]: 2026-11-12T09:20:52.308192Z INFO garage_api_common::generic_server: 192.168.1.3:32772 PUT /farm/nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092052Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2743b2326ca00ab63d74233636582f9b945ad23f171ed01a4ff0481999a9eb85 lb # [ 150.584347] garage[898]: 2026-11-12T09:20:52.312373Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 150.590471] garage[898]: 2026-11-12T09:20:52.314319Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker1 # [ 149.296152] nix-grpc-daemon[1104]: time=2026-11-12T09:20:53.089Z level=INFO msg="Upload complete. (247ms)" lb # [ 150.595795] garage[898]: 2026-11-12T09:20:52.317001Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst worker1 # [ 149.304813] nix-grpc-daemon[485]: ts=2026-11-12T09:20:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=12 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 150.601934] garage[898]: 2026-11-12T09:20:52.319833Z INFO garage_api_common::generic_server: 192.168.1.3:32772 PUT /farm/daks7y2c761g04qpzsjx25629wigr8js.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092052Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ca2660ab0a9f088bcfc3b7d8764380670a3955f131aa612924332417c7d6802 lb # [ 150.611535] garage[898]: 2026-11-12T09:20:52.332953Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/daks7y2c761g04qpzsjx25629wigr8js.narinfo lb # [ 150.615865] niks3-server[956]: 2026/11/12 09:20:52 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign lb # [ 150.618860] niks3-server[956]: 2026/11/12 09:20:52 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls worker1 # [ 149.322581] nix-daemon[1059]: reaped child process 1446, status = succeeded lb # [ 150.623104] niks3-server[956]: 2026/11/12 09:20:52 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 150.626463] niks3-server[956]: 2026/11/12 09:20:52 INFO Signed narinfos id=21 count=1 worker1 # [ 149.326326] nix-grpc-daemon[485]: ts=2026-11-12T09:20:53Z level=debug event=want client=9 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 lb # [ 150.627908] niks3-server[956]: 2026/11/12 09:20:52 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst worker1 # [ 149.330210] nix-grpc-daemon[485]: ts=2026-11-12T09:20:53Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=1 lb # [ 150.631611] niks3-server[956]: 2026/11/12 09:20:52 INFO Received complete push request method=POST path=/api/pushes/21/complete lb # [ 150.634116] niks3-server[956]: 2026/11/12 09:20:52 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo lb # [ 150.636831] niks3-server[956]: 2026/11/12 09:20:52 INFO Completed push id=21 objects=8 duration=24.2646ms worker1 # [ 149.341220] nix-grpc-daemon[485]: ts=2026-11-12T09:20:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 149.343933] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 149.356202] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 151.563668] garage[898]: 2026-11-12T09:20:53.322303Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker1 # [ 150.598147] nix-daemon[1059]: reaped child process 1474, status = succeeded worker1 # [ 150.723257] nix-daemon[1059]: accepted connection from pid 1490, user nix-grpc-daemon (trusted) worker1 # [ 150.745636] nix-daemon[1059]: reaped child process 1493, status = succeeded lb # [ 151.568923] garage[898]: 2026-11-12T09:20:53.322755Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 152.051602] niks3-server[956]: 2026/11/12 09:20:53 INFO Received push request method=POST path=/api/pushes worker1 # [ 150.764484] nix-grpc-daemon[1104]: time=2026-11-12T09:20:54.556Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 150.766236] nix-grpc-daemon[1104]: time=2026-11-12T09:20:54.556Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 152.069269] garage[898]: 2026-11-12T09:20:53.828584Z INFO garage_api_common::generic_server: 192.168.1.3:32772 PUT /farm/log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092053Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ce0b078e76ba2161c10e8c27f3a18372f449d4ee8045fbdca73d7d82b4ddf5a1 worker1 # [ 150.783135] nix-grpc-daemon[1104]: time=2026-11-12T09:20:54.576Z level=INFO msg="Uploading 1 narinfos" worker1 # [ 150.794056] nix-grpc-daemon[1104]: time=2026-11-12T09:20:54.587Z level=INFO msg="Upload complete. (226ms)" lb # [ 152.094462] garage[898]: 2026-11-12T09:20:53.839123Z INFO garage_api_common::generic_server: 192.168.1.3:60974 PUT /farm/xdwmx2f4n5n8bggglniz2n35any0xz4w.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092053Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9227c7830e3120d4d75f442dc1d18bbc5db43fcf94cb0c8e8ad01d4eb5c00b37 worker1 # [ 150.803006] nix-grpc-daemon[485]: ts=2026-11-12T09:20:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=13 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 152.105770] garage[898]: 2026-11-12T09:20:53.839679Z INFO garage_api_common::generic_server: 192.168.1.3:33728 PUT /farm/nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092053Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=29c4cae1e4fbec2f67c7a3c9436efef911f3e7ecf1cf4a31456d85bc3a7006e4 worker1 # [ 150.817446] nix-daemon[1059]: reaped child process 1472, status = succeeded lb # [ 152.116282] garage[898]: 2026-11-12T09:20:53.843056Z INFO garage_api_common::generic_server: 192.168.1.3:33728 PUT /farm/xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092053Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4c92c20653f705ca6753473959844654d21ff48ffdb41acaecd74c3dc5c63c20 lb # [ 152.126017] garage[898]: 2026-11-12T09:20:53.843502Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 152.131410] garage[898]: 2026-11-12T09:20:53.846598Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 152.136312] garage[898]: 2026-11-12T09:20:53.849845Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 152.140876] niks3-server[956]: 2026/11/12 09:20:53 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign lb # [ 152.143019] niks3-server[956]: 2026/11/12 09:20:53 INFO Signed narinfos id=22 count=1 lb # [ 152.145124] niks3-server[956]: 2026/11/12 09:20:53 INFO Received complete push request method=POST path=/api/pushes/22/complete lb # [ 152.147381] niks3-server[956]: 2026/11/12 09:20:53 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 152.150011] niks3-server[956]: 2026/11/12 09:20:53 INFO Completed push id=22 objects=12 duration=8.31542ms client # [ 150.846512] sshd-session[1192]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 152.151857] niks3-server[956]: 2026/11/12 09:20:53 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo client # [ 150.850297] sshd-session[1192]: Disconnected from user root UNKNOWN port 65535 lb # [ 152.154413] niks3-server[956]: 2026/11/12 09:20:53 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 152.156621] niks3-server[956]: 2026/11/12 09:20:53 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst client # [ 150.854074] sshd-session[1170]: pam_unix(sshd:session): session closed for user root lb # [ 152.159131] garage[898]: 2026-11-12T09:20:53.851671Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo client # [ 150.859950] systemd[1]: sshd-vsock@18-19-3:22-2:18.service: Deactivated successfully. client # [ 150.868548] systemd[1]: session-21.scope: Deactivated successfully. client # [ 150.873513] systemd[1]: session-21.scope: Consumed 217ms CPU time over 5.281s wall clock time, 42.3M memory peak, 12.3K incoming IP traffic, 13.7K outgoing IP traffic. client # [ 150.881027] systemd-logind[427]: Session 21 logged out. Waiting for processes to exit. client # [ 150.882778] systemd-logind[427]: Removed session 21. client # [ 151.803391] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 151.811756] systemd[1]: Started SSH per-connection Daemon (vsock:2:19). client # [ 151.906909] sshd-session[1211]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 151.916487] sshd-session[1211]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 151.925420] sshd-session[1211]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 151.934731] systemd-logind[427]: New session '23' of user 'root' with class 'user' and type 'tty'. client # [ 151.941290] systemd[1]: Started Session 23 of User root. client # [ 152.090816] sshd-session[1217]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 152.093804] sshd-session[1217]: Disconnected from user root UNKNOWN port 65535 client # [ 152.095676] sshd-session[1211]: pam_unix(sshd:session): session closed for user root client # [ 152.100361] systemd[1]: sshd-vsock@19-20-3:22-2:19.service: Deactivated successfully. client # [ 152.105782] systemd[1]: session-23.scope: Deactivated successfully. client # [ 152.110606] systemd-logind[427]: Session 23 logged out. Waiting for processes to exit. client # [ 152.113200] systemd-logind[427]: Removed session 23. worker2 # [ 151.278179] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 151.280207] systemd[1]: Started SSH per-connection Daemon (vsock:2:12). worker2 # [ 151.406403] sshd-session[1460]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 151.420492] sshd-session[1460]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 151.432335] sshd-session[1460]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 151.448506] systemd-logind[515]: New session '16' of user 'root' with class 'user' and type 'tty'. worker2 # [ 151.455810] systemd[1]: Started Session 16 of User root. worker2 # [ 151.653870] sshd-session[1466]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 151.655311] sshd-session[1466]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 151.658707] sshd-session[1460]: pam_unix(sshd:session): session closed for user root worker2 # [ 151.662476] systemd[1]: sshd-vsock@12-13-6:22-2:12.service: Deactivated successfully. worker2 # [ 151.666607] systemd-logind[515]: Session 16 logged out. Waiting for processes to exit. worker2 # [ 151.671192] systemd[1]: session-16.scope: Deactivated successfully. worker2 # [ 151.673740] systemd-logind[515]: Removed session 16. client # [ 153.294688] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 153.301622] systemd[1]: Started SSH per-connection Daemon (vsock:2:20). worker2 # [ 151.849802] nix-daemon[976]: reaped child process 1245, status = succeeded client # [ 153.401252] sshd-session[1224]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 153.410208] sshd-session[1224]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 153.417998] sshd-session[1224]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 153.428624] systemd-logind[427]: New session '24' of user 'root' with class 'user' and type 'tty'. client # [ 153.439047] systemd[1]: Started Session 24 of User root. client # [ 153.472597] sshd-session[1230]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 153.475305] sshd-session[1230]: Disconnected from user root UNKNOWN port 65535 client # [ 153.477612] sshd-session[1224]: pam_unix(sshd:session): session closed for user root client # [ 153.481736] systemd[1]: sshd-vsock@20-21-3:22-2:20.service: Deactivated successfully. client # [ 153.487048] systemd[1]: session-24.scope: Deactivated successfully. client # [ 153.491915] systemd-logind[427]: Session 24 logged out. Waiting for processes to exit. client # [ 153.494972] systemd-logind[427]: Removed session 24. worker2 # [ 152.116250] nix-daemon[976]: accepted connection from pid 1472, user nix-grpc-daemon (trusted) lb # [ 154.991685] niks3-server[956]: 2026/11/12 09:20:56 INFO Received push request method=POST path=/api/pushes worker2 # [ 152.142497] nix-daemon[976]: reaped child process 1475, status = succeeded worker2 # [ 152.148335] nix-grpc-daemon[992]: time=2026-11-12T09:20:57.417Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 152.150017] nix-grpc-daemon[992]: time=2026-11-12T09:20:57.418Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 155.002010] garage[898]: 2026-11-12T09:20:56.761252Z INFO garage_api_common::generic_server: 192.168.1.4:44816 PUT /farm/log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092056Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6fae513eec35408d932de548df4646252bd593d1a55acbc6149a05ea3bea993a worker2 # [ 152.164098] nix-grpc-daemon[992]: time=2026-11-12T09:20:57.436Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.027252] garage[898]: 2026-11-12T09:20:56.772474Z INFO garage_api_common::generic_server: 192.168.1.4:44836 PUT /farm/qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092056Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=acf5cbd6be83504077c2bd5a14c157add00e982b8b583b360ef645f7e7f6b3ab worker2 # [ 152.183706] nix-grpc-daemon[992]: time=2026-11-12T09:20:57.456Z level=INFO msg="Upload complete. (362ms)" lb # [ 155.038245] garage[898]: 2026-11-12T09:20:56.772884Z INFO garage_api_common::generic_server: 192.168.1.4:44832 PUT /farm/nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092056Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=15c89b7cd91b5fc0dc1eb758d8ecbcaa3b8bc297a2cc3245653b99567f453ffd worker2 # [ 152.192814] nix-grpc-daemon[791]: ts=2026-11-12T09:20:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43368 duration_s=41 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=10 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 155.049846] garage[898]: 2026-11-12T09:20:56.775547Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 155.055872] garage[898]: 2026-11-12T09:20:56.777299Z INFO garage_api_common::generic_server: 127.0.0.1:35142 (key GK0123456789abcdef01234567) HEAD /farm/log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 152.208446] nix-daemon[976]: reaped child process 1243, status = succeeded lb # [ 155.061285] garage[898]: 2026-11-12T09:20:56.779353Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 155.067007] garage[898]: 2026-11-12T09:20:56.780628Z INFO garage_api_common::generic_server: 192.168.1.4:44832 PUT /farm/qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092056Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e6c7273786d2e77b381b91ffeed19fd0a5226b39dea4095d49a405ef724a863b lb # [ 155.075337] niks3-server[956]: 2026/11/12 09:20:56 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign lb # [ 155.077563] niks3-server[956]: 2026/11/12 09:20:56 INFO Signed narinfos id=23 count=1 lb # [ 155.079176] niks3-server[956]: 2026/11/12 09:20:56 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 155.081809] niks3-server[956]: 2026/11/12 09:20:56 INFO Received complete push request method=POST path=/api/pushes/23/complete lb # [ 155.083884] niks3-server[956]: 2026/11/12 09:20:56 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls client # [ 153.782789] systemd[1]: sw.service: Deactivated successfully. lb # [ 155.086201] niks3-server[956]: 2026/11/12 09:20:56 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv lb # [ 155.088495] niks3-server[956]: 2026/11/12 09:20:56 INFO Completed push id=23 objects=4 duration=11.61538ms lb # [ 155.090155] niks3-server[956]: 2026/11/12 09:20:56 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo client # [ 153.786326] systemd[1]: sw.service: Consumed 201ms CPU time over 41.833s wall clock time, 38.8M memory peak, 4K written to disk, 9.3K incoming IP traffic, 9.1K outgoing IP traffic. lb # [ 155.092443] garage[898]: 2026-11-12T09:20:56.784567Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker2 # [ 152.371650] nix-grpc-daemon[791]: ts=2026-11-12T09:20:57Z level=info event=signal_exit client # [ 154.957221] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 154.963909] systemd[1]: Started SSH per-connection Daemon (vsock:2:21). lb # [ 156.328681] envoy[897]: conn peer=[2001:db8:1::1]:53310 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=6395 tx=4005 ms=5059 lb # [ 156.331497] envoy[897]: conn peer=[2001:db8:1::1]:37472 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2873 tx=1595 ms=41614 client # [ 155.052836] sshd-session[1239]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 155.062376] sshd-session[1239]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 155.071159] sshd-session[1239]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 155.080493] systemd-logind[427]: New session '25' of user 'root' with class 'user' and type 'tty'. client # [ 155.093597] systemd[1]: Started Session 25 of User root. client # [ 155.129161] sshd-session[1245]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 155.131933] sshd-session[1245]: Disconnected from user root UNKNOWN port 65535 client # [ 155.134090] sshd-session[1239]: pam_unix(sshd:session): session closed for user root client # [ 155.137811] systemd[1]: sshd-vsock@21-22-3:22-2:21.service: Deactivated successfully. client # [ 155.142893] systemd[1]: session-25.scope: Deactivated successfully. client # [ 155.146762] systemd-logind[427]: Session 25 logged out. Waiting for processes to exit. client # [ 155.150121] systemd-logind[427]: Removed session 25. worker2 # [ 154.052483] nix-grpc-daemon[791]: ts=2026-11-12T09:20:59Z level=info event=scheduler_restarting worker1 # [ 155.612174] nix-grpc-daemon[485]: ts=2026-11-12T09:20:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:46232 worker1 # [ 155.612427] nix-grpc-daemon[485]: ts=2026-11-12T09:20:59Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 154.074145] nix-grpc-daemon[791]: ts=2026-11-12T09:20:59Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 154.152377] nix-daemon[976]: reaped child process 1067, status = succeeded worker2 # [ 154.153712] nix-daemon[976]: reaped child process 1085, status = succeeded worker2 # [ 154.154892] nix-daemon[976]: reaped child process 1112, status = succeeded worker2 # [ 154.156294] nix-daemon[976]: reaped child process 1114, status = succeeded worker2 # [ 154.157530] nix-daemon[976]: reaped child process 1239, status = succeeded worker2 # [ 154.158577] nix-daemon[976]: reaped child process 990, status = succeeded worker2 # [ 154.159739] nix-daemon[976]: reaped child process 980, status = succeeded worker2 # [ 154.161201] nix-daemon[976]: reaped child process 1036, status = succeeded client # [ 156.351444] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 156.358709] systemd[1]: Started SSH per-connection Daemon (vsock:2:22). client # [ 156.455366] sshd-session[1251]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 156.465658] sshd-session[1251]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 156.474542] sshd-session[1251]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 156.483686] systemd-logind[427]: New session '26' of user 'root' with class 'user' and type 'tty'. client # [ 156.490941] systemd[1]: Started Session 26 of User root. client # [ 156.517907] sshd-session[1257]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 156.520560] sshd-session[1257]: Disconnected from user root UNKNOWN port 65535 client # [ 156.522618] sshd-session[1251]: pam_unix(sshd:session): session closed for user root client # [ 156.526291] systemd[1]: sshd-vsock@22-23-3:22-2:22.service: Deactivated successfully. client # [ 156.531723] systemd[1]: session-26.scope: Deactivated successfully. client # [ 156.536463] systemd-logind[427]: Session 26 logged out. Waiting for processes to exit. client # [ 156.538695] systemd-logind[427]: Removed session 26. worker2 # [ 155.417239] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 155.421670] systemd[1]: nix-grpc-daemon.service: Consumed 2.470s CPU time over 2min 12.438s wall clock time, 68.1M memory peak, 4K written to disk, 149.1K incoming IP traffic, 181.7K outgoing IP traffic. worker2 # [ 155.581101] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker2 # [ 155.588802] systemd[1]: Starting scheduler-token.service... worker2 # [ 155.649769] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 155.662293] systemd[1]: Started SSH per-connection Daemon (vsock:2:13). worker2 # [ 155.676549] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 155.678021] systemd[1]: Finished scheduler-token.service. worker2 # [ 155.679081] systemd[1]: scheduler-token.service: Consumed 39ms CPU time over 76ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 155.692468] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 155.831974] nix-grpc-daemon[1487]: ts=2026-11-12T09:21:01Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 155.833903] nix-grpc-daemon[1487]: ts=2026-11-12T09:21:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 155.835728] nix-grpc-daemon[1487]: ts=2026-11-12T09:21:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 155.888659] nix-grpc-daemon[1487]: ts=2026-11-12T09:21:01Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 155.890657] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 157.455087] nix-grpc-daemon[485]: ts=2026-11-12T09:21:01Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:46232 worker2 # [ 155.902812] nix-grpc-daemon[1487]: ts=2026-11-12T09:21:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 157.459400] nix-grpc-daemon[485]: ts=2026-11-12T09:21:01Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux,riscv64-linux max_jobs=1 running=0 worker2 # [ 155.940436] sshd-session[1485]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 155.948001] sshd-session[1485]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 155.955272] sshd-session[1485]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 155.963482] systemd-logind[515]: New session '17' of user 'root' with class 'user' and type 'tty'. worker2 # [ 155.969257] systemd[1]: Started Session 17 of User root. worker2 # [ 156.001376] sshd-session[1544]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 156.003919] sshd-session[1544]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 156.005925] sshd-session[1485]: pam_unix(sshd:session): session closed for user root worker2 # [ 156.009576] systemd[1]: sshd-vsock@13-14-6:22-2:13.service: Deactivated successfully. worker2 # [ 156.014698] systemd[1]: session-17.scope: Deactivated successfully. worker2 # [ 156.019667] systemd-logind[515]: Session 17 logged out. Waiting for processes to exit. worker2 # [ 156.022517] systemd-logind[515]: Removed session 17. [e2e] heartbeat t=60s lb # [ 160.656901] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 160.662963] systemd[1]: Started SSH per-connection Daemon (vsock:2:11). lb # [ 160.759305] sshd-session[1247]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 160.768285] sshd-session[1247]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 160.779013] sshd-session[1247]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 160.795011] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 160.809255] systemd-logind[499]: New session '15' of user 'root' with class 'user' and type 'tty'. lb # [ 160.833000] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 160.848267] systemd[1]: Starting User Manager for UID 0... lb # [ 160.881608] (systemd)[1255]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 160.888141] systemd-logind[499]: New session '16' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 160.985418] systemd[1255]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 161.087070] systemd[1255]: Queued start job for default target Main User Target. lb # [ 161.097038] systemd[1255]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 161.101418] systemd[1255]: Created slice User Application Slice. lb # [ 161.102459] systemd[1255]: Started Daily Cleanup of User's Temporary Directories. lb # [ 161.106104] systemd[1255]: Reached target Paths. lb # [ 161.106885] systemd[1255]: Reached target Timers. lb # [ 161.107586] systemd[1255]: Starting D-Bus User Message Bus Socket... lb # [ 161.112294] systemd[1255]: Starting Create User Files and Directories... lb # [ 161.156173] systemd[1255]: Finished Create User Files and Directories. lb # [ 161.166338] systemd[1255]: Listening on D-Bus User Message Bus Socket. lb # [ 161.169059] systemd[1255]: Reached target Sockets. lb # [ 161.169913] systemd[1255]: Reached target Basic System. lb # [ 161.170694] systemd[1255]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 161.174734] systemd[1255]: Reached target Main User Target. lb # [ 161.175637] systemd[1255]: Startup finished in 263ms. lb # [ 161.176697] systemd[1]: Started User Manager for UID 0. lb # [ 161.183322] systemd[1]: Started Session 15 of User root. lb # [ 161.214087] sshd-session[1269]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 161.216711] sshd-session[1269]: Disconnected from user root UNKNOWN port 65535 lb # [ 161.218076] sshd-session[1247]: pam_unix(sshd:session): session closed for user root lb # [ 161.222435] systemd[1]: sshd-vsock@11-12-4:22-2:11.service: Deactivated successfully. lb # [ 161.226941] systemd[1]: session-15.scope: Deactivated successfully. lb # [ 161.228886] systemd[1]: session-15.scope: Consumed 25ms CPU time over 47ms wall clock time, 2.9M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 161.234024] systemd-logind[499]: Session 15 logged out. Waiting for processes to exit. lb # [ 161.236369] systemd-logind[499]: Removed session 15. lb # [ 164.971254] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 164.979355] systemd[1]: Started SSH per-connection Daemon (vsock:2:12). lb # [ 165.075298] sshd-session[1275]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 165.084842] sshd-session[1275]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 165.093500] sshd-session[1275]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 165.104736] systemd-logind[499]: New session '17' of user 'root' with class 'user' and type 'tty'. lb # [ 165.109406] systemd[1]: Started Session 17 of User root. lb # [ 165.144595] sshd-session[1281]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 165.146072] sshd-session[1281]: Disconnected from user root UNKNOWN port 65535 lb # [ 165.148409] sshd-session[1275]: pam_unix(sshd:session): session closed for user root lb # [ 165.152252] systemd[1]: sshd-vsock@12-13-4:22-2:12.service: Deactivated successfully. lb # [ 165.157361] systemd[1]: session-17.scope: Deactivated successfully. lb # [ 165.160773] systemd[1]: session-17.scope: Consumed 27ms CPU time over 50ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 165.165335] systemd-logind[499]: Session 17 logged out. Waiting for processes to exit. lb # [ 165.166528] systemd-logind[499]: Removed session 17. worker1 # [ 163.918959] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 163.928309] systemd[1]: Started SSH per-connection Daemon (vsock:2:17). worker1 # [ 164.027234] sshd-session[1495]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 164.039253] sshd-session[1495]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 164.047608] sshd-session[1495]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 164.068614] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 164.078176] systemd-logind[539]: New session '21' of user 'root' with class 'user' and type 'tty'. worker1 # [ 164.105093] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 164.110276] systemd[1]: Starting User Manager for UID 0... worker1 # [ 164.138064] (systemd)[1503]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 164.144619] systemd-logind[539]: New session '22' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 164.233644] systemd[1503]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 164.335177] systemd[1503]: Queued start job for default target Main User Target. worker1 # [ 164.341162] systemd[1503]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 164.345458] systemd[1503]: Created slice User Application Slice. worker1 # [ 164.346466] systemd[1503]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 164.351540] systemd[1503]: Reached target Paths. worker1 # [ 164.353549] systemd[1503]: Reached target Timers. worker1 # [ 164.354299] systemd[1503]: Starting D-Bus User Message Bus Socket... worker1 # [ 164.355206] systemd[1503]: Starting Create User Files and Directories... worker1 # [ 164.399276] systemd[1503]: Finished Create User Files and Directories. worker1 # [ 164.403685] systemd[1503]: Listening on D-Bus User Message Bus Socket. worker1 # [ 164.408644] systemd[1503]: Reached target Sockets. worker1 # [ 164.409504] systemd[1503]: Reached target Basic System. worker1 # [ 164.410274] systemd[1503]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 164.411667] systemd[1503]: Reached target Main User Target. worker1 # [ 164.412932] systemd[1503]: Startup finished in 245ms. worker1 # [ 164.413698] systemd[1]: Started User Manager for UID 0. worker1 # [ 164.418603] systemd[1]: Started Session 21 of User root. worker1 # [ 164.449897] sshd-session[1516]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 164.452484] sshd-session[1516]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 164.454022] sshd-session[1495]: pam_unix(sshd:session): session closed for user root worker1 # [ 164.458042] systemd[1]: sshd-vsock@17-18-5:22-2:17.service: Deactivated successfully. ok worker1 # [ 164.463381] systemd[1]: session-21.scope: Deactivated successfully. test farm::serial::a_failed_upload_fails_the_build_instead_of_rebuilding_it ... worker1 # [ 164.466412] systemd[1]: session-21.scope: Consumed 25ms CPU time over 48ms wall clock time, 3.1M memory peak, 19.4K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 164.471399] systemd-logind[539]: Session 21 logged out. Waiting for processes to exit. worker1 # [ 164.472835] systemd-logind[539]: Removed session 21. lb # [ 166.326418] envoy[897]: conn peer=[2001:db8:1::4]:49658 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=6970 tx=988 ms=114181 client # [ 166.643154] systemd[1]: Stopping User Manager for UID 0... client # [ 166.651264] systemd[1179]: Activating special unit Exit the Session... client # [ 166.657989] systemd[1179]: Stopped target Main User Target. client # [ 166.659501] systemd[1179]: Stopped target Basic System. client # [ 166.663857] systemd[1179]: Stopped target Paths. client # [ 166.666016] systemd[1179]: Stopped target Sockets. client # [ 166.667161] systemd[1179]: Stopped target Timers. client # [ 166.668561] systemd[1179]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 166.670353] systemd[1179]: Closed D-Bus User Message Bus Socket. client # [ 166.671701] systemd[1179]: Stopped Create User Files and Directories. client # [ 166.673475] systemd[1179]: Removed slice User Application Slice. client # [ 166.674890] systemd[1179]: Reached target Shutdown. client # [ 166.676089] systemd[1179]: Finished Exit the Session. client # [ 166.677270] systemd[1179]: Reached target Exit the Session. client # [ 166.685954] systemd-logind[427]: Removed session 22. client # [ 166.693265] systemd[1]: user@0.service: Deactivated successfully. client # [ 166.696199] systemd[1]: Stopped User Manager for UID 0. client # [ 166.764333] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 166.806751] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 166.811391] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 166.815157] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 167.069269] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 167.077161] systemd[1]: Started SSH per-connection Daemon (vsock:2:18). worker1 # [ 167.179940] sshd-session[1521]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 167.188606] sshd-session[1521]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 167.199625] sshd-session[1521]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 167.211742] systemd-logind[539]: New session '23' of user 'root' with class 'user' and type 'tty'. worker1 # [ 167.217169] systemd[1]: Started Session 23 of User root. worker1 # [ 167.250065] sshd-session[1527]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 167.253426] sshd-session[1527]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 167.254545] sshd-session[1521]: pam_unix(sshd:session): session closed for user root worker1 # [ 167.260250] systemd[1]: sshd-vsock@18-19-5:22-2:18.service: Deactivated successfully. worker1 # [ 167.265851] systemd[1]: session-23.scope: Deactivated successfully. worker1 # [ 167.270505] systemd-logind[539]: Session 23 logged out. Waiting for processes to exit. worker1 # [ 167.273176] systemd-logind[539]: Removed session 23. worker2 # [ 166.083884] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 166.092468] systemd[1209]: Activating special unit Exit the Session... worker2 # [ 166.101230] systemd[1209]: Stopped target Main User Target. worker2 # [ 166.102679] systemd[1209]: Stopped target Basic System. worker2 # [ 166.103985] systemd[1209]: Stopped target Paths. worker2 # [ 166.108920] systemd[1209]: Stopped target Sockets. worker2 # [ 166.110117] systemd[1209]: Stopped target Timers. worker2 # [ 166.111281] systemd[1209]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 166.113255] systemd[1209]: Stopping D-Bus User Message Bus... worker2 # [ 166.114754] systemd[1209]: Stopped Create User Files and Directories. worker2 # [ 166.116947] dbus-broker[1367]: Dispatched 726 messages @ 1(±3)μs / message. worker2 # [ 166.124946] systemd[1209]: Stopped D-Bus User Message Bus. worker2 # [ 166.128370] systemd[1209]: Removed slice User Core Session Slice. worker2 # [ 166.129911] systemd[1209]: Closed D-Bus User Message Bus Socket. worker2 # [ 166.133040] systemd[1209]: Removed slice User Application Slice. worker2 # [ 166.134560] systemd[1209]: Reached target Shutdown. worker2 # [ 166.135760] systemd[1209]: Finished Exit the Session. worker2 # [ 166.137677] systemd[1209]: Reached target Exit the Session. worker2 # [ 166.174088] systemd-logind[515]: Removed session 10. worker2 # [ 166.181602] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 166.185660] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 166.206453] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 166.237254] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 166.242029] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 166.245045] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 167.851206] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 167.860475] systemd[1]: Started SSH per-connection Daemon (vsock:2:14). worker2 # [ 167.963004] sshd-session[1555]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 167.972947] sshd-session[1555]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 167.982088] sshd-session[1555]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 168.002002] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 168.010198] systemd-logind[515]: New session '18' of user 'root' with class 'user' and type 'tty'. worker2 # [ 168.040646] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 168.048275] systemd[1]: Starting User Manager for UID 0... worker2 # [ 168.074600] (systemd)[1563]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 168.081490] systemd-logind[515]: New session '19' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 168.176512] systemd[1563]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 168.275509] systemd[1563]: Queued start job for default target Main User Target. worker2 # [ 168.285024] systemd[1563]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 168.289308] systemd[1563]: Created slice User Application Slice. worker2 # [ 168.290352] systemd[1563]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 168.291456] systemd[1563]: Reached target Paths. worker2 # [ 168.295114] systemd[1563]: Reached target Timers. worker2 # [ 168.295908] systemd[1563]: Starting D-Bus User Message Bus Socket... worker2 # [ 168.300369] systemd[1563]: Starting Create User Files and Directories... worker2 # [ 168.342067] systemd[1563]: Finished Create User Files and Directories. worker2 # [ 168.344815] systemd[1563]: Listening on D-Bus User Message Bus Socket. worker2 # [ 168.345894] systemd[1563]: Reached target Sockets. worker2 # [ 168.346608] systemd[1563]: Reached target Basic System. worker2 # [ 168.347398] systemd[1563]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 168.351772] systemd[1563]: Reached target Main User Target. worker2 # [ 168.355112] systemd[1563]: Startup finished in 246ms. worker2 # [ 168.355955] systemd[1]: Started User Manager for UID 0. worker2 # [ 168.359218] systemd[1]: Started Session 18 of User root. worker2 # [ 168.386262] sshd-session[1576]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 168.389785] sshd-session[1576]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 168.390889] sshd-session[1555]: pam_unix(sshd:session): session closed for user root worker2 # [ 168.394544] systemd[1]: sshd-vsock@14-15-6:22-2:14.service: Deactivated successfully. worker2 # [ 168.400132] systemd[1]: session-18.scope: Deactivated successfully. worker2 # [ 168.404577] systemd-logind[515]: Session 18 logged out. Waiting for processes to exit. worker2 # [ 168.406526] systemd-logind[515]: Removed session 18. lb # [ 171.296768] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 171.304119] systemd[1]: Started SSH per-connection Daemon (vsock:2:13). lb # [ 171.406851] sshd-session[1286]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 171.417100] sshd-session[1286]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 171.428678] sshd-session[1286]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 171.442454] systemd-logind[499]: New session '18' of user 'root' with class 'user' and type 'tty'. lb # [ 171.451237] systemd[1]: Started Session 18 of User root. lb # [ 171.490111] sshd-session[1292]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 171.491651] sshd-session[1292]: Disconnected from user root UNKNOWN port 65535 lb # [ 171.493938] sshd-session[1286]: pam_unix(sshd:session): session closed for user root lb # [ 171.497889] systemd[1]: sshd-vsock@13-14-4:22-2:13.service: Deactivated successfully. lb # [ 171.503025] systemd[1]: session-18.scope: Deactivated successfully. lb # [ 171.505220] systemd[1]: session-18.scope: Consumed 31ms CPU time over 56ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 171.510635] systemd-logind[499]: Session 18 logged out. Waiting for processes to exit. lb # [ 171.513278] systemd-logind[499]: Removed session 18. worker1 # [ 170.697315] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 170.705810] systemd[1]: Started SSH per-connection Daemon (vsock:2:19). worker1 # [ 170.807384] sshd-session[1533]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 170.817598] sshd-session[1533]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 170.826710] sshd-session[1533]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 170.836584] systemd-logind[539]: New session '24' of user 'root' with class 'user' and type 'tty'. worker1 # [ 170.849622] systemd[1]: Started Session 24 of User root. worker1 # [ 170.886996] sshd-session[1539]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 170.888977] sshd-session[1539]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 170.890810] sshd-session[1533]: pam_unix(sshd:session): session closed for user root worker1 # [ 170.895013] systemd[1]: sshd-vsock@19-20-5:22-2:19.service: Deactivated successfully. worker1 # [ 170.900120] systemd[1]: session-24.scope: Deactivated successfully. worker1 # [ 170.901772] systemd[1]: session-24.scope: Consumed 29ms CPU time over 52ms wall clock time, 3.1M memory peak, 19.4K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 170.907145] systemd-logind[539]: Session 24 logged out. Waiting for processes to exit. worker1 # [ 170.909657] systemd-logind[539]: Removed session 24. worker1 # [ 171.018400] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 171.027003] systemd[1]: Started SSH per-connection Daemon (vsock:2:20). worker1 # [ 171.121192] sshd-session[1544]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 171.130881] sshd-session[1544]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 171.140299] sshd-session[1544]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 171.151546] systemd-logind[539]: New session '25' of user 'root' with class 'user' and type 'tty'. worker1 # [ 171.156554] systemd[1]: Started Session 25 of User root. worker1 # [ 171.193505] sshd-session[1550]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 171.196261] sshd-session[1550]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 171.197760] sshd-session[1544]: pam_unix(sshd:session): session closed for user root worker1 # [ 171.202424] systemd[1]: sshd-vsock@20-21-5:22-2:20.service: Deactivated successfully. worker1 # [ 171.207075] systemd[1]: session-25.scope: Deactivated successfully. worker1 # [ 171.210719] systemd[1]: session-25.scope: Consumed 29ms CPU time over 52ms wall clock time, 3.1M memory peak, 19.4K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 171.215494] systemd-logind[539]: Session 25 logged out. Waiting for processes to exit. worker1 # [ 171.216824] systemd-logind[539]: Removed session 25. worker2 # [ 170.976421] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 170.985873] systemd[1]: Started SSH per-connection Daemon (vsock:2:15). worker2 # [ 171.086678] sshd-session[1582]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 171.096306] sshd-session[1582]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 171.107530] sshd-session[1582]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 171.117513] systemd-logind[515]: New session '20' of user 'root' with class 'user' and type 'tty'. worker2 # [ 171.125205] systemd[1]: Started Session 20 of User root. worker2 # [ 171.166700] sshd-session[1588]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 171.169721] sshd-session[1588]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 171.171256] sshd-session[1582]: pam_unix(sshd:session): session closed for user root worker2 # [ 171.176156] systemd[1]: sshd-vsock@15-16-6:22-2:15.service: Deactivated successfully. worker2 # [ 171.182757] systemd[1]: session-20.scope: Deactivated successfully. worker2 # [ 171.185113] systemd[1]: session-20.scope: Consumed 31ms CPU time over 59ms wall clock time, 4.8M memory peak, 2K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 171.191973] systemd-logind[515]: Session 20 logged out. Waiting for processes to exit. worker2 # [ 171.194802] systemd-logind[515]: Removed session 20. worker1 # [ 175.115797] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 175.123815] systemd[1]: Started SSH per-connection Daemon (vsock:2:21). worker1 # [ 175.226381] sshd-session[1555]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 175.236269] sshd-session[1555]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 175.246566] sshd-session[1555]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 175.257176] systemd-logind[539]: New session '26' of user 'root' with class 'user' and type 'tty'. worker1 # [ 175.267167] systemd[1]: Started Session 26 of User root. worker1 # [ 175.302194] sshd-session[1561]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 175.305174] sshd-session[1561]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 175.306633] sshd-session[1555]: pam_unix(sshd:session): session closed for user root worker1 # [ 175.311043] systemd[1]: sshd-vsock@21-22-5:22-2:21.service: Deactivated successfully. worker1 # [ 175.317469] systemd[1]: session-26.scope: Deactivated successfully. worker1 # [ 175.319732] systemd[1]: session-26.scope: Consumed 28ms CPU time over 54ms wall clock time, 4.8M memory peak, 19.4K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 175.326817] systemd-logind[539]: Session 26 logged out. Waiting for processes to exit. worker1 # [ 175.329255] systemd-logind[539]: Removed session 26. worker2 # [ 174.421422] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 174.430853] systemd[1]: Started SSH per-connection Daemon (vsock:2:16). worker2 # [ 174.528200] sshd-session[1593]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 174.536673] sshd-session[1593]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 174.547818] sshd-session[1593]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 174.557497] systemd-logind[515]: New session '21' of user 'root' with class 'user' and type 'tty'. worker2 # [ 174.568644] systemd[1]: Started Session 21 of User root. worker2 # [ 174.606305] sshd-session[1599]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 174.609162] sshd-session[1599]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 174.610604] sshd-session[1593]: pam_unix(sshd:session): session closed for user root worker2 # [ 174.615412] systemd[1]: sshd-vsock@16-17-6:22-2:16.service: Deactivated successfully. worker2 # [ 174.620836] systemd[1]: session-21.scope: Deactivated successfully. worker2 # [ 174.624319] systemd[1]: session-21.scope: Consumed 29ms CPU time over 53ms wall clock time, 3.1M memory peak, 2K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 174.628872] systemd-logind[515]: Session 21 logged out. Waiting for processes to exit. worker2 # [ 174.630330] systemd-logind[515]: Removed session 21. client # [ 179.777773] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 179.786407] systemd[1]: Started SSH per-connection Daemon (vsock:2:23). client # [ 179.886060] sshd-session[1267]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 179.894985] sshd-session[1267]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 179.905947] sshd-session[1267]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 179.936596] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 179.973227] systemd-logind[427]: New session '27' of user 'root' with class 'user' and type 'tty'. client # [ 179.983679] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 179.991628] systemd[1]: Starting User Manager for UID 0... client # [ 180.019093] (systemd)[1276]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 180.026145] systemd-logind[427]: New session '28' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 180.117714] systemd[1276]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 180.220425] systemd[1276]: Queued start job for default target Main User Target. client # [ 180.229117] systemd[1276]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 180.233594] systemd[1276]: Created slice User Application Slice. client # [ 180.234713] systemd[1276]: Started Daily Cleanup of User's Temporary Directories. client # [ 180.235854] systemd[1276]: Reached target Paths. client # [ 180.239802] systemd[1276]: Reached target Timers. client # [ 180.241974] systemd[1276]: Starting D-Bus User Message Bus Socket... client # [ 180.242971] systemd[1276]: Starting Create User Files and Directories... lb # [ 181.555679] systemd[1]: Stopping User Manager for UID 0... lb # [ 181.563136] systemd[1255]: Activating special unit Exit the Session... lb # [ 181.569334] systemd[1255]: Stopped target Main User Target. lb # [ 181.570745] systemd[1255]: Stopped target Basic System. lb # [ 181.571947] systemd[1255]: Stopped target Paths. lb # [ 181.575880] systemd[1255]: Stopped target Sockets. lb # [ 181.578742] systemd[1255]: Stopped target Timers. lb # [ 181.579862] systemd[1255]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 181.582710] systemd[1255]: Closed D-Bus User Message Bus Socket. lb # [ 181.584353] systemd[1255]: Stopped Create User Files and Directories. lb # [ 181.586331] systemd[1255]: Removed slice User Application Slice. lb # [ 181.588762] systemd[1255]: Reached target Shutdown. lb # [ 181.590701] systemd[1255]: Finished Exit the Session. lb # [ 181.591913] systemd[1255]: Reached target Exit the Session. client # [ 180.291114] systemd[1276]: Finished Create User Files and Directories. client # [ 180.296397] systemd[1276]: Listening on D-Bus User Message Bus Socket. client # [ 180.297613] systemd[1276]: Reached target Sockets. client # [ 180.298356] systemd[1276]: Reached target Basic System. client # [ 180.299135] systemd[1276]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 180.301260] systemd[1276]: Reached target Main User Target. client # [ 180.302113] systemd[1276]: Startup finished in 251ms. lb # [ 181.606044] systemd-logind[499]: Removed session 16. client # [ 180.302887] systemd[1]: Started User Manager for UID 0. client # [ 180.305431] systemd[1]: Started Session 27 of User root. lb # [ 181.614867] systemd[1]: user@0.service: Deactivated successfully. lb # [ 181.618981] systemd[1]: Stopped User Manager for UID 0. client # [ 180.332221] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.pem&client-key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.key" --eval-store auto -f /nix/store/v7sckhacjvxxq8xv667z4hgvbaqhw2dd-slow.nix --argstr tag pubdown. client # [ 180.342477] sshd-session[1289]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 180.343905] sshd-session[1289]: Disconnected from user root UNKNOWN port 65535 client # [ 180.352437] sshd-session[1267]: pam_unix(sshd:session): session closed for user root client # [ 180.354972] systemd[1]: sshd-vsock@23-24-3:22-2:23.service: Deactivated successfully. client # [ 180.366062] systemd[1]: session-27.scope: Deactivated successfully. client # [ 180.373379] systemd-logind[427]: Session 27 logged out. Waiting for processes to exit. client # [ 180.379125] systemd-logind[427]: Removed session 27. lb # [ 181.682571] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 181.722751] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 181.729329] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 181.732877] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 178.988863] nix-grpc-daemon[1487]: ts=2026-11-12T09:21:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48140 worker2 # [ 178.999005] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) client # [ 180.561345] nix[1292]: don't know how to build these paths: client # [ 180.563369] nix[1292]: /nix/store/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv worker1 # [ 180.570476] nix-grpc-daemon[485]: ts=2026-11-12T09:21:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 181.876911] garage[898]: 2026-11-12T09:21:23.634902Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.narinfo lb # [ 181.882781] garage[898]: 2026-11-12T09:21:23.635369Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 179.034659] nix-grpc-daemon[1487]: ts=2026-11-12T09:21:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 worker2 # [ 179.045314] nix-grpc-daemon[1487]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5) worker2 # [ 179.087280] nix-grpc-daemon[1487]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 2/5) worker2 # [ 179.128800] nix-grpc-daemon[1487]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 198 ms (attempt 3/5) worker2 # [ 179.328757] nix-grpc-daemon[1487]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 581 ms (attempt 4/5) worker1 # [ 181.078338] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 181.085876] systemd[1]: Started SSH per-connection Daemon (vsock:2:22). worker1 # [ 181.178907] sshd-session[1567]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 181.186124] sshd-session[1567]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 181.195526] sshd-session[1567]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 181.207247] systemd-logind[539]: New session '27' of user 'root' with class 'user' and type 'tty'. worker1 # [ 181.213383] systemd[1]: Started Session 27 of User root. worker1 # [ 181.249469] sshd-session[1573]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 181.252245] sshd-session[1573]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 181.253709] sshd-session[1567]: pam_unix(sshd:session): session closed for user root worker1 # [ 181.258725] systemd[1]: sshd-vsock@22-23-5:22-2:22.service: Deactivated successfully. worker1 # [ 181.264431] systemd[1]: session-27.scope: Deactivated successfully. worker1 # [ 181.269662] systemd-logind[539]: Session 27 logged out. Waiting for processes to exit. worker1 # [ 181.271898] systemd-logind[539]: Removed session 27. worker2 # [ 179.915527] nix-grpc-daemon[1487]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 179.919635] nix-grpc-daemon[1487]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 182.779418] garage[898]: 2026-11-12T09:21:24.538718Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.narinfo lb # [ 182.779713] garage[898]: 2026-11-12T09:21:24.539166Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 182.789508] garage[898]: 2026-11-12T09:21:24.548664Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.narinfo lb # [ 182.794941] garage[898]: 2026-11-12T09:21:24.549105Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 181.501040] nix-grpc-daemon[485]: ts=2026-11-12T09:21:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 182.806471] garage[898]: 2026-11-12T09:21:24.565945Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/5mb1b0xn9mbvhranprkickbsxbzz1vw0.narinfo lb # [ 182.811520] garage[898]: 2026-11-12T09:21:24.566381Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 181.515672] nix[1292]: copying 1 paths to 'lb:50051'... worker1 # [ 181.519866] nix-grpc-daemon[485]: ts=2026-11-12T09:21:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36426 client # [ 181.515920] nix[1292]: copying path '/nix/store/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv' to 'lb:50051'... worker1 # [ 181.531315] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 181.548177] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 181.712121] nix-daemon[1059]: accepted connection from pid 1582, user nix-grpc-daemon (trusted) lb # [ 183.035794] niks3-server[956]: 2026/11/12 09:21:24 INFO Received push request method=POST path=/api/pushes worker1 # [ 181.738950] nix-daemon[1059]: reaped child process 1585, status = succeeded worker1 # [ 181.745478] nix-grpc-daemon[1104]: time=2026-11-12T09:21:25.538Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 181.747107] nix-grpc-daemon[1104]: time=2026-11-12T09:21:25.538Z level=INFO msg="Uploading 5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv (440B)" lb # [ 183.046540] garage[898]: 2026-11-12T09:21:24.804933Z INFO garage_api_common::generic_server: 192.168.1.3:33728 PUT /farm/nar/125abb7s64f86bgsrkpy0ds3phm61zryzyrnxvqrl6kadsfall4n.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092124Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e7c49d948ab4595194ab1e4d5ec3ed15da2b76e14d9e0d7fad89631ddc60d24 worker1 # [ 181.765878] nix-grpc-daemon[1104]: time=2026-11-12T09:21:25.559Z level=INFO msg="Uploading 1 narinfos" lb # [ 183.067765] garage[898]: 2026-11-12T09:21:24.805618Z INFO garage_api_common::generic_server: 192.168.1.3:60974 PUT /farm/5mb1b0xn9mbvhranprkickbsxbzz1vw0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092124Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=856e3c005f77044bc2df3e14c62a0184ea78ef3d615530c2c2cb825e5047fda8 lb # [ 183.082121] garage[898]: 2026-11-12T09:21:24.819444Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/nar/125abb7s64f86bgsrkpy0ds3phm61zryzyrnxvqrl6kadsfall4n.nar.zst lb # [ 183.088573] garage[898]: 2026-11-12T09:21:24.823118Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/5mb1b0xn9mbvhranprkickbsxbzz1vw0.ls lb # [ 183.094511] garage[898]: 2026-11-12T09:21:24.825728Z INFO garage_api_common::generic_server: 192.168.1.3:33728 PUT /farm/5mb1b0xn9mbvhranprkickbsxbzz1vw0.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092124Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f031988d76cce3ba7adf700b8ab68a4206a00443d505d00fa8b9109c9d371b4a worker1 # [ 181.805265] nix-grpc-daemon[1104]: time=2026-11-12T09:21:25.599Z level=INFO msg="Upload complete. (244ms)" lb # [ 183.105012] garage[898]: 2026-11-12T09:21:24.829069Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/5mb1b0xn9mbvhranprkickbsxbzz1vw0.narinfo lb # [ 183.110411] niks3-server[956]: 2026/11/12 09:21:24 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign lb # [ 183.113987] niks3-server[956]: 2026/11/12 09:21:24 INFO Signed narinfos id=24 count=1 worker1 # [ 181.812874] nix-grpc-daemon[485]: ts=2026-11-12T09:21:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=0 paths=1 nar_bytes_in=440 lb # [ 183.115719] niks3-server[956]: 2026/11/12 09:21:24 INFO Received complete push request method=POST path=/api/pushes/24/complete lb # [ 183.118718] niks3-server[956]: 2026/11/12 09:21:24 INFO Registered completed upload object_key=nar/125abb7s64f86bgsrkpy0ds3phm61zryzyrnxvqrl6kadsfall4n.nar.zst lb # [ 183.121727] niks3-server[956]: 2026/11/12 09:21:24 INFO Registered completed upload object_key=5mb1b0xn9mbvhranprkickbsxbzz1vw0.ls lb # [ 183.124105] niks3-server[956]: 2026/11/12 09:21:24 INFO Registered completed upload object_key=5mb1b0xn9mbvhranprkickbsxbzz1vw0.narinfo lb # [ 183.126557] niks3-server[956]: 2026/11/12 09:21:24 INFO Completed push id=24 objects=3 duration=36.06674ms worker1 # [ 181.830468] nix-daemon[1059]: reaped child process 1578, status = succeeded worker1 # [ 181.834002] nix-grpc-daemon[485]: ts=2026-11-12T09:21:25Z level=debug event=want client=10 drv=5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv cached=0 worker1 # [ 181.841279] nix-grpc-daemon[485]: ts=2026-11-12T09:21:25Z level=debug event=assigned drv=5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 181.849557] nix-grpc-daemon[485]: ts=2026-11-12T09:21:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 181.855399] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 181.864640] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) client # [ 181.860818] nix[1292]: building '/nix/store/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv' on lb:50051... lb # [ 183.570351] garage[898]: 2026-11-12T09:21:25.329503Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.narinfo lb # [ 183.575454] garage[898]: 2026-11-12T09:21:25.329950Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 181.107377] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 181.120608] systemd[1]: Started SSH per-connection Daemon (vsock:2:17). worker2 # [ 181.229370] sshd-session[1611]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 181.239616] sshd-session[1611]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 181.249635] sshd-session[1611]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 181.260498] systemd-logind[515]: New session '22' of user 'root' with class 'user' and type 'tty'. worker2 # [ 181.269083] systemd[1]: Started Session 22 of User root. worker2 # [ 181.307402] sshd-session[1617]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 181.310414] sshd-session[1617]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 181.311854] sshd-session[1611]: pam_unix(sshd:session): session closed for user root worker2 # [ 181.316907] systemd[1]: sshd-vsock@17-18-6:22-2:17.service: Deactivated successfully. worker2 # [ 181.322344] systemd[1]: session-22.scope: Deactivated successfully. worker2 # [ 181.327439] systemd-logind[515]: Session 22 logged out. Waiting for processes to exit. worker2 # [ 181.330373] systemd-logind[515]: Removed session 22. worker1 # [ 185.003653] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 185.008278] systemd[1]: Started SSH per-connection Daemon (vsock:2:23). worker1 # [ 185.143419] sshd-session[1608]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 185.162135] sshd-session[1608]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 185.172319] sshd-session[1608]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 185.192966] systemd-logind[539]: New session '28' of user 'root' with class 'user' and type 'tty'. worker1 # [ 185.194394] systemd[1]: Started Session 28 of User root. worker1 # [ 185.344415] sshd-session[1614]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 185.345875] sshd-session[1614]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 185.346883] sshd-session[1608]: pam_unix(sshd:session): session closed for user root worker1 # [ 185.387449] systemd[1]: sshd-vsock@23-24-5:22-2:23.service: Deactivated successfully. worker1 # [ 185.390711] systemd[1]: session-28.scope: Deactivated successfully. worker1 # [ 185.396720] systemd-logind[539]: Session 28 logged out. Waiting for processes to exit. worker1 # [ 185.397942] systemd-logind[539]: Removed session 28. worker2 # [ 184.365820] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 184.374873] systemd[1]: Started SSH per-connection Daemon (vsock:2:18). worker2 # [ 184.479948] sshd-session[1622]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 184.488677] sshd-session[1622]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 184.499441] sshd-session[1622]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 184.508489] systemd-logind[515]: New session '23' of user 'root' with class 'user' and type 'tty'. worker2 # [ 184.521458] systemd[1]: Started Session 23 of User root. worker2 # [ 184.555588] sshd-session[1628]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 184.558247] sshd-session[1628]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 184.560469] sshd-session[1622]: pam_unix(sshd:session): session closed for user root worker2 # [ 184.564588] systemd[1]: sshd-vsock@18-19-6:22-2:18.service: Deactivated successfully. worker2 # [ 184.569891] systemd[1]: session-23.scope: Deactivated successfully. worker2 # [ 184.574351] systemd-logind[515]: Session 23 logged out. Waiting for processes to exit. worker2 # [ 184.577172] systemd-logind[515]: Removed session 23. [e2e] heartbeat t=90s lb # [ 189.525646] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 189.533735] systemd[1]: Started SSH per-connection Daemon (vsock:2:14). lb # [ 189.633280] sshd-session[1305]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 189.641876] sshd-session[1305]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 189.652729] sshd-session[1305]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 189.671925] systemd-logind[499]: New session '19' of user 'root' with class 'user' and type 'tty'. lb # [ 189.682177] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 189.720269] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 189.725973] systemd[1]: Starting User Manager for UID 0... lb # [ 189.753976] (systemd)[1314]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 189.759666] systemd-logind[499]: New session '20' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 189.859029] systemd[1314]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 189.959098] systemd[1314]: Queued start job for default target Main User Target. lb # [ 189.970433] systemd[1314]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 189.974161] systemd[1314]: Created slice User Application Slice. lb # [ 189.975401] systemd[1314]: Started Daily Cleanup of User's Temporary Directories. lb # [ 189.976727] systemd[1314]: Reached target Paths. lb # [ 189.978942] systemd[1314]: Reached target Timers. lb # [ 189.981789] systemd[1314]: Starting D-Bus User Message Bus Socket... lb # [ 189.984095] systemd[1314]: Starting Create User Files and Directories... lb # [ 190.028990] systemd[1314]: Finished Create User Files and Directories. lb # [ 190.033440] systemd[1314]: Listening on D-Bus User Message Bus Socket. lb # [ 190.035619] systemd[1314]: Reached target Sockets. lb # [ 190.039157] systemd[1314]: Reached target Basic System. lb # [ 190.040405] systemd[1314]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 190.041775] systemd[1314]: Reached target Main User Target. lb # [ 190.042578] systemd[1314]: Startup finished in 259ms. lb # [ 190.043317] systemd[1]: Started User Manager for UID 0. lb # [ 190.046952] systemd[1]: Started Session 19 of User root. lb # [ 190.089948] sshd-session[1327]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 190.091405] sshd-session[1327]: Disconnected from user root UNKNOWN port 65535 lb # [ 190.098523] sshd-session[1305]: pam_unix(sshd:session): session closed for user root lb # [ 190.099733] systemd[1]: sshd-vsock@14-15-4:22-2:14.service: Deactivated successfully. lb # [ 190.105800] systemd[1]: session-19.scope: Deactivated successfully. lb # [ 190.110751] systemd-logind[499]: Session 19 logged out. Waiting for processes to exit. lb # [ 190.114450] systemd-logind[499]: Removed session 19. lb # [ 190.213473] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 190.219949] systemd[1]: Started SSH per-connection Daemon (vsock:2:15). lb # [ 190.297354] sshd-session[1335]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 190.305156] sshd-session[1335]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 190.312305] sshd-session[1335]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 190.320160] systemd-logind[499]: New session '21' of user 'root' with class 'user' and type 'tty'. lb # [ 190.330668] systemd[1]: Started Session 21 of User root. lb # [ 190.369811] sshd-session[1341]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 190.371233] sshd-session[1341]: Disconnected from user root UNKNOWN port 65535 lb # [ 190.373256] sshd-session[1335]: pam_unix(sshd:session): session closed for user root lb # [ 190.377065] systemd[1]: sshd-vsock@15-16-4:22-2:15.service: Deactivated successfully. lb # [ 190.382480] systemd[1]: session-21.scope: Deactivated successfully. lb # [ 190.386952] systemd-logind[499]: Session 21 logged out. Waiting for processes to exit. lb # [ 190.389610] systemd-logind[499]: Removed session 21. worker1 # [ 189.246271] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 189.247715] systemd[1]: Started SSH per-connection Daemon (vsock:2:24). worker1 # [ 189.378794] sshd-session[1619]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 189.389904] sshd-session[1619]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 189.404276] sshd-session[1619]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 189.417814] systemd-logind[539]: New session '29' of user 'root' with class 'user' and type 'tty'. worker1 # [ 189.427706] systemd[1]: Started Session 29 of User root. worker1 # [ 189.620636] sshd-session[1625]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 189.622047] sshd-session[1625]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 189.623033] sshd-session[1619]: pam_unix(sshd:session): session closed for user root worker1 # [ 189.631557] systemd[1]: sshd-vsock@24-25-5:22-2:24.service: Deactivated successfully. worker1 # [ 189.637901] systemd[1]: session-29.scope: Deactivated successfully. worker1 # [ 189.642251] systemd-logind[539]: Session 29 logged out. Waiting for processes to exit. worker1 # [ 189.644628] systemd-logind[539]: Removed session 29. worker1 # [ 189.709908] nix-daemon[1059]: reaped child process 1592, status = succeeded worker1 # [ 189.823528] nix-daemon[1059]: accepted connection from pid 1631, user nix-grpc-daemon (trusted) lb # [ 191.146087] niks3-server[956]: 2026/11/12 09:21:32 INFO Received push request method=POST path=/api/pushes worker1 # [ 189.848901] nix-daemon[1059]: reaped child process 1634, status = succeeded worker1 # [ 189.856709] nix-grpc-daemon[1104]: time=2026-11-12T09:21:33.648Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 189.858302] nix-grpc-daemon[1104]: time=2026-11-12T09:21:33.648Z level=INFO msg="Uploading 9qdcj6ih36k1z96krj5srdjjrg1dzjbd-slow-pubdown (120B)" worker1 # [ 189.861884] nix-grpc-daemon[1104]: time=2026-11-12T09:21:33.655Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/17cdsgc1vy44n6aj89q9d6xjc272i7aqsy6bimj4wkmqqsxjgbqq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cb694e2b48caafd6809662fd740f661adae4ce0f10ffa0f4ac30b25dd2dd1aeb\": read tcp 192.168.1.3:60974->192.168.1.2:9000: read: connection reset by peer" url="http://lb:9000/farm/nar/17cdsgc1vy44n6aj89q9d6xjc272i7aqsy6bimj4wkmqqsxjgbqq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cb694e2b48caafd6809662fd740f661adae4ce0f10ffa0f4ac30b25dd2dd1aeb" worker1 # [ 189.873331] nix-grpc-daemon[1104]: time=2026-11-12T09:21:33.655Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ea191637bc661934845e424675287d4bf3c50e427045ac1b6eee39b6fb991ce\": read tcp 192.168.1.3:33728->192.168.1.2:9000: read: connection reset by peer" url="http://lb:9000/farm/log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ea191637bc661934845e424675287d4bf3c50e427045ac1b6eee39b6fb991ce" worker1 # [ 189.884228] nix-grpc-daemon[1104]: time=2026-11-12T09:21:33.655Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5099e8a8d76fb0b9bf225f9e644a3511b286d7da97ce792eb5800adae1fc8164\": read tcp 192.168.1.3:32772->192.168.1.2:9000: read: connection reset by peer" url="http://lb:9000/farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5099e8a8d76fb0b9bf225f9e644a3511b286d7da97ce792eb5800adae1fc8164" worker1 # [ 189.963489] nix-grpc-daemon[1104]: time=2026-11-12T09:21:33.757Z level=WARN msg="Request failed, retrying" attempt=2 backoff=200.749389ms error="Put \"http://lb:9000/farm/log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ea191637bc661934845e424675287d4bf3c50e427045ac1b6eee39b6fb991ce\": read tcp 192.168.1.3:33726->192.168.1.2:9000: read: connection reset by peer" url="http://lb:9000/farm/log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ea191637bc661934845e424675287d4bf3c50e427045ac1b6eee39b6fb991ce" worker1 # [ 189.978317] nix-grpc-daemon[1104]: time=2026-11-12T09:21:33.757Z level=WARN msg="Request failed, retrying" attempt=2 backoff=180.552444ms error="Put \"http://lb:9000/farm/nar/17cdsgc1vy44n6aj89q9d6xjc272i7aqsy6bimj4wkmqqsxjgbqq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cb694e2b48caafd6809662fd740f661adae4ce0f10ffa0f4ac30b25dd2dd1aeb\": read tcp 192.168.1.3:33718->192.168.1.2:9000: read: connection reset by peer" url="http://lb:9000/farm/nar/17cdsgc1vy44n6aj89q9d6xjc272i7aqsy6bimj4wkmqqsxjgbqq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cb694e2b48caafd6809662fd740f661adae4ce0f10ffa0f4ac30b25dd2dd1aeb" worker1 # [ 189.993307] nix-grpc-daemon[1104]: time=2026-11-12T09:21:33.757Z level=WARN msg="Request failed, retrying" attempt=2 backoff=183.749532ms error="Put \"http://lb:9000/farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5099e8a8d76fb0b9bf225f9e644a3511b286d7da97ce792eb5800adae1fc8164\": read tcp 192.168.1.3:60990->192.168.1.2:9000: read: connection reset by peer" url="http://lb:9000/farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5099e8a8d76fb0b9bf225f9e644a3511b286d7da97ce792eb5800adae1fc8164" worker1 # [ 190.148216] nix-grpc-daemon[1104]: time=2026-11-12T09:21:33.941Z level=WARN msg="Request failed, retrying" attempt=3 backoff=408.966179ms error="Put \"http://lb:9000/farm/nar/17cdsgc1vy44n6aj89q9d6xjc272i7aqsy6bimj4wkmqqsxjgbqq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cb694e2b48caafd6809662fd740f661adae4ce0f10ffa0f4ac30b25dd2dd1aeb\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/17cdsgc1vy44n6aj89q9d6xjc272i7aqsy6bimj4wkmqqsxjgbqq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cb694e2b48caafd6809662fd740f661adae4ce0f10ffa0f4ac30b25dd2dd1aeb" worker1 # [ 190.168438] nix-grpc-daemon[1104]: time=2026-11-12T09:21:33.962Z level=WARN msg="Request failed, retrying" attempt=3 backoff=386.740283ms error="Put \"http://lb:9000/farm/log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ea191637bc661934845e424675287d4bf3c50e427045ac1b6eee39b6fb991ce\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ea191637bc661934845e424675287d4bf3c50e427045ac1b6eee39b6fb991ce" worker1 # [ 190.185685] nix-grpc-daemon[1104]: time=2026-11-12T09:21:33.962Z level=WARN msg="Request failed, retrying" attempt=3 backoff=373.285537ms error="Put \"http://lb:9000/farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5099e8a8d76fb0b9bf225f9e644a3511b286d7da97ce792eb5800adae1fc8164\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5099e8a8d76fb0b9bf225f9e644a3511b286d7da97ce792eb5800adae1fc8164" client # [ 190.394431] systemd[1]: Stopping User Manager for UID 0... client # [ 190.400638] systemd[1276]: Activating special unit Exit the Session... client # [ 190.407717] systemd[1276]: Stopped target Main User Target. client # [ 190.411961] systemd[1276]: Stopped target Basic System. client # [ 190.414364] systemd[1276]: Stopped target Paths. client # [ 190.415495] systemd[1276]: Stopped target Sockets. client # [ 190.417140] systemd[1276]: Stopped target Timers. client # [ 190.418286] systemd[1276]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 190.419932] systemd[1276]: Closed D-Bus User Message Bus Socket. client # [ 190.421543] systemd[1276]: Stopped Create User Files and Directories. client # [ 190.422977] systemd[1276]: Removed slice User Application Slice. client # [ 190.424800] systemd[1276]: Reached target Shutdown. client # [ 190.425961] systemd[1276]: Finished Exit the Session. client # [ 190.427110] systemd[1276]: Reached target Exit the Session. client # [ 190.437878] systemd-logind[427]: Removed session 28. client # [ 190.445572] systemd[1]: user@0.service: Deactivated successfully. client # [ 190.450475] systemd[1]: Stopped User Manager for UID 0. client # [ 190.511230] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 190.549485] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 190.554526] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 190.544671] nix-grpc-daemon[1104]: time=2026-11-12T09:21:34.338Z level=WARN msg="Request failed, retrying" attempt=4 backoff=728.472753ms error="Put \"http://lb:9000/farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5099e8a8d76fb0b9bf225f9e644a3511b286d7da97ce792eb5800adae1fc8164\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5099e8a8d76fb0b9bf225f9e644a3511b286d7da97ce792eb5800adae1fc8164" client # [ 190.558565] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 190.563806] nix-grpc-daemon[1104]: time=2026-11-12T09:21:34.357Z level=WARN msg="Request failed, retrying" attempt=4 backoff=838.786039ms error="Put \"http://lb:9000/farm/nar/17cdsgc1vy44n6aj89q9d6xjc272i7aqsy6bimj4wkmqqsxjgbqq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cb694e2b48caafd6809662fd740f661adae4ce0f10ffa0f4ac30b25dd2dd1aeb\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/17cdsgc1vy44n6aj89q9d6xjc272i7aqsy6bimj4wkmqqsxjgbqq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cb694e2b48caafd6809662fd740f661adae4ce0f10ffa0f4ac30b25dd2dd1aeb" worker1 # [ 190.581189] nix-grpc-daemon[1104]: time=2026-11-12T09:21:34.357Z level=WARN msg="Request failed, retrying" attempt=4 backoff=787.478214ms error="Put \"http://lb:9000/farm/log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ea191637bc661934845e424675287d4bf3c50e427045ac1b6eee39b6fb991ce\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ea191637bc661934845e424675287d4bf3c50e427045ac1b6eee39b6fb991ce" worker1 # [ 191.277432] nix-grpc-daemon[1104]: time=2026-11-12T09:21:35.070Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.478776208s error="Put \"http://lb:9000/farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5099e8a8d76fb0b9bf225f9e644a3511b286d7da97ce792eb5800adae1fc8164\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5099e8a8d76fb0b9bf225f9e644a3511b286d7da97ce792eb5800adae1fc8164" worker1 # [ 191.354625] nix-grpc-daemon[1104]: time=2026-11-12T09:21:35.148Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.481397101s error="Put \"http://lb:9000/farm/log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ea191637bc661934845e424675287d4bf3c50e427045ac1b6eee39b6fb991ce\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ea191637bc661934845e424675287d4bf3c50e427045ac1b6eee39b6fb991ce" worker1 # [ 191.405621] nix-grpc-daemon[1104]: time=2026-11-12T09:21:35.199Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.632857369s error="Put \"http://lb:9000/farm/nar/17cdsgc1vy44n6aj89q9d6xjc272i7aqsy6bimj4wkmqqsxjgbqq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cb694e2b48caafd6809662fd740f661adae4ce0f10ffa0f4ac30b25dd2dd1aeb\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/17cdsgc1vy44n6aj89q9d6xjc272i7aqsy6bimj4wkmqqsxjgbqq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cb694e2b48caafd6809662fd740f661adae4ce0f10ffa0f4ac30b25dd2dd1aeb" worker2 # [ 190.685350] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 190.693188] systemd[1]: Started SSH per-connection Daemon (vsock:2:19). worker2 # [ 190.792510] sshd-session[1633]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 190.802229] sshd-session[1633]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 190.811349] sshd-session[1633]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 190.820831] systemd-logind[515]: New session '24' of user 'root' with class 'user' and type 'tty'. worker2 # [ 190.833550] systemd[1]: Started Session 24 of User root. worker2 # [ 190.870383] sshd-session[1639]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 190.872392] sshd-session[1639]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 190.874354] sshd-session[1633]: pam_unix(sshd:session): session closed for user root worker2 # [ 190.878841] systemd[1]: sshd-vsock@19-20-6:22-2:19.service: Deactivated successfully. worker2 # [ 190.885510] systemd[1]: session-24.scope: Deactivated successfully. worker2 # [ 190.890286] systemd-logind[515]: Session 24 logged out. Waiting for processes to exit. worker2 # [ 190.892983] systemd-logind[515]: Removed session 24. worker1 # [ 192.759533] nix-grpc-daemon[1104]: time=2026-11-12T09:21:36.552Z level=WARN msg="Request failed, retrying" attempt=6 backoff=3.498219545s error="Put \"http://lb:9000/farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5099e8a8d76fb0b9bf225f9e644a3511b286d7da97ce792eb5800adae1fc8164\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/9qdcj6ih36k1z96krj5srdjjrg1dzjbd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5099e8a8d76fb0b9bf225f9e644a3511b286d7da97ce792eb5800adae1fc8164" worker1 # [ 192.839741] nix-grpc-daemon[1104]: time=2026-11-12T09:21:36.633Z level=WARN msg="Request failed, retrying" attempt=6 backoff=3.028841792s error="Put \"http://lb:9000/farm/log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ea191637bc661934845e424675287d4bf3c50e427045ac1b6eee39b6fb991ce\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ea191637bc661934845e424675287d4bf3c50e427045ac1b6eee39b6fb991ce" worker1 # [ 195.873152] nix-grpc-daemon[1104]: time=2026-11-12T09:21:39.666Z level=ERROR msg="Upload failed" error="uploading objects: uploading build log log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv: uploading: request failed after retries: Put \"http://lb:9000/farm/log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ea191637bc661934845e424675287d4bf3c50e427045ac1b6eee39b6fb991ce\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 195.893735] nix-grpc-daemon[485]: ts=2026-11-12T09:21:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=14 drv=5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv assign_id=14 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 195.908238] nix-daemon[1059]: reaped child process 1590, status = succeeded client # [ 195.894951] nix[1292]: error: error: publish failed: error: niks3 push: uploading objects: uploading build log log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv: uploading: request failed after retries: Put "http://lb:9000/farm/log/5mb1b0xn9mbvhranprkickbsxbzz1vw0-slow-pubdown.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092132Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ea191637bc661934845e424675287d4bf3c50e427045ac1b6eee39b6fb991ce": dial tcp [2001:db8:1::2]:9000: connect: connection refused client # [ 195.931642] systemd[1]: pubdown.service: Main process exited, code=exited, status=1/FAILURE client # [ 195.935178] systemd[1]: pubdown.service: Failed with result 'exit-code'. client # [ 195.940258] systemd[1]: pubdown.service: Consumed 187ms CPU time over 15.605s wall clock time, 40.8M memory peak, 9.1K incoming IP traffic, 8.7K outgoing IP traffic. client # [ 196.885991] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 196.893909] systemd[1]: Started SSH per-connection Daemon (vsock:2:24). client # [ 196.992644] sshd-session[1313]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 197.000916] sshd-session[1313]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 197.012510] sshd-session[1313]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 197.044878] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 197.079531] systemd-logind[427]: New session '29' of user 'root' with class 'user' and type 'tty'. client # [ 197.091509] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 197.098771] systemd[1]: Starting User Manager for UID 0... client # [ 197.126080] (systemd)[1322]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 197.132642] systemd-logind[427]: New session '30' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 197.219422] systemd[1322]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 197.318654] systemd[1322]: Queued start job for default target Main User Target. client # [ 197.325164] systemd[1322]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 197.329470] systemd[1322]: Created slice User Application Slice. client # [ 197.330511] systemd[1322]: Started Daily Cleanup of User's Temporary Directories. client # [ 197.331548] systemd[1322]: Reached target Paths. client # [ 197.334830] systemd[1322]: Reached target Timers. client # [ 197.335643] systemd[1322]: Starting D-Bus User Message Bus Socket... client # [ 197.340245] systemd[1322]: Starting Create User Files and Directories... client # [ 197.385111] systemd[1322]: Finished Create User Files and Directories. client # [ 197.391552] systemd[1322]: Listening on D-Bus User Message Bus Socket. client # [ 197.392961] systemd[1322]: Reached target Sockets. client # [ 197.393678] systemd[1322]: Reached target Basic System. client # [ 197.394488] systemd[1322]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 197.395894] systemd[1322]: Reached target Main User Target. client # [ 197.399174] systemd[1322]: Startup finished in 239ms. client # [ 197.399997] systemd[1]: Started User Manager for UID 0. client # [ 197.402437] systemd[1]: Started Session 29 of User root. client # [ 197.429599] sshd-session[1335]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 197.432282] sshd-session[1335]: Disconnected from user root UNKNOWN port 65535 client # [ 197.434199] sshd-session[1313]: pam_unix(sshd:session): session closed for user root client # [ 197.437882] systemd[1]: sshd-vsock@24-25-3:22-2:24.service: Deactivated successfully. client # [ 197.442791] systemd[1]: session-29.scope: Deactivated successfully. client # [ 197.447460] systemd-logind[427]: Session 29 logged out. Waiting for processes to exit. client # [ 197.450166] systemd-logind[427]: Removed session 29. lb # [ 199.481413] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 199.489883] systemd[1]: Started SSH per-connection Daemon (vsock:2:16). lb # [ 199.585522] sshd-session[1347]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 199.594188] sshd-session[1347]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 199.602490] sshd-session[1347]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 199.611473] systemd-logind[499]: New session '22' of user 'root' with class 'user' and type 'tty'. lb # [ 199.616550] systemd[1]: Started Session 22 of User root. lb # [ 199.646699] sshd-session[1353]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 199.650859] sshd-session[1353]: Disconnected from user root UNKNOWN port 65535 lb # [ 199.652796] sshd-session[1347]: pam_unix(sshd:session): session closed for user root lb # [ 199.657144] systemd[1]: sshd-vsock@16-17-4:22-2:16.service: Deactivated successfully. lb # [ 199.662448] systemd[1]: session-22.scope: Deactivated successfully. lb # [ 199.666990] systemd-logind[499]: Session 22 logged out. Waiting for processes to exit. lb # [ 199.669794] systemd-logind[499]: Removed session 22. lb # [ 200.535553] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 200.542875] systemd[1]: Started SSH per-connection Daemon (vsock:2:17). lb # [ 200.636611] sshd-session[1358]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 200.645235] sshd-session[1358]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 200.653334] sshd-session[1358]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 200.662075] systemd-logind[499]: New session '23' of user 'root' with class 'user' and type 'tty'. lb # [ 200.671558] systemd[1]: Started Session 23 of User root. lb # [ 200.698619] sshd-session[1364]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 200.701497] sshd-session[1364]: Disconnected from user root UNKNOWN port 65535 lb # [ 200.703359] sshd-session[1358]: pam_unix(sshd:session): session closed for user root lb # [ 200.707132] systemd[1]: sshd-vsock@17-18-4:22-2:17.service: Deactivated successfully. lb # [ 200.713633] systemd[1]: session-23.scope: Deactivated successfully. lb # [ 200.718233] systemd-logind[499]: Session 23 logged out. Waiting for processes to exit. lb # [ 200.720857] systemd-logind[499]: Removed session 23. worker1 # [ 199.788616] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 199.796965] systemd[1503]: Activating special unit Exit the Session... worker1 # [ 199.803359] systemd[1503]: Stopped target Main User Target. worker1 # [ 199.807923] systemd[1503]: Stopped target Basic System. worker1 # [ 199.809588] systemd[1503]: Stopped target Paths. worker1 # [ 199.810704] systemd[1503]: Stopped target Sockets. worker1 # [ 199.811812] systemd[1503]: Stopped target Timers. worker1 # [ 199.814215] systemd[1503]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 199.815884] systemd[1503]: Closed D-Bus User Message Bus Socket. worker1 # [ 199.817636] systemd[1503]: Stopped Create User Files and Directories. worker1 # [ 199.819084] systemd[1503]: Removed slice User Application Slice. worker1 # [ 199.820504] systemd[1503]: Reached target Shutdown. worker1 # [ 199.821666] systemd[1503]: Finished Exit the Session. worker1 # [ 199.822808] systemd[1503]: Reached target Exit the Session. worker1 # [ 199.837889] systemd-logind[539]: Removed session 22. worker1 # [ 199.846039] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 199.849427] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 199.870778] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 199.914481] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 199.918858] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 199.924774] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 201.676215] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 201.679685] systemd[1]: Started SSH per-connection Daemon (vsock:2:18). lb # [ 201.779797] sshd-session[1369]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 201.790130] sshd-session[1369]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 201.798963] sshd-session[1369]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 201.808635] systemd-logind[499]: New session '24' of user 'root' with class 'user' and type 'tty'. lb # [ 201.821461] systemd[1]: Started Session 24 of User root. lb # [ 201.860920] sshd-session[1375]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 201.862545] sshd-session[1375]: Disconnected from user root UNKNOWN port 65535 lb # [ 201.864283] sshd-session[1369]: pam_unix(sshd:session): session closed for user root lb # [ 201.869122] systemd[1]: sshd-vsock@18-19-4:22-2:18.service: Deactivated successfully. lb # [ 201.874422] systemd[1]: session-24.scope: Deactivated successfully. lb # [ 201.876415] systemd[1]: session-24.scope: Consumed 29ms CPU time over 55ms wall clock time, 5.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 201.881738] systemd-logind[499]: Session 24 logged out. Waiting for processes to exit. lb # [ 201.884500] systemd-logind[499]: Removed session 24. worker1 # [ 200.703139] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 200.711610] systemd[1]: Started SSH per-connection Daemon (vsock:2:25). worker1 # [ 200.809734] sshd-session[1640]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 200.820285] sshd-session[1640]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 200.829926] sshd-session[1640]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 200.846229] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 200.861092] systemd-logind[539]: New session '30' of user 'root' with class 'user' and type 'tty'. worker1 # [ 200.883312] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 200.891579] systemd[1]: Starting User Manager for UID 0... worker1 # [ 200.917947] (systemd)[1648]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 200.924640] systemd-logind[539]: New session '31' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 201.014014] systemd[1648]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 201.112457] systemd[1648]: Queued start job for default target Main User Target. worker1 # [ 201.117143] systemd[1648]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 201.121451] systemd[1648]: Created slice User Application Slice. worker1 # [ 201.122436] systemd[1648]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 201.123462] systemd[1648]: Reached target Paths. worker1 # [ 201.126971] systemd[1648]: Reached target Timers. worker1 # [ 201.127743] systemd[1648]: Starting D-Bus User Message Bus Socket... worker1 # [ 201.132556] systemd[1648]: Starting Create User Files and Directories... worker1 # [ 201.170495] systemd[1648]: Finished Create User Files and Directories. worker1 # [ 201.175205] systemd[1648]: Listening on D-Bus User Message Bus Socket. worker1 # [ 201.179997] systemd[1648]: Reached target Sockets. worker1 # [ 201.181068] systemd[1648]: Reached target Basic System. worker1 # [ 201.181828] systemd[1648]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 201.183209] systemd[1648]: Reached target Main User Target. worker1 # [ 201.183968] systemd[1648]: Startup finished in 237ms. worker1 # [ 201.187253] systemd[1]: Started User Manager for UID 0. worker1 # [ 201.189686] systemd[1]: Started Session 30 of User root. worker1 # [ 201.224905] sshd-session[1661]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 201.226326] sshd-session[1661]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 201.228665] sshd-session[1640]: pam_unix(sshd:session): session closed for user root worker1 # [ 201.234282] systemd[1]: sshd-vsock@25-26-5:22-2:25.service: Deactivated successfully. worker1 # [ 201.238641] systemd[1]: session-30.scope: Deactivated successfully. worker1 # [ 201.241013] systemd[1]: session-30.scope: Consumed 26ms CPU time over 54ms wall clock time, 3.1M memory peak, 19.5K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 201.246473] systemd-logind[539]: Session 30 logged out. Waiting for processes to exit. worker1 # [ 201.248813] systemd-logind[539]: Removed session 30. client # [ 201.375905] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 201.379500] systemd[1]: Started SSH per-connection Daemon (vsock:2:25). client # [ 201.474917] sshd-session[1341]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 201.485099] sshd-session[1341]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 201.493900] sshd-session[1341]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 201.505010] systemd-logind[427]: New session '31' of user 'root' with class 'user' and type 'tty'. client # [ 201.515031] systemd[1]: Started Session 31 of User root. client # [ 201.544135] sshd-session[1347]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 201.547371] sshd-session[1347]: Disconnected from user root UNKNOWN port 65535 client # [ 201.549559] sshd-session[1341]: pam_unix(sshd:session): session closed for user root client # [ 201.554074] systemd[1]: sshd-vsock@25-26-3:22-2:25.service: Deactivated successfully. client # [ 201.560133] systemd[1]: session-31.scope: Deactivated successfully. client # [ 201.565181] systemd-logind[427]: Session 31 logged out. Waiting for processes to exit. client # [ 201.567543] systemd-logind[427]: Removed session 31. client # [ 201.992776] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 202.000976] systemd[1]: Started SSH per-connection Daemon (vsock:2:26). client # [ 202.098634] sshd-session[1352]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 202.109114] sshd-session[1352]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 202.118146] sshd-session[1352]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 202.127182] systemd-logind[427]: New session '32' of user 'root' with class 'user' and type 'tty'. client # [ 202.136743] systemd[1]: Started Session 32 of User root. client # [ 202.167040] sshd-session[1358]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 202.170228] sshd-session[1358]: Disconnected from user root UNKNOWN port 65535 client # [ 202.171742] sshd-session[1352]: pam_unix(sshd:session): session closed for user root client # [ 202.176695] systemd[1]: sshd-vsock@26-27-3:22-2:26.service: Deactivated successfully. client # [ 202.182461] systemd[1]: session-32.scope: Deactivated successfully. client # [ 202.186986] systemd-logind[427]: Session 32 logged out. Waiting for processes to exit. client # [ 202.190291] systemd-logind[427]: Removed session 32. worker1 # [ 202.531082] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 202.538439] systemd[1]: Started SSH per-connection Daemon (vsock:2:26). worker1 # [ 202.636810] sshd-session[1666]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 201.084081] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 201.091403] systemd[1563]: Activating special unit Exit the Session... worker1 # [ 202.645985] sshd-session[1666]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 201.097468] systemd[1563]: Stopped target Main User Target. worker2 # [ 201.099108] systemd[1563]: Stopped target Basic System. worker1 # [ 202.656610] sshd-session[1666]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 201.103336] systemd[1563]: Stopped target Paths. worker2 # [ 201.105377] systemd[1563]: Stopped target Sockets. worker2 # [ 201.106741] systemd[1563]: Stopped target Timers. worker2 # [ 201.107938] systemd[1563]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 201.109840] systemd[1563]: Closed D-Bus User Message Bus Socket. worker2 # [ 201.111296] systemd[1563]: Stopped Create User Files and Directories. worker2 # [ 201.113065] systemd[1563]: Removed slice User Application Slice. worker2 # [ 201.114516] systemd[1563]: Reached target Shutdown. worker1 # [ 202.668640] systemd-logind[539]: New session '32' of user 'root' with class 'user' and type 'tty'. worker2 # [ 201.115741] systemd[1563]: Finished Exit the Session. worker2 # [ 201.117963] systemd[1563]: Reached target Exit the Session. worker1 # [ 202.673292] systemd[1]: Started Session 32 of User root. worker2 # [ 201.147011] systemd-logind[515]: Removed session 19. worker2 # [ 201.154072] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 202.709744] sshd-session[1672]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 202.711325] sshd-session[1672]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 202.713496] sshd-session[1666]: pam_unix(sshd:session): session closed for user root worker2 # [ 201.159827] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 202.717865] systemd[1]: sshd-vsock@26-27-5:22-2:26.service: Deactivated successfully. worker1 # [ 202.722447] systemd[1]: session-32.scope: Deactivated successfully. worker1 # [ 202.724614] systemd[1]: session-32.scope: Consumed 28ms CPU time over 51ms wall clock time, 3.1M memory peak, 19.5K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 201.174902] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 202.729856] systemd-logind[539]: Session 32 logged out. Waiting for processes to exit. worker1 # [ 202.732119] systemd-logind[539]: Removed session 32. worker2 # [ 201.217316] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 201.222908] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 201.228606] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 201.267955] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 201.276649] systemd[1]: Started SSH per-connection Daemon (vsock:2:20). worker2 # [ 201.375338] sshd-session[1648]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 201.385147] sshd-session[1648]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 201.394552] sshd-session[1648]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 201.410744] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 201.423181] systemd-logind[515]: New session '25' of user 'root' with class 'user' and type 'tty'. worker2 # [ 201.446941] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 201.455219] systemd[1]: Starting User Manager for UID 0... worker2 # [ 201.481946] (systemd)[1656]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 201.488267] systemd-logind[515]: New session '26' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 201.579946] systemd[1656]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 201.679929] systemd[1656]: Queued start job for default target Main User Target. worker2 # [ 201.685042] systemd[1656]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 201.689405] systemd[1656]: Created slice User Application Slice. worker2 # [ 201.690446] systemd[1656]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 201.691556] systemd[1656]: Reached target Paths. worker2 # [ 201.695112] systemd[1656]: Reached target Timers. worker2 # [ 201.695912] systemd[1656]: Starting D-Bus User Message Bus Socket... worker2 # [ 201.700276] systemd[1656]: Starting Create User Files and Directories... worker2 # [ 201.737922] systemd[1656]: Finished Create User Files and Directories. worker2 # [ 201.740787] systemd[1656]: Listening on D-Bus User Message Bus Socket. worker2 # [ 201.741857] systemd[1656]: Reached target Sockets. worker2 # [ 201.742747] systemd[1656]: Reached target Basic System. worker2 # [ 201.743545] systemd[1656]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 201.751883] systemd[1656]: Reached target Main User Target. worker2 # [ 201.754966] systemd[1656]: Startup finished in 236ms. worker2 # [ 201.755828] systemd[1]: Started User Manager for UID 0. worker2 # [ 201.757704] systemd[1]: Started Session 25 of User root. worker2 # [ 201.785280] sshd-session[1669]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 201.786902] sshd-session[1669]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 201.788930] sshd-session[1648]: pam_unix(sshd:session): session closed for user root worker2 # [ 201.795775] systemd[1]: sshd-vsock@20-21-6:22-2:20.service: Deactivated successfully. worker2 # [ 201.800873] systemd[1]: session-25.scope: Deactivated successfully. worker2 # [ 201.805192] systemd[1]: session-25.scope: Consumed 26ms CPU time over 52ms wall clock time, 3.1M memory peak, 4.9K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 201.807545] systemd-logind[515]: Session 25 logged out. Waiting for processes to exit. worker2 # [ 201.810499] systemd-logind[515]: Removed session 25. worker1 # [ 203.400991] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 203.409450] systemd[1]: Started SSH per-connection Daemon (vsock:2:27). worker1 # [ 203.495803] sshd-session[1677]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 203.503030] sshd-session[1677]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 203.512925] sshd-session[1677]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 203.523751] systemd-logind[539]: New session '33' of user 'root' with class 'user' and type 'tty'. worker1 # [ 203.529433] systemd[1]: Started Session 33 of User root. worker1 # [ 203.563571] sshd-session[1683]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 203.566583] sshd-session[1683]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 203.568543] sshd-session[1677]: pam_unix(sshd:session): session closed for user root worker1 # [ 203.573294] systemd[1]: sshd-vsock@27-28-5:22-2:27.service: Deactivated successfully. worker1 # [ 203.578341] systemd[1]: session-33.scope: Deactivated successfully. worker1 # [ 203.580283] systemd[1]: session-33.scope: Consumed 27ms CPU time over 50ms wall clock time, 3.1M memory peak, 19.5K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 203.585590] systemd-logind[539]: Session 33 logged out. Waiting for processes to exit. worker1 # [ 203.587645] systemd-logind[539]: Removed session 33. worker2 # [ 202.483714] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 202.491503] systemd[1]: Started SSH per-connection Daemon (vsock:2:21). worker2 # [ 202.598239] sshd-session[1674]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 202.609096] sshd-session[1674]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 202.619412] sshd-session[1674]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 202.632525] systemd-logind[515]: New session '27' of user 'root' with class 'user' and type 'tty'. worker2 # [ 202.636681] systemd[1]: Started Session 27 of User root. worker2 # [ 202.673733] sshd-session[1680]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 202.676797] sshd-session[1680]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 202.678281] sshd-session[1674]: pam_unix(sshd:session): session closed for user root worker2 # [ 202.683340] systemd[1]: sshd-vsock@21-22-6:22-2:21.service: Deactivated successfully. worker2 # [ 202.689130] systemd[1]: session-27.scope: Deactivated successfully. worker2 # [ 202.691021] systemd[1]: session-27.scope: Consumed 29ms CPU time over 53ms wall clock time, 3.1M memory peak, 4.9K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 202.697156] systemd-logind[515]: Session 27 logged out. Waiting for processes to exit. worker2 # [ 202.699659] systemd-logind[515]: Removed session 27. ok test farm::serial::a_failing_build_is_counted_with_its_own_reason ... worker1 # [ 204.389405] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 204.397773] systemd[1]: Started SSH per-connection Daemon (vsock:2:28). worker1 # [ 204.507052] sshd-session[1688]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 204.516303] sshd-session[1688]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 204.526681] sshd-session[1688]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 204.538300] systemd-logind[539]: New session '34' of user 'root' with class 'user' and type 'tty'. worker1 # [ 204.547144] systemd[1]: Started Session 34 of User root. worker1 # [ 204.578811] sshd-session[1694]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 204.582517] sshd-session[1694]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 204.583602] sshd-session[1688]: pam_unix(sshd:session): session closed for user root worker1 # [ 204.587727] systemd[1]: sshd-vsock@28-29-5:22-2:28.service: Deactivated successfully. worker1 # [ 204.593777] systemd[1]: session-34.scope: Deactivated successfully. worker1 # [ 204.598335] systemd-logind[539]: Session 34 logged out. Waiting for processes to exit. worker1 # [ 204.601425] systemd-logind[539]: Removed session 34. lb # [ 206.327751] envoy[897]: conn peer=[2001:db8:1::1]:49812 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2842 tx=1665 ms=15371 worker2 # [ 205.749402] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 205.757869] systemd[1]: Started SSH per-connection Daemon (vsock:2:22). worker2 # [ 205.865452] sshd-session[1685]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 205.876150] sshd-session[1685]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 205.885802] sshd-session[1685]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 205.895879] systemd-logind[515]: New session '28' of user 'root' with class 'user' and type 'tty'. worker2 # [ 205.909195] systemd[1]: Started Session 28 of User root. worker2 # [ 205.943967] sshd-session[1691]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 205.947012] sshd-session[1691]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 205.949000] sshd-session[1685]: pam_unix(sshd:session): session closed for user root worker2 # [ 205.952915] systemd[1]: sshd-vsock@22-23-6:22-2:22.service: Deactivated successfully. worker2 # [ 205.958594] systemd[1]: session-28.scope: Deactivated successfully. worker2 # [ 205.963175] systemd-logind[515]: Session 28 logged out. Waiting for processes to exit. worker2 # [ 205.966096] systemd-logind[515]: Removed session 28. lb # [ 209.440530] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 209.444189] systemd[1]: Started SSH per-connection Daemon (vsock:2:19). lb # [ 209.544991] sshd-session[1384]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 209.555287] sshd-session[1384]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 209.564237] sshd-session[1384]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 209.573152] systemd-logind[499]: New session '25' of user 'root' with class 'user' and type 'tty'. lb # [ 209.584634] systemd[1]: Started Session 25 of User root. lb # [ 209.623287] sshd-session[1390]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 209.626260] sshd-session[1390]: Disconnected from user root UNKNOWN port 65535 lb # [ 209.627645] sshd-session[1384]: pam_unix(sshd:session): session closed for user root lb # [ 209.632318] systemd[1]: sshd-vsock@19-20-4:22-2:19.service: Deactivated successfully. lb # [ 209.638313] systemd[1]: session-25.scope: Deactivated successfully. lb # [ 209.640452] systemd[1]: session-25.scope: Consumed 30ms CPU time over 55ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 209.646101] systemd-logind[499]: Session 25 logged out. Waiting for processes to exit. lb # [ 209.648213] systemd-logind[499]: Removed session 25. worker1 # [ 210.045933] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 210.055073] systemd[1]: Started SSH per-connection Daemon (vsock:2:29). worker1 # [ 210.155332] sshd-session[1700]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 210.166778] sshd-session[1700]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 210.175178] sshd-session[1700]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 210.186674] systemd-logind[539]: New session '35' of user 'root' with class 'user' and type 'tty'. worker1 # [ 210.192678] systemd[1]: Started Session 35 of User root. worker1 # [ 210.227337] sshd-session[1706]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 210.230184] sshd-session[1706]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 210.231574] sshd-session[1700]: pam_unix(sshd:session): session closed for user root worker1 # [ 210.235588] systemd[1]: sshd-vsock@29-30-5:22-2:29.service: Deactivated successfully. worker1 # [ 210.241235] systemd[1]: session-35.scope: Deactivated successfully. worker1 # [ 210.242839] systemd[1]: session-35.scope: Consumed 27ms CPU time over 49ms wall clock time, 5.1M memory peak, 19.5K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 210.247806] systemd-logind[539]: Session 35 logged out. Waiting for processes to exit. worker1 # [ 210.250422] systemd-logind[539]: Removed session 35. client # [ 212.394357] systemd[1]: Stopping User Manager for UID 0... client # [ 212.401703] systemd[1322]: Activating special unit Exit the Session... client # [ 212.406443] systemd[1322]: Stopped target Main User Target. client # [ 212.407949] systemd[1322]: Stopped target Basic System. client # [ 212.413605] systemd[1322]: Stopped target Paths. client # [ 212.414754] systemd[1322]: Stopped target Sockets. client # [ 212.415871] systemd[1322]: Stopped target Timers. client # [ 212.417453] systemd[1322]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 212.419100] systemd[1322]: Closed D-Bus User Message Bus Socket. client # [ 212.420637] systemd[1322]: Stopped Create User Files and Directories. client # [ 212.422092] systemd[1322]: Removed slice User Application Slice. client # [ 212.423452] systemd[1322]: Reached target Shutdown. client # [ 212.425674] systemd[1322]: Finished Exit the Session. client # [ 212.426919] systemd[1322]: Reached target Exit the Session. client # [ 212.449974] systemd-logind[427]: Removed session 30. client # [ 212.458037] systemd[1]: user@0.service: Deactivated successfully. client # [ 212.461547] systemd[1]: Stopped User Manager for UID 0. client # [ 212.527357] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 212.561654] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 212.566427] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 212.572572] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 212.925281] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 212.933831] systemd[1]: Started SSH per-connection Daemon (vsock:2:30). worker1 # [ 213.033671] sshd-session[1711]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 213.044172] sshd-session[1711]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 213.053797] sshd-session[1711]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 213.063450] systemd-logind[539]: New session '36' of user 'root' with class 'user' and type 'tty'. worker1 # [ 213.071054] systemd[1]: Started Session 36 of User root. worker1 # [ 213.105474] sshd-session[1717]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 213.107052] sshd-session[1717]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 213.109185] sshd-session[1711]: pam_unix(sshd:session): session closed for user root worker1 # [ 213.113623] systemd[1]: sshd-vsock@30-31-5:22-2:30.service: Deactivated successfully. worker1 # [ 213.118667] systemd[1]: session-36.scope: Deactivated successfully. worker1 # [ 213.122253] systemd[1]: session-36.scope: Consumed 28ms CPU time over 51ms wall clock time, 3.1M memory peak, 19.5K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 213.127039] systemd-logind[539]: Session 36 logged out. Waiting for processes to exit. worker1 # [ 213.128405] systemd-logind[539]: Removed session 36. worker2 # [ 212.597414] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 212.607128] systemd[1]: Started SSH per-connection Daemon (vsock:2:23). worker2 # [ 212.708777] sshd-session[1697]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 212.717157] sshd-session[1697]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 212.728483] sshd-session[1697]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 212.737871] systemd-logind[515]: New session '29' of user 'root' with class 'user' and type 'tty'. worker2 # [ 212.746874] systemd[1]: Started Session 29 of User root. worker2 # [ 212.784505] sshd-session[1703]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 212.786295] sshd-session[1703]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 212.788200] sshd-session[1697]: pam_unix(sshd:session): session closed for user root worker2 # [ 212.792845] systemd[1]: sshd-vsock@23-24-6:22-2:23.service: Deactivated successfully. worker2 # [ 212.799083] systemd[1]: session-29.scope: Deactivated successfully. worker2 # [ 212.802471] systemd[1]: session-29.scope: Consumed 30ms CPU time over 55ms wall clock time, 3.1M memory peak, 4.9K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 212.808449] systemd-logind[515]: Session 29 logged out. Waiting for processes to exit. worker2 # [ 212.810730] systemd-logind[515]: Removed session 29. worker1 # [ 216.355812] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 216.363949] systemd[1]: Started SSH per-connection Daemon (vsock:2:31). worker1 # [ 216.459886] sshd-session[1722]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 216.468420] sshd-session[1722]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 216.479149] sshd-session[1722]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 216.490922] systemd-logind[539]: New session '37' of user 'root' with class 'user' and type 'tty'. worker1 # [ 216.501166] systemd[1]: Started Session 37 of User root. worker1 # [ 216.539237] sshd-session[1728]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 216.541287] sshd-session[1728]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 216.542721] sshd-session[1722]: pam_unix(sshd:session): session closed for user root worker1 # [ 216.547464] systemd[1]: sshd-vsock@31-32-5:22-2:31.service: Deactivated successfully. worker1 # [ 216.553097] systemd[1]: session-37.scope: Deactivated successfully. worker1 # [ 216.554826] systemd[1]: session-37.scope: Consumed 29ms CPU time over 53ms wall clock time, 3.1M memory peak, 19.5K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 216.561183] systemd-logind[539]: Session 37 logged out. Waiting for processes to exit. worker1 # [ 216.562375] systemd-logind[539]: Removed session 37. [e2e] heartbeat t=120s worker2 # [ 216.755064] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 216.764379] systemd[1]: Started SSH per-connection Daemon (vsock:2:24). worker2 # [ 216.863686] sshd-session[1708]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 216.872834] sshd-session[1708]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 216.883812] sshd-session[1708]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 216.896347] systemd-logind[515]: New session '30' of user 'root' with class 'user' and type 'tty'. worker2 # [ 216.900602] systemd[1]: Started Session 30 of User root. worker2 # [ 216.938296] sshd-session[1714]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 216.941051] sshd-session[1714]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 216.942721] sshd-session[1708]: pam_unix(sshd:session): session closed for user root worker2 # [ 216.946811] systemd[1]: sshd-vsock@24-25-6:22-2:24.service: Deactivated successfully. worker2 # [ 216.952595] systemd[1]: session-30.scope: Deactivated successfully. lb # [ 219.805970] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 216.954726] systemd[1]: session-30.scope: Consumed 29ms CPU time over 53ms wall clock time, 5.1M memory peak, 4.9K incoming IP traffic, 457B outgoing IP traffic. lb # [ 219.814422] systemd[1314]: Activating special unit Exit the Session... worker2 # [ 216.961324] systemd-logind[515]: Session 30 logged out. Waiting for processes to exit. worker2 # [ 216.962731] systemd-logind[515]: Removed session 30. lb # [ 219.820503] systemd[1314]: Stopped target Main User Target. lb # [ 219.821965] systemd[1314]: Stopped target Basic System. lb # [ 219.823179] systemd[1314]: Stopped target Paths. lb # [ 219.828784] systemd[1314]: Stopped target Sockets. lb # [ 219.830018] systemd[1314]: Stopped target Timers. lb # [ 219.831133] systemd[1314]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 219.833101] systemd[1314]: Closed D-Bus User Message Bus Socket. lb # [ 219.834463] systemd[1314]: Stopped Create User Files and Directories. lb # [ 219.835913] systemd[1314]: Removed slice User Application Slice. lb # [ 219.837670] systemd[1314]: Reached target Shutdown. lb # [ 219.838870] systemd[1314]: Finished Exit the Session. lb # [ 219.840140] systemd[1314]: Reached target Exit the Session. lb # [ 219.849958] systemd-logind[499]: Removed session 20. lb # [ 219.858090] systemd[1]: user@0.service: Deactivated successfully. lb # [ 219.861133] systemd[1]: Stopped User Manager for UID 0. lb # [ 219.930405] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 219.970321] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 219.975766] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 219.979909] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 220.089738] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 220.096684] systemd[1]: Started SSH per-connection Daemon (vsock:2:27). client # [ 220.175255] sshd-session[1368]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 220.183443] sshd-session[1368]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 220.190896] sshd-session[1368]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 220.220253] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 220.254502] systemd-logind[427]: New session '33' of user 'root' with class 'user' and type 'tty'. client # [ 220.265678] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 220.272779] systemd[1]: Starting User Manager for UID 0... client # [ 220.299139] (systemd)[1377]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 220.306527] systemd-logind[427]: New session '34' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 220.399212] systemd[1377]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 220.499588] systemd[1377]: Queued start job for default target Main User Target. client # [ 220.509231] systemd[1377]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 220.513699] systemd[1377]: Created slice User Application Slice. client # [ 220.514762] systemd[1377]: Started Daily Cleanup of User's Temporary Directories. client # [ 220.515835] systemd[1377]: Reached target Paths. client # [ 220.519663] systemd[1377]: Reached target Timers. client # [ 220.521960] systemd[1377]: Starting D-Bus User Message Bus Socket... client # [ 220.522955] systemd[1377]: Starting Create User Files and Directories... client # [ 220.568698] systemd[1377]: Finished Create User Files and Directories. client # [ 220.573220] systemd[1377]: Listening on D-Bus User Message Bus Socket. client # [ 220.578652] systemd[1377]: Reached target Sockets. client # [ 220.579552] systemd[1377]: Reached target Basic System. client # [ 220.580757] systemd[1377]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 220.582189] systemd[1377]: Reached target Main User Target. client # [ 220.583009] systemd[1377]: Startup finished in 251ms. client # [ 220.583764] systemd[1]: Started User Manager for UID 0. client # [ 220.587670] systemd[1]: Started Session 33 of User root. worker2 # [ 219.203287] nix-grpc-daemon[1487]: ts=2026-11-12T09:22:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48140 worker1 # [ 220.765809] nix-grpc-daemon[485]: ts=2026-11-12T09:22:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 222.071307] garage[898]: 2026-11-12T09:22:03.830590Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/b9qg95kksva1qwbm9z7z66jbbwynfh18.narinfo lb # [ 222.076496] garage[898]: 2026-11-12T09:22:03.832058Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 219.231576] nix-grpc-daemon[1487]: ts=2026-11-12T09:22:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 222.090202] garage[898]: 2026-11-12T09:22:03.849666Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/b9qg95kksva1qwbm9z7z66jbbwynfh18.narinfo lb # [ 222.095350] garage[898]: 2026-11-12T09:22:03.850096Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 222.100484] garage[898]: 2026-11-12T09:22:03.859370Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/b9qg95kksva1qwbm9z7z66jbbwynfh18.narinfo lb # [ 222.105623] garage[898]: 2026-11-12T09:22:03.859757Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 219.257097] nix-grpc-daemon[1487]: ts=2026-11-12T09:22:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 222.116219] garage[898]: 2026-11-12T09:22:03.875436Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/j4rjl229w5xzbr9614xcipiv7652fdka.narinfo lb # [ 222.120726] garage[898]: 2026-11-12T09:22:03.876074Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 219.286626] nix-grpc-daemon[1487]: ts=2026-11-12T09:22:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 worker2 # [ 219.295864] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 219.315639] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 219.337159] nix-grpc-daemon[1487]: ts=2026-11-12T09:22:04Z level=info event=niks3_push_started pid=1723 worker2 # [ 219.490020] nix-grpc-daemon[1723]: time=2026-11-12T09:22:04.762Z level=INFO msg="Configuring client TLS" cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker2.pem key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker2.key ca="" worker2 # [ 219.614684] nix-daemon[976]: accepted connection from pid 1736, user nix-grpc-daemon (trusted) worker2 # [ 219.643384] nix-daemon[976]: reaped child process 1739, status = succeeded lb # [ 222.495144] niks3-server[956]: 2026/11/12 09:22:04 INFO Received push request method=POST path=/api/pushes worker2 # [ 219.650052] nix-grpc-daemon[1723]: time=2026-11-12T09:22:04.921Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 219.651833] nix-grpc-daemon[1723]: time=2026-11-12T09:22:04.921Z level=INFO msg="Uploading j4rjl229w5xzbr9614xcipiv7652fdka-fail-boom.drv (400B)" worker2 # [ 219.675360] nix-grpc-daemon[1723]: time=2026-11-12T09:22:04.947Z level=INFO msg="Uploading 1 narinfos" lb # [ 222.512123] garage[898]: 2026-11-12T09:22:04.271489Z INFO garage_api_common::generic_server: 192.168.1.4:54250 PUT /farm/j4rjl229w5xzbr9614xcipiv7652fdka.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092204Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2fe20c89f00777b349315b65af80cf8ce4c2abc8b9e7ac95ea71aa694df1cfb2 lb # [ 222.535276] garage[898]: 2026-11-12T09:22:04.281075Z INFO garage_api_common::generic_server: 192.168.1.4:54238 PUT /farm/nar/0d79vqzwc4s1agk431w3csq2p4brahnzmanwj14fjf383ld797i6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092204Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=318d71724e57f5536770b7cce1b6d0dc05b13d4497ea10404f26050b2e629d1f lb # [ 222.546207] garage[898]: 2026-11-12T09:22:04.284618Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/j4rjl229w5xzbr9614xcipiv7652fdka.ls lb # [ 222.550688] garage[898]: 2026-11-12T09:22:04.288558Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/nar/0d79vqzwc4s1agk431w3csq2p4brahnzmanwj14fjf383ld797i6.nar.zst lb # [ 222.555491] garage[898]: 2026-11-12T09:22:04.289057Z INFO garage_api_common::generic_server: 192.168.1.4:54238 PUT /farm/j4rjl229w5xzbr9614xcipiv7652fdka.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092204Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d007dd09880ca114a84bd49c1df0ecc5f0c21893d5324de04bedde3dd4c2878b worker2 # [ 219.711725] nix-grpc-daemon[1723]: time=2026-11-12T09:22:04.984Z level=INFO msg="Upload complete. (217ms)" lb # [ 222.565707] garage[898]: 2026-11-12T09:22:04.293948Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/j4rjl229w5xzbr9614xcipiv7652fdka.narinfo lb # [ 222.571222] niks3-server[956]: 2026/11/12 09:22:04 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign worker2 # [ 219.720282] nix-grpc-daemon[1487]: ts=2026-11-12T09:22:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 paths=1 nar_bytes_in=400 lb # [ 222.574752] niks3-server[956]: 2026/11/12 09:22:04 INFO Signed narinfos id=26 count=1 lb # [ 222.577720] niks3-server[956]: 2026/11/12 09:22:04 INFO Received complete push request method=POST path=/api/pushes/26/complete lb # [ 222.580877] niks3-server[956]: 2026/11/12 09:22:04 INFO Registered completed upload object_key=j4rjl229w5xzbr9614xcipiv7652fdka.ls worker2 # [ 219.729177] nix-daemon[976]: reaped child process 1719, status = succeeded lb # [ 222.584678] niks3-server[956]: 2026/11/12 09:22:04 INFO Registered completed upload object_key=nar/0d79vqzwc4s1agk431w3csq2p4brahnzmanwj14fjf383ld797i6.nar.zst lb # [ 222.587698] niks3-server[956]: 2026/11/12 09:22:04 INFO Completed push id=26 objects=3 duration=33.62712ms lb # [ 222.590299] niks3-server[956]: 2026/11/12 09:22:04 INFO Registered completed upload object_key=j4rjl229w5xzbr9614xcipiv7652fdka.narinfo worker1 # [ 221.291670] nix-grpc-daemon[485]: ts=2026-11-12T09:22:05Z level=debug event=want client=11 drv=j4rjl229w5xzbr9614xcipiv7652fdka-fail-boom.drv cached=0 worker1 # [ 221.295717] nix-grpc-daemon[485]: ts=2026-11-12T09:22:05Z level=debug event=assigned drv=j4rjl229w5xzbr9614xcipiv7652fdka-fail-boom.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 219.742971] nix-grpc-daemon[1487]: ts=2026-11-12T09:22:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 worker2 # [ 219.753180] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 219.768167] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 223.115402] garage[898]: 2026-11-12T09:22:04.874148Z INFO garage_api_common::generic_server: 127.0.0.1:35134 (key GK0123456789abcdef01234567) HEAD /farm/b9qg95kksva1qwbm9z7z66jbbwynfh18.narinfo lb # [ 223.120807] garage[898]: 2026-11-12T09:22:04.874592Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 220.579318] nix-grpc-daemon[1487]: ts=2026-11-12T09:22:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 drv=j4rjl229w5xzbr9614xcipiv7652fdka-fail-boom.drv assign_id=15 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 220.608533] nix-daemon[976]: reaped child process 1742, status = succeeded worker2 # [ 220.610600] nix-daemon[976]: reaped child process 1744, status = succeeded client # [ 222.159743] sshd-session[1390]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 222.162620] sshd-session[1390]: Disconnected from user root UNKNOWN port 65535 client # [ 222.164660] sshd-session[1368]: pam_unix(sshd:session): session closed for user root client # [ 222.169660] systemd[1]: sshd-vsock@27-28-3:22-2:27.service: Deactivated successfully. client # [ 222.175017] systemd[1]: session-33.scope: Deactivated successfully. client # [ 222.176974] systemd[1]: session-33.scope: Consumed 175ms CPU time over 1.591s wall clock time, 42.1M memory peak, 8.1K incoming IP traffic, 8.2K outgoing IP traffic. client # [ 222.182903] systemd-logind[427]: Session 33 logged out. Waiting for processes to exit. client # [ 222.185646] systemd-logind[427]: Removed session 33. lb # [ 226.325707] envoy[897]: conn peer=[2001:db8:1::1]:56478 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2721 tx=1304 ms=1397 worker1 # [ 225.308909] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 225.317481] systemd[1]: Started SSH per-connection Daemon (vsock:2:32). worker1 # [ 225.421627] sshd-session[1735]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 225.430593] sshd-session[1735]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 225.438860] sshd-session[1735]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 225.450672] systemd-logind[539]: New session '38' of user 'root' with class 'user' and type 'tty'. worker1 # [ 225.456702] systemd[1]: Started Session 38 of User root. worker1 # [ 225.490984] sshd-session[1741]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 225.492993] sshd-session[1741]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 225.494322] sshd-session[1735]: pam_unix(sshd:session): session closed for user root worker1 # [ 225.502099] systemd[1]: sshd-vsock@32-33-5:22-2:32.service: Deactivated successfully. worker1 # [ 225.507502] systemd[1]: session-38.scope: Deactivated successfully. worker1 # [ 225.511263] systemd[1]: session-38.scope: Consumed 25ms CPU time over 52ms wall clock time, 3.1M memory peak, 19.5K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 225.515773] systemd-logind[539]: Session 38 logged out. Waiting for processes to exit. worker1 # [ 225.517441] systemd-logind[539]: Removed session 38. worker2 # [ 227.084305] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 227.093889] systemd[1656]: Activating special unit Exit the Session... worker2 # [ 227.095731] systemd[1656]: Stopped target Main User Target. worker2 # [ 227.102723] systemd[1656]: Stopped target Basic System. worker2 # [ 227.104330] systemd[1656]: Stopped target Paths. worker2 # [ 227.105443] systemd[1656]: Stopped target Sockets. worker2 # [ 227.106687] systemd[1656]: Stopped target Timers. worker2 # [ 227.107810] systemd[1656]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 227.109853] systemd[1656]: Closed D-Bus User Message Bus Socket. worker2 # [ 227.111232] systemd[1656]: Stopped Create User Files and Directories. worker2 # [ 227.113370] systemd[1656]: Removed slice User Application Slice. worker2 # [ 227.114807] systemd[1656]: Reached target Shutdown. worker2 # [ 227.115954] systemd[1656]: Finished Exit the Session. worker2 # [ 227.117701] systemd[1656]: Reached target Exit the Session. worker2 # [ 227.141805] systemd-logind[515]: Removed session 26. worker2 # [ 227.149838] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 227.152660] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 227.174535] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 227.217857] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 227.221318] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 227.227810] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 228.306860] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 228.316452] systemd[1]: Started SSH per-connection Daemon (vsock:2:25). worker2 # [ 228.413988] sshd-session[1764]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 228.423627] sshd-session[1764]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 228.432625] sshd-session[1764]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 228.453913] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 228.462109] systemd-logind[515]: New session '31' of user 'root' with class 'user' and type 'tty'. worker2 # [ 228.493516] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 228.500145] systemd[1]: Starting User Manager for UID 0... worker2 # [ 228.526611] (systemd)[1772]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 228.533156] systemd-logind[515]: New session '32' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 228.624733] systemd[1772]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 228.740648] systemd[1772]: Queued start job for default target Main User Target. worker2 # [ 228.746359] systemd[1772]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 228.749768] systemd[1772]: Created slice User Application Slice. worker2 # [ 228.750762] systemd[1772]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 228.751829] systemd[1772]: Reached target Paths. worker2 # [ 228.752918] systemd[1772]: Reached target Timers. worker2 # [ 228.755971] systemd[1772]: Starting D-Bus User Message Bus Socket... worker2 # [ 228.758218] systemd[1772]: Starting Create User Files and Directories... worker2 # [ 228.798994] systemd[1772]: Finished Create User Files and Directories. worker2 # [ 228.803415] systemd[1772]: Listening on D-Bus User Message Bus Socket. worker2 # [ 228.806921] systemd[1772]: Reached target Sockets. worker2 # [ 228.807745] systemd[1772]: Reached target Basic System. worker2 # [ 228.810095] systemd[1772]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 228.811629] systemd[1772]: Reached target Main User Target. worker2 # [ 228.815686] systemd[1772]: Startup finished in 256ms. worker2 # [ 228.817496] systemd[1]: Started User Manager for UID 0. worker2 # [ 228.818331] systemd[1]: Started Session 31 of User root. worker2 # [ 228.849338] sshd-session[1785]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 228.852269] sshd-session[1785]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 228.853659] sshd-session[1764]: pam_unix(sshd:session): session closed for user root worker2 # [ 228.858659] systemd[1]: sshd-vsock@25-26-6:22-2:25.service: Deactivated successfully. worker2 # [ 228.863819] systemd[1]: session-31.scope: Deactivated successfully. worker2 # [ 228.867440] systemd[1]: session-31.scope: Consumed 27ms CPU time over 52ms wall clock time, 4.6M memory peak, 11.5K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 228.872562] systemd-logind[515]: Session 31 logged out. Waiting for processes to exit. worker2 # [ 228.874089] systemd-logind[515]: Removed session 31. client # [ 232.395231] systemd[1]: Stopping User Manager for UID 0... client # [ 232.404662] systemd[1377]: Activating special unit Exit the Session... client # [ 232.406337] systemd[1377]: Stopped target Main User Target. client # [ 232.407616] systemd[1377]: Stopped target Basic System. client # [ 232.413029] systemd[1377]: Stopped target Paths. client # [ 232.414218] systemd[1377]: Stopped target Sockets. client # [ 232.415322] systemd[1377]: Stopped target Timers. client # [ 232.416897] systemd[1377]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 232.418596] systemd[1377]: Closed D-Bus User Message Bus Socket. client # [ 232.419962] systemd[1377]: Stopped Create User Files and Directories. client # [ 232.421560] systemd[1377]: Removed slice User Application Slice. client # [ 232.422900] systemd[1377]: Reached target Shutdown. client # [ 232.425031] systemd[1377]: Finished Exit the Session. client # [ 232.426281] systemd[1377]: Reached target Exit the Session. client # [ 232.459181] systemd-logind[427]: Removed session 34. client # [ 232.466356] systemd[1]: user@0.service: Deactivated successfully. client # [ 232.472289] systemd[1]: Stopped User Manager for UID 0. client # [ 232.531488] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 232.570118] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 232.575729] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 232.580868] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 232.982998] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 232.991995] systemd[1]: Started SSH per-connection Daemon (vsock:2:33). worker1 # [ 233.087545] sshd-session[1746]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 233.095458] sshd-session[1746]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 233.106727] sshd-session[1746]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 233.117099] systemd-logind[539]: New session '39' of user 'root' with class 'user' and type 'tty'. worker1 # [ 233.126671] systemd[1]: Started Session 39 of User root. worker1 # [ 233.159516] sshd-session[1752]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 233.162416] sshd-session[1752]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 233.164209] sshd-session[1746]: pam_unix(sshd:session): session closed for user root worker1 # [ 233.167940] systemd[1]: sshd-vsock@33-34-5:22-2:33.service: Deactivated successfully. worker1 # [ 233.173742] systemd[1]: session-39.scope: Deactivated successfully. worker1 # [ 233.176884] systemd[1]: session-39.scope: Consumed 27ms CPU time over 50ms wall clock time, 3.1M memory peak, 19.5K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 233.181722] systemd-logind[539]: Session 39 logged out. Waiting for processes to exit. worker1 # [ 233.182950] systemd-logind[539]: Removed session 39. worker2 # [ 231.730327] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 231.739427] systemd[1]: Started SSH per-connection Daemon (vsock:2:26). worker2 # [ 231.840642] sshd-session[1790]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 231.850619] sshd-session[1790]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 231.859806] sshd-session[1790]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 231.871831] systemd-logind[515]: New session '33' of user 'root' with class 'user' and type 'tty'. worker2 # [ 231.876586] systemd[1]: Started Session 33 of User root. worker2 # [ 231.926788] sshd-session[1796]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 231.928594] sshd-session[1796]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 231.929972] sshd-session[1790]: pam_unix(sshd:session): session closed for user root worker2 # [ 231.934473] systemd[1]: sshd-vsock@26-27-6:22-2:26.service: Deactivated successfully. worker2 # [ 231.940157] systemd[1]: session-33.scope: Deactivated successfully. worker2 # [ 231.943446] systemd[1]: session-33.scope: Consumed 29ms CPU time over 64ms wall clock time, 6.6M memory peak, 11.5K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 231.948696] systemd-logind[515]: Session 33 logged out. Waiting for processes to exit. worker2 # [ 231.949928] systemd-logind[515]: Removed session 33. ok test farm::serial::a_niks3_restart_does_not_cost_the_leader_its_role ... worker1 # [ 236.254039] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 236.263002] systemd[1]: Started SSH per-connection Daemon (vsock:2:34). worker1 # [ 236.357718] sshd-session[1757]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 236.367305] sshd-session[1757]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 236.376371] sshd-session[1757]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 236.385391] systemd-logind[539]: New session '40' of user 'root' with class 'user' and type 'tty'. worker1 # [ 236.397008] systemd[1]: Started Session 40 of User root. worker1 # [ 236.432208] sshd-session[1763]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 236.433721] sshd-session[1763]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 236.435361] sshd-session[1757]: pam_unix(sshd:session): session closed for user root worker1 # [ 236.439667] systemd[1]: sshd-vsock@34-35-5:22-2:34.service: Deactivated successfully. worker1 # [ 236.445873] systemd[1]: session-40.scope: Deactivated successfully. worker1 # [ 236.450251] systemd-logind[539]: Session 40 logged out. Waiting for processes to exit. worker1 # [ 236.453205] systemd-logind[539]: Removed session 40. worker2 # [ 237.001502] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 237.011260] systemd[1]: Started SSH per-connection Daemon (vsock:2:27). worker2 # [ 237.108993] sshd-session[1801]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 237.117832] sshd-session[1801]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 237.129299] sshd-session[1801]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 237.139448] systemd-logind[515]: New session '34' of user 'root' with class 'user' and type 'tty'. worker2 # [ 237.146607] systemd[1]: Started Session 34 of User root. worker2 # [ 237.178639] sshd-session[1807]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 237.181484] sshd-session[1807]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 237.183368] sshd-session[1801]: pam_unix(sshd:session): session closed for user root worker2 # [ 237.187332] systemd[1]: sshd-vsock@27-28-6:22-2:27.service: Deactivated successfully. worker2 # [ 237.193137] systemd[1]: session-34.scope: Deactivated successfully. worker2 # [ 237.197571] systemd-logind[515]: Session 34 logged out. Waiting for processes to exit. worker2 # [ 237.199635] systemd-logind[515]: Removed session 34. lb # [ 242.427279] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 242.432260] systemd[1]: Started SSH per-connection Daemon (vsock:2:20). lb # [ 242.530778] sshd-session[1403]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 242.540878] sshd-session[1403]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 242.549646] sshd-session[1403]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 242.580505] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 242.611560] systemd-logind[499]: New session '26' of user 'root' with class 'user' and type 'tty'. lb # [ 242.623104] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 242.628134] systemd[1]: Starting User Manager for UID 0... lb # [ 242.654491] (systemd)[1412]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 242.660164] systemd-logind[499]: New session '27' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 242.756168] systemd[1412]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 242.860212] systemd[1412]: Queued start job for default target Main User Target. lb # [ 242.869043] systemd[1412]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 242.873461] systemd[1412]: Created slice User Application Slice. lb # [ 242.874513] systemd[1412]: Started Daily Cleanup of User's Temporary Directories. lb # [ 242.875578] systemd[1412]: Reached target Paths. lb # [ 242.878998] systemd[1412]: Reached target Timers. lb # [ 242.879832] systemd[1412]: Starting D-Bus User Message Bus Socket... lb # [ 242.884294] systemd[1412]: Starting Create User Files and Directories... lb # [ 242.929679] systemd[1412]: Finished Create User Files and Directories. lb # [ 242.934416] systemd[1412]: Listening on D-Bus User Message Bus Socket. lb # [ 242.939421] systemd[1412]: Reached target Sockets. lb # [ 242.942026] systemd[1412]: Reached target Basic System. lb # [ 242.942888] systemd[1]: Started User Manager for UID 0. lb # [ 242.943811] systemd[1412]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 242.945440] systemd[1412]: Reached target Main User Target. lb # [ 242.946264] systemd[1412]: Startup finished in 262ms. lb # [ 242.949508] systemd[1]: Started Session 26 of User root. lb # [ 242.985289] sshd-session[1425]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 242.986768] sshd-session[1425]: Disconnected from user root UNKNOWN port 65535 lb # [ 242.988414] sshd-session[1403]: pam_unix(sshd:session): session closed for user root lb # [ 242.993120] systemd[1]: sshd-vsock@20-21-4:22-2:20.service: Deactivated successfully. lb # [ 242.998527] systemd[1]: session-26.scope: Deactivated successfully. lb # [ 243.001889] systemd[1]: session-26.scope: Consumed 27ms CPU time over 51ms wall clock time, 4.9M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 243.007209] systemd-logind[499]: Session 26 logged out. Waiting for processes to exit. lb # [ 243.008927] systemd-logind[499]: Removed session 26. worker1 # [ 244.409781] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 244.418953] systemd[1]: Started SSH per-connection Daemon (vsock:2:35). worker1 # [ 244.516660] sshd-session[1769]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 244.525881] sshd-session[1769]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 244.534708] sshd-session[1769]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 244.545277] systemd-logind[539]: New session '41' of user 'root' with class 'user' and type 'tty'. worker1 # [ 244.553085] systemd[1]: Started Session 41 of User root. worker1 # [ 244.591176] sshd-session[1775]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 244.593192] sshd-session[1775]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 244.594678] sshd-session[1769]: pam_unix(sshd:session): session closed for user root worker1 # [ 244.599648] systemd[1]: sshd-vsock@35-36-5:22-2:35.service: Deactivated successfully. worker1 # [ 244.605636] systemd[1]: session-41.scope: Deactivated successfully. worker1 # [ 244.609550] systemd[1]: session-41.scope: Consumed 29ms CPU time over 54ms wall clock time, 3.1M memory peak, 19.5K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 244.612945] systemd-logind[539]: Session 41 logged out. Waiting for processes to exit. worker1 # [ 244.614881] systemd-logind[539]: Removed session 41. lb # [ 248.996559] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 249.000636] systemd[1]: Started SSH per-connection Daemon (vsock:2:21). lb # [ 249.104698] sshd-session[1431]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 249.115027] sshd-session[1431]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 249.123904] sshd-session[1431]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 249.133775] systemd-logind[499]: New session '28' of user 'root' with class 'user' and type 'tty'. lb # [ 249.140688] systemd[1]: Started Session 28 of User root. lb # [ 249.189486] sshd-session[1437]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 249.191053] sshd-session[1437]: Disconnected from user root UNKNOWN port 65535 lb # [ 249.192866] sshd-session[1431]: pam_unix(sshd:session): session closed for user root lb # [ 249.197914] systemd[1]: sshd-vsock@21-22-4:22-2:21.service: Deactivated successfully. lb # [ 249.203454] systemd[1]: session-28.scope: Deactivated successfully. lb # [ 249.207180] systemd[1]: session-28.scope: Consumed 39ms CPU time over 64ms wall clock time, 4.8M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 249.211256] systemd-logind[499]: Session 28 logged out. Waiting for processes to exit. lb # [ 249.214052] systemd-logind[499]: Removed session 28. [e2e] heartbeat t=150s worker2 # [ 247.334256] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 247.342434] systemd[1772]: Activating special unit Exit the Session... worker2 # [ 247.350621] systemd[1772]: Stopped target Main User Target. worker2 # [ 247.352684] systemd[1772]: Stopped target Basic System. worker2 # [ 247.354021] systemd[1772]: Stopped target Paths. worker2 # [ 247.355424] systemd[1772]: Stopped target Sockets. worker2 # [ 247.357049] systemd[1772]: Stopped target Timers. worker2 # [ 247.358330] systemd[1772]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 247.360909] systemd[1772]: Closed D-Bus User Message Bus Socket. worker2 # [ 247.362740] systemd[1772]: Stopped Create User Files and Directories. worker2 # [ 247.366276] systemd[1772]: Removed slice User Application Slice. worker2 # [ 247.367749] systemd[1772]: Reached target Shutdown. worker2 # [ 247.368983] systemd[1772]: Finished Exit the Session. worker2 # [ 247.370190] systemd[1772]: Reached target Exit the Session. worker2 # [ 247.389332] systemd-logind[515]: Removed session 32. worker2 # [ 247.399729] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 247.404304] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 247.419180] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 247.462126] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 247.467022] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 247.473044] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 249.450545] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 249.458627] systemd[1]: Started SSH per-connection Daemon (vsock:2:36). worker1 # [ 249.556905] sshd-session[1780]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 249.566987] sshd-session[1780]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 249.576170] sshd-session[1780]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 249.587820] systemd-logind[539]: New session '42' of user 'root' with class 'user' and type 'tty'. worker1 # [ 249.592565] systemd[1]: Started Session 42 of User root. worker1 # [ 249.620762] sshd-session[1786]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 249.623340] sshd-session[1786]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 249.624914] sshd-session[1780]: pam_unix(sshd:session): session closed for user root worker1 # [ 249.629620] systemd[1]: sshd-vsock@36-37-5:22-2:36.service: Deactivated successfully. worker1 # [ 249.634843] systemd[1]: session-42.scope: Deactivated successfully. worker1 # [ 249.639515] systemd-logind[539]: Session 42 logged out. Waiting for processes to exit. worker1 # [ 249.642529] systemd-logind[539]: Removed session 42. lb # [ 254.179478] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 254.189444] systemd[1]: Started SSH per-connection Daemon (vsock:2:22). lb # [ 254.283831] sshd-session[1442]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 254.293790] sshd-session[1442]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 254.302350] sshd-session[1442]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 254.312789] systemd-logind[499]: New session '29' of user 'root' with class 'user' and type 'tty'. lb # [ 254.322839] systemd[1]: Started Session 29 of User root. lb # [ 254.354460] niks3-server[956]: 2026/11/12 09:22:36 INFO Shutdown signal received, draining in-flight requests timeout=10s worker2 # [ 251.504490] nix-grpc-daemon[1487]: ts=2026-11-12T09:22:36Z level=info event=scheduler_lock_lost status=200 worker1 # [ 253.058361] nix-grpc-daemon[485]: ts=2026-11-12T09:22:36Z level=info event=scheduler_lock_lost status=200 lb # [ 254.358987] niks3-server[956]: 2026/11/12 09:22:36 INFO lead: released remote=192.168.1.3:33950 lb # [ 254.373668] systemd[1]: Stopping niks3 server... lb # [ 254.379522] systemd[1]: niks3.service: Deactivated successfully. lb # [ 254.381451] systemd[1]: Stopped niks3 server. lb # [ 254.382348] systemd[1]: niks3.service: Consumed 529ms CPU time over 3min 47.274s wall clock time, 39.6M memory peak, 69.5K incoming IP traffic, 131.6K outgoing IP traffic. lb # [ 254.394990] systemd[1]: Starting niks3 server... lb # [ 254.477983] niks3-server[1454]: 2026/11/12 09:22:36 INFO Loaded signing key name=farm-test-1 path=/nix/store/qcn6zbvp2fnqabyy8lxshg7h698xr74x-key lb # [ 254.484635] garage[898]: 2026-11-12T09:22:36.243110Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) GET /farm/?location= lb # [ 254.487125] garage[898]: 2026-11-12T09:22:36.244177Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nix-cache-info lb # [ 254.496269] garage[898]: 2026-11-12T09:22:36.250258Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) GET /farm/?lifecycle=&withUpdatedAt=true lb # [ 254.498866] systemd[1]: Started niks3 server. lb # [ 254.499671] niks3-server[1454]: 2026/11/12 09:22:36 WARN Cannot read the bucket lifecycle configuration; incomplete uploads are only removed by niks3 gc. Add an AbortIncompleteMultipartUpload lifecycle rule to the bucket, or set --abort-incomplete-uploads-days=0 to silence this warning bucket=farm error="The specified bucket does not exist." lb # [ 254.505141] niks3-server[1454]: 2026/11/12 09:22:36 INFO Read proxy enabled — serving cache objects from S3 lb # [ 254.506731] niks3-server[1454]: 2026/11/12 09:22:36 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 254.508212] niks3-server[1454]: 2026/11/12 09:22:36 INFO systemd watchdog enabled interval=15s lb # [ 254.509390] niks3-server[1454]: 2026/11/12 09:22:36 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 254.512139] sshd-session[1448]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 254.513477] sshd-session[1448]: Disconnected from user root UNKNOWN port 65535 lb # [ 254.515294] sshd-session[1442]: pam_unix(sshd:session): session closed for user root lb # [ 254.522751] systemd[1]: sshd-vsock@22-23-4:22-2:22.service: Deactivated successfully. lb # [ 254.525992] systemd-logind[499]: Session 29 logged out. Waiting for processes to exit. lb # [ 254.528833] systemd[1]: session-29.scope: Deactivated successfully. lb # [ 254.531502] systemd-logind[499]: Removed session 29. lb # [ 255.216127] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 255.219731] systemd[1]: Started SSH per-connection Daemon (vsock:2:23). lb # [ 255.316575] sshd-session[1463]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 255.326518] sshd-session[1463]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 255.335436] sshd-session[1463]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 255.344485] systemd-logind[499]: New session '30' of user 'root' with class 'user' and type 'tty'. lb # [ 255.353387] systemd[1]: Started Session 30 of User root. lb # [ 255.363804] niks3-server[1454]: 2026/11/12 09:22:37 INFO lead: acquired remote=192.168.1.3:46670 lb # [ 255.389058] sshd-session[1469]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 255.390606] sshd-session[1469]: Disconnected from user root UNKNOWN port 65535 lb # [ 255.392619] sshd-session[1463]: pam_unix(sshd:session): session closed for user root lb # [ 255.396559] systemd[1]: sshd-vsock@23-24-4:22-2:23.service: Deactivated successfully. lb # [ 255.402141] systemd[1]: session-30.scope: Deactivated successfully. lb # [ 255.406248] systemd-logind[499]: Session 30 logged out. Waiting for processes to exit. lb # [ 255.409103] systemd-logind[499]: Removed session 30. lb # [ 256.873189] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 256.881765] systemd[1]: Started SSH per-connection Daemon (vsock:2:24). lb # [ 256.980750] sshd-session[1476]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 256.991773] sshd-session[1476]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 257.000420] sshd-session[1476]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 257.011806] systemd-logind[499]: New session '31' of user 'root' with class 'user' and type 'tty'. lb # [ 257.017469] systemd[1]: Started Session 31 of User root. lb # [ 257.053272] sshd-session[1482]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 257.056852] sshd-session[1482]: Disconnected from user root UNKNOWN port 65535 lb # [ 257.058064] sshd-session[1476]: pam_unix(sshd:session): session closed for user root lb # [ 257.062214] systemd[1]: sshd-vsock@24-25-4:22-2:24.service: Deactivated successfully. lb # [ 257.067347] systemd[1]: session-31.scope: Deactivated successfully. lb # [ 257.070948] systemd[1]: session-31.scope: Consumed 28ms CPU time over 52ms wall clock time, 4.6M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 257.075871] systemd-logind[499]: Session 31 logged out. Waiting for processes to exit. lb # [ 257.077213] systemd-logind[499]: Removed session 31. worker1 # [ 257.620448] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 257.624535] systemd[1]: Started SSH per-connection Daemon (vsock:2:37). worker1 # [ 257.721721] sshd-session[1793]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 257.730404] sshd-session[1793]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 257.738931] sshd-session[1793]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 257.750721] systemd-logind[539]: New session '43' of user 'root' with class 'user' and type 'tty'. worker1 # [ 257.757390] systemd[1]: Started Session 43 of User root. worker1 # [ 257.792565] sshd-session[1799]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 257.795216] sshd-session[1799]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 257.797512] sshd-session[1793]: pam_unix(sshd:session): session closed for user root worker1 # [ 257.801480] systemd[1]: sshd-vsock@37-38-5:22-2:37.service: Deactivated successfully. worker1 # [ 257.806594] systemd[1]: session-43.scope: Deactivated successfully. worker1 # [ 257.808407] systemd[1]: session-43.scope: Consumed 28ms CPU time over 51ms wall clock time, 3.1M memory peak, 19.5K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 257.813657] systemd-logind[539]: Session 43 logged out. Waiting for processes to exit. worker1 # [ 257.815666] systemd-logind[539]: Removed session 43. lb # [ 261.867225] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 261.876211] systemd[1]: Started SSH per-connection Daemon (vsock:2:25). lb # [ 261.972895] sshd-session[1487]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 261.982592] sshd-session[1487]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 261.991000] sshd-session[1487]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 262.002583] systemd-logind[499]: New session '32' of user 'root' with class 'user' and type 'tty'. lb # [ 262.008526] systemd[1]: Started Session 32 of User root. lb # [ 262.045605] sshd-session[1493]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 262.048344] sshd-session[1493]: Disconnected from user root UNKNOWN port 65535 lb # [ 262.049784] sshd-session[1487]: pam_unix(sshd:session): session closed for user root lb # [ 262.054409] systemd[1]: sshd-vsock@25-26-4:22-2:25.service: Deactivated successfully. lb # [ 262.059424] systemd[1]: session-32.scope: Deactivated successfully. lb # [ 262.062887] systemd[1]: session-32.scope: Consumed 28ms CPU time over 52ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 262.067638] systemd-logind[499]: Session 32 logged out. Waiting for processes to exit. lb # [ 262.069058] systemd-logind[499]: Removed session 32. worker1 # [ 262.269274] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 262.277742] systemd[1]: Started SSH per-connection Daemon (vsock:2:38). worker1 # [ 262.375270] sshd-session[1804]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 262.383657] sshd-session[1804]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 262.394744] sshd-session[1804]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 262.406665] systemd-logind[539]: New session '44' of user 'root' with class 'user' and type 'tty'. worker1 # [ 262.411260] systemd[1]: Started Session 44 of User root. worker1 # [ 262.435195] sshd-session[1810]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 262.438181] sshd-session[1810]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 262.440154] sshd-session[1804]: pam_unix(sshd:session): session closed for user root worker1 # [ 262.443970] systemd[1]: sshd-vsock@38-39-5:22-2:38.service: Deactivated successfully. worker1 # [ 262.449712] systemd[1]: session-44.scope: Deactivated successfully. worker1 # [ 262.454122] systemd-logind[539]: Session 44 logged out. Waiting for processes to exit. worker1 # [ 262.456379] systemd-logind[539]: Removed session 44. client # [ 266.672506] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 266.680400] systemd[1]: Started SSH per-connection Daemon (vsock:2:28). client # [ 266.778736] sshd-session[1411]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 266.789097] sshd-session[1411]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 266.798265] sshd-session[1411]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 266.818386] systemd-logind[427]: New session '35' of user 'root' with class 'user' and type 'tty'. client # [ 266.832229] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 266.871271] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 266.878513] systemd[1]: Starting User Manager for UID 0... client # [ 266.905725] (systemd)[1420]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 266.911972] systemd-logind[427]: New session '36' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 266.998958] systemd[1420]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 267.106527] systemd[1420]: Queued start job for default target Main User Target. client # [ 267.113104] systemd[1420]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 267.117901] systemd[1420]: Created slice User Application Slice. client # [ 267.119041] systemd[1420]: Started Daily Cleanup of User's Temporary Directories. client # [ 267.122452] systemd[1420]: Reached target Paths. client # [ 267.123321] systemd[1420]: Reached target Timers. client # [ 267.126009] systemd[1420]: Starting D-Bus User Message Bus Socket... client # [ 267.127057] systemd[1420]: Starting Create User Files and Directories... client # [ 267.174661] systemd[1420]: Listening on D-Bus User Message Bus Socket. client # [ 267.176442] systemd[1420]: Finished Create User Files and Directories. client # [ 267.178714] systemd[1420]: Reached target Sockets. client # [ 267.179539] systemd[1420]: Reached target Basic System. client # [ 267.183055] systemd[1420]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 267.184814] systemd[1420]: Reached target Main User Target. client # [ 267.185638] systemd[1420]: Startup finished in 251ms. client # [ 267.186341] systemd[1]: Started User Manager for UID 0. client # [ 267.189487] systemd[1]: Started Session 35 of User root. worker1 # [ 267.363979] nix-grpc-daemon[485]: ts=2026-11-12T09:22:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 267.367967] nix-grpc-daemon[485]: ts=2026-11-12T09:22:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 268.676579] garage[898]: 2026-11-12T09:22:50.434697Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo lb # [ 268.683688] garage[898]: 2026-11-12T09:22:50.435139Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 268.691010] garage[898]: 2026-11-12T09:22:50.442473Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo lb # [ 268.696216] garage[898]: 2026-11-12T09:22:50.442882Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 268.699522] garage[898]: 2026-11-12T09:22:50.447258Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo lb # [ 268.704630] garage[898]: 2026-11-12T09:22:50.447662Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 267.406088] nix-grpc-daemon[485]: ts=2026-11-12T09:22:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 268.710906] garage[898]: 2026-11-12T09:22:50.470395Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo lb # [ 268.715995] garage[898]: 2026-11-12T09:22:50.470820Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 268.720953] garage[898]: 2026-11-12T09:22:50.480032Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo lb # [ 268.726039] garage[898]: 2026-11-12T09:22:50.480431Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 265.879404] nix-grpc-daemon[1487]: ts=2026-11-12T09:22:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 268.740138] garage[898]: 2026-11-12T09:22:50.499608Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo lb # [ 268.744884] garage[898]: 2026-11-12T09:22:50.500015Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 268.749685] garage[898]: 2026-11-12T09:22:50.508882Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo lb # [ 268.754130] garage[898]: 2026-11-12T09:22:50.509235Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 265.907590] nix-grpc-daemon[1487]: ts=2026-11-12T09:22:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 268.766084] garage[898]: 2026-11-12T09:22:50.525517Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo lb # [ 268.771585] garage[898]: 2026-11-12T09:22:50.525922Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 268.776577] garage[898]: 2026-11-12T09:22:50.535685Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo lb # [ 268.781645] garage[898]: 2026-11-12T09:22:50.536070Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 267.487241] nix-grpc-daemon[485]: ts=2026-11-12T09:22:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 268.794657] garage[898]: 2026-11-12T09:22:50.553412Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo lb # [ 268.802356] garage[898]: 2026-11-12T09:22:50.553820Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 268.806261] garage[898]: 2026-11-12T09:22:50.553984Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo lb # [ 268.811228] garage[898]: 2026-11-12T09:22:50.554160Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 265.960123] nix-grpc-daemon[1487]: ts=2026-11-12T09:22:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 268.814403] garage[898]: 2026-11-12T09:22:50.559944Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo lb # [ 268.818279] garage[898]: 2026-11-12T09:22:50.560331Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 265.969940] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 265.993101] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 266.137041] nix-daemon[976]: accepted connection from pid 1825, user nix-grpc-daemon (trusted) lb # [ 269.013643] niks3-server[1454]: 2026/11/12 09:22:50 INFO Received push request method=POST path=/api/pushes worker2 # [ 266.164271] nix-daemon[976]: reaped child process 1828, status = succeeded worker2 # [ 266.172573] nix-grpc-daemon[1723]: time=2026-11-12T09:22:51.444Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker2 # [ 266.174372] nix-grpc-daemon[1723]: time=2026-11-12T09:22:51.444Z level=INFO msg="Uploading mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv (544B)" worker2 # [ 266.180596] nix-grpc-daemon[1723]: time=2026-11-12T09:22:51.444Z level=INFO msg="Uploading 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv (656B)" worker2 # [ 266.182466] nix-grpc-daemon[1723]: time=2026-11-12T09:22:51.444Z level=INFO msg="Uploading 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv (784B)" lb # [ 269.031088] garage[898]: 2026-11-12T09:22:50.790214Z INFO garage_api_common::generic_server: 192.168.1.4:54238 PUT /farm/nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092250Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6b79b4df13a11d10bad8e2e18936a44069922559a2485504435bd918295ea6a5 lb # [ 269.060495] garage[898]: 2026-11-12T09:22:50.790860Z INFO garage_api_common::generic_server: 192.168.1.4:54250 PUT /farm/nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092250Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8e8c0fcdd6c2d1bb32c2820501b4e175023216ec72f566c12e413579a57c5db3 worker2 # [ 266.242938] nix-grpc-daemon[1723]: time=2026-11-12T09:22:51.514Z level=INFO msg="Uploading 3 narinfos" lb # [ 269.105808] garage[898]: 2026-11-12T09:22:50.805354Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst lb # [ 269.126182] garage[898]: 2026-11-12T09:22:50.811317Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/6j7gr603xfslr5lxcbh72430f5q1r4b0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092250Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8d7c9b83206e08fa2f7a464ff19223769f8ce79afb9814280207ab7905e188c4 lb # [ 269.137265] garage[898]: 2026-11-12T09:22:50.818173Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092250Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=19b2a090f1f7aab8e42ab6fa9a7c9ec738210a93a6d5deb6ba3e1e7bd20871c1 lb # [ 269.145588] garage[898]: 2026-11-12T09:22:50.818672Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092250Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=36726c1966987afe008b932bd12428df409c37132793b29faa210d030a964fbf worker2 # [ 266.299125] nix-grpc-daemon[1723]: time=2026-11-12T09:22:51.572Z level=INFO msg="Upload complete. (296ms)" lb # [ 269.153878] garage[898]: 2026-11-12T09:22:50.819087Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092250Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7b49d433ef260e8e5b24ea6df407f6462cd76797378499c684736316fc015d07 lb # [ 269.161521] niks3-server[1454]: 2026/11/12 09:22:50 INFO Registered completed upload object_key=nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst worker2 # [ 266.308237] nix-grpc-daemon[1487]: ts=2026-11-12T09:22:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 paths=3 nar_bytes_in=1984 lb # [ 269.164440] niks3-server[1454]: 2026/11/12 09:22:50 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign lb # [ 269.166420] niks3-server[1454]: 2026/11/12 09:22:50 INFO Signed narinfos id=27 count=3 lb # [ 269.167821] niks3-server[1454]: 2026/11/12 09:22:50 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.ls lb # [ 269.170704] niks3-server[1454]: 2026/11/12 09:22:50 INFO Registered completed upload object_key=nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst worker2 # [ 266.318929] nix-daemon[976]: reaped child process 1821, status = succeeded lb # [ 269.175680] niks3-server[1454]: 2026/11/12 09:22:50 INFO Registered completed upload object_key=nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst worker1 # [ 267.876885] nix-grpc-daemon[485]: ts=2026-11-12T09:22:51Z level=debug event=want client=12 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv cached=0 lb # [ 269.178503] niks3-server[1454]: 2026/11/12 09:22:50 INFO Received complete push request method=POST path=/api/pushes/27/complete lb # [ 269.180990] niks3-server[1454]: 2026/11/12 09:22:50 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.ls lb # [ 269.182655] niks3-server[1454]: 2026/11/12 09:22:50 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo worker1 # [ 267.880900] nix-grpc-daemon[485]: ts=2026-11-12T09:22:51Z level=debug event=assigned drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker=192.168.1.3:50051 clients=1 lb # [ 269.184528] niks3-server[1454]: 2026/11/12 09:22:50 INFO Completed push id=27 objects=9 duration=41.8999ms lb # [ 269.185934] niks3-server[1454]: 2026/11/12 09:22:50 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo lb # [ 269.187566] niks3-server[1454]: 2026/11/12 09:22:50 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.ls worker1 # [ 267.887638] nix-grpc-daemon[485]: ts=2026-11-12T09:22:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 269.189279] niks3-server[1454]: 2026/11/12 09:22:50 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo lb # [ 269.190960] garage[898]: 2026-11-12T09:22:50.834903Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.ls lb # [ 269.193640] garage[898]: 2026-11-12T09:22:50.837272Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.ls worker1 # [ 267.895148] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 269.196495] garage[898]: 2026-11-12T09:22:50.839842Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst lb # [ 269.199495] garage[898]: 2026-11-12T09:22:50.856885Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092250Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fa48349a05e08feea2dd06be3bd5abafbaad6e95f6bfc8d849fb5f6a1246137a lb # [ 269.205393] garage[898]: 2026-11-12T09:22:50.857428Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst worker1 # [ 267.912144] nix-grpc-daemon[485]: copying path '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' from 'http://lb:5751'... lb # [ 269.210245] garage[898]: 2026-11-12T09:22:50.857722Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092250Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fcb3cf8a18f2f4c4d32c622c411f2cff27b22e915929bde5cdc129c8c0de3afb lb # [ 269.216428] garage[898]: 2026-11-12T09:22:50.861017Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092250Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7c43d382cd99ea191ca70ff5afbc4b360047a511f34a388baa92bbdf195b1388 lb # [ 269.223733] garage[898]: 2026-11-12T09:22:50.878564Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo lb # [ 269.227267] garage[898]: 2026-11-12T09:22:50.880852Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/6j7gr603xfslr5lxcbh72430f5q1r4b0.ls worker1 # [ 267.929878] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 269.230254] garage[898]: 2026-11-12T09:22:50.881919Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo lb # [ 269.233125] garage[898]: 2026-11-12T09:22:50.884359Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo lb # [ 269.235770] garage[898]: 2026-11-12T09:22:50.968961Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo lb # [ 269.238546] garage[898]: 2026-11-12T09:22:50.969671Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo lb # [ 269.241358] garage[898]: 2026-11-12T09:22:50.982306Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst lb # [ 269.244949] garage[898]: 2026-11-12T09:22:50.982954Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst worker1 # [ 267.946162] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 270.074565] garage[898]: 2026-11-12T09:22:51.833052Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo lb # [ 270.079192] garage[898]: 2026-11-12T09:22:51.833492Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 269.213118] nix-daemon[1059]: reaped child process 1825, status = succeeded worker1 # [ 269.320735] nix-daemon[1059]: accepted connection from pid 1841, user nix-grpc-daemon (trusted) worker1 # [ 269.347544] nix-daemon[1059]: reaped child process 1844, status = succeeded lb # [ 270.654398] niks3-server[1454]: 2026/11/12 09:22:52 INFO Received push request method=POST path=/api/pushes worker1 # [ 269.364504] nix-grpc-daemon[1104]: time=2026-11-12T09:22:53.156Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 269.366178] nix-grpc-daemon[1104]: time=2026-11-12T09:22:53.156Z level=INFO msg="Uploading j3iswx3ynilvcycpyw0z667966c9kpzx-farm-a (144B)" lb # [ 270.671966] garage[898]: 2026-11-12T09:22:52.431303Z INFO garage_api_common::generic_server: 192.168.1.3:39524 PUT /farm/j3iswx3ynilvcycpyw0z667966c9kpzx.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092252Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9d56cecf27fb93ed25ac68bae111ca9c51d040c159b93b622b02aa7b6b9c5733 lb # [ 270.695613] garage[898]: 2026-11-12T09:22:52.440613Z INFO garage_api_common::generic_server: 192.168.1.3:39520 PUT /farm/nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092252Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b5b3a180fcc93986946ac5372075095ff1b4c89dc94de3d0800285bc598f4921 worker1 # [ 269.406596] nix-grpc-daemon[1104]: time=2026-11-12T09:22:53.199Z level=INFO msg="Uploading 1 narinfos" lb # [ 270.708424] garage[898]: 2026-11-12T09:22:52.441025Z INFO garage_api_common::generic_server: 192.168.1.3:39522 PUT /farm/log/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092252Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8f2ead59cfbdb5a8b7d9ff8dd79d9a032f7f4e147b65ecd4e61eaa8d66e91e7c worker1 # [ 269.423850] nix-grpc-daemon[1104]: time=2026-11-12T09:22:53.217Z level=INFO msg="Upload complete. (262ms)" lb # [ 270.724290] garage[898]: 2026-11-12T09:22:52.446040Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 270.730097] garage[898]: 2026-11-12T09:22:52.446761Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/j3iswx3ynilvcycpyw0z667966c9kpzx.ls worker1 # [ 269.432828] nix-grpc-daemon[485]: ts=2026-11-12T09:22:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv assign_id=16 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 270.734946] garage[898]: 2026-11-12T09:22:52.452188Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/log/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv lb # [ 270.739827] niks3-server[1454]: 2026/11/12 09:22:52 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign lb # [ 270.742846] niks3-server[1454]: 2026/11/12 09:22:52 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.ls lb # [ 270.746656] niks3-server[1454]: 2026/11/12 09:22:52 INFO Signed narinfos id=28 count=1 worker1 # [ 269.450357] nix-daemon[1059]: reaped child process 1823, status = succeeded lb # [ 270.750702] niks3-server[1454]: 2026/11/12 09:22:52 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst worker1 # [ 269.453387] nix-grpc-daemon[485]: ts=2026-11-12T09:22:53Z level=debug event=want client=12 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv cached=0 lb # [ 270.754468] niks3-server[1454]: 2026/11/12 09:22:52 INFO Registered completed upload object_key=log/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker1 # [ 269.457069] nix-grpc-daemon[485]: ts=2026-11-12T09:22:53Z level=debug event=assigned drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv worker=192.168.1.3:50051 clients=1 lb # [ 270.758279] niks3-server[1454]: 2026/11/12 09:22:52 INFO Received complete push request method=POST path=/api/pushes/28/complete lb # [ 270.760804] niks3-server[1454]: 2026/11/12 09:22:52 INFO Completed push id=28 objects=4 duration=4.07866ms worker1 # [ 269.462383] nix-grpc-daemon[485]: ts=2026-11-12T09:22:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 270.765249] niks3-server[1454]: 2026/11/12 09:22:52 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo worker1 # [ 269.467133] nix-grpc-daemon[485]: copying path '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' from 'http://lb:5751'... lb # [ 270.768128] garage[898]: 2026-11-12T09:22:52.466398Z INFO garage_api_common::generic_server: 192.168.1.3:39522 PUT /farm/j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092252Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7da3a3df54771d2971d6c3926db1f8affa75c186ae707e217ff701b2b6b61a43 lb # [ 270.777677] garage[898]: 2026-11-12T09:22:52.482244Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo lb # [ 270.781249] garage[898]: 2026-11-12T09:22:52.523383Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo worker1 # [ 269.485632] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 270.784686] garage[898]: 2026-11-12T09:22:52.524461Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) GET /farm/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo lb # [ 270.788212] garage[898]: 2026-11-12T09:22:52.536335Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst lb # [ 270.791581] garage[898]: 2026-11-12T09:22:52.537098Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) GET /farm/nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst worker1 # [ 269.504288] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 271.428932] garage[898]: 2026-11-12T09:22:53.187387Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo lb # [ 271.429116] garage[898]: 2026-11-12T09:22:53.187947Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 270.546849] nix-daemon[1059]: reaped child process 1852, status = succeeded worker1 # [ 270.676433] nix-daemon[1059]: accepted connection from pid 1868, user nix-grpc-daemon (trusted) lb # [ 271.999784] niks3-server[1454]: 2026/11/12 09:22:53 INFO Received push request method=POST path=/api/pushes worker1 # [ 270.702376] nix-daemon[1059]: reaped child process 1871, status = succeeded worker1 # [ 270.708736] nix-grpc-daemon[1104]: time=2026-11-12T09:22:54.502Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 270.713179] nix-grpc-daemon[1104]: time=2026-11-12T09:22:54.504Z level=INFO msg="Uploading myar0ljvsqm9h7fxyh6qrqkg0175r3xn-farm-b (192B)" worker1 # [ 270.735893] nix-grpc-daemon[1104]: time=2026-11-12T09:22:54.529Z level=INFO msg="Uploading 1 narinfos" lb # [ 272.012637] garage[898]: 2026-11-12T09:22:53.772072Z INFO garage_api_common::generic_server: 192.168.1.3:39522 PUT /farm/log/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092253Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1ecdbf172270e437bcac08291ee70e16c5dc0aeb0d6ece6565f52d58cfb4e711 lb # [ 272.040242] garage[898]: 2026-11-12T09:22:53.782613Z INFO garage_api_common::generic_server: 192.168.1.3:39524 PUT /farm/myar0ljvsqm9h7fxyh6qrqkg0175r3xn.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092253Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=be841b5a53986b84bfeb8bf526acd9ce2c01f5e9496f18610455090ac37ab181 worker1 # [ 270.757629] nix-grpc-daemon[1104]: time=2026-11-12T09:22:54.551Z level=INFO msg="Upload complete. (231ms)" lb # [ 272.057171] garage[898]: 2026-11-12T09:22:53.783035Z INFO garage_api_common::generic_server: 192.168.1.3:39520 PUT /farm/nar/0zvv5rxmyk9afay83j52m7ipyhrqivhg6h6a0ksjd658pxzwi78w.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092253Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ef711810600fa3be85a0fd0acda0e882c82ae05860325ca59d742c7c1eee319e worker1 # [ 270.764765] nix-grpc-daemon[485]: ts=2026-11-12T09:22:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv assign_id=17 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 272.067553] garage[898]: 2026-11-12T09:22:53.786386Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/myar0ljvsqm9h7fxyh6qrqkg0175r3xn.ls lb # [ 272.072905] garage[898]: 2026-11-12T09:22:53.788228Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/log/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv worker1 # [ 270.779903] nix-daemon[1059]: reaped child process 1850, status = succeeded lb # [ 272.077591] garage[898]: 2026-11-12T09:22:53.791998Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/0zvv5rxmyk9afay83j52m7ipyhrqivhg6h6a0ksjd658pxzwi78w.nar.zst worker1 # [ 270.786055] nix-grpc-daemon[485]: ts=2026-11-12T09:22:54Z level=debug event=want client=12 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv cached=0 worker1 # [ 270.789755] nix-grpc-daemon[485]: ts=2026-11-12T09:22:54Z level=debug event=assigned drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker=192.168.1.3:50051 clients=1 lb # [ 272.085488] garage[898]: 2026-11-12T09:22:53.795937Z INFO garage_api_common::generic_server: 192.168.1.3:39520 PUT /farm/myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092253Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83be56a54c130b11508ecc55f32b16f052de69d9d7445e7b6e5b603aabf54408 lb # [ 272.094868] niks3-server[1454]: 2026/11/12 09:22:53 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign lb # [ 272.098156] niks3-server[1454]: 2026/11/12 09:22:53 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.ls worker1 # [ 270.799246] nix-grpc-daemon[485]: ts=2026-11-12T09:22:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 272.101082] niks3-server[1454]: 2026/11/12 09:22:53 INFO Signed narinfos id=29 count=1 lb # [ 272.102795] niks3-server[1454]: 2026/11/12 09:22:53 INFO Registered completed upload object_key=log/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv lb # [ 272.107815] niks3-server[1454]: 2026/11/12 09:22:53 INFO Registered completed upload object_key=nar/0zvv5rxmyk9afay83j52m7ipyhrqivhg6h6a0ksjd658pxzwi78w.nar.zst worker1 # [ 270.809588] nix-grpc-daemon[485]: copying path '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' from 'http://lb:5751'... lb # [ 272.110826] niks3-server[1454]: 2026/11/12 09:22:53 INFO Received complete push request method=POST path=/api/pushes/29/complete lb # [ 272.113002] niks3-server[1454]: 2026/11/12 09:22:53 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo lb # [ 272.117364] niks3-server[1454]: 2026/11/12 09:22:53 INFO Completed push id=29 objects=8 duration=17.10238ms lb # [ 272.119216] garage[898]: 2026-11-12T09:22:53.799154Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo worker1 # [ 270.823691] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 272.122958] garage[898]: 2026-11-12T09:22:53.866159Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo lb # [ 272.126471] garage[898]: 2026-11-12T09:22:53.866964Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo lb # [ 272.129840] garage[898]: 2026-11-12T09:22:53.875982Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst lb # [ 272.133467] garage[898]: 2026-11-12T09:22:53.876682Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst worker1 # [ 270.838394] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 272.305657] systemd[1]: Stopping User Manager for UID 0... lb # [ 272.312873] systemd[1412]: Activating special unit Exit the Session... lb # [ 272.318952] systemd[1412]: Stopped target Main User Target. lb # [ 272.323111] systemd[1412]: Stopped target Basic System. lb # [ 272.325668] systemd[1412]: Stopped target Paths. lb # [ 272.326795] systemd[1412]: Stopped target Sockets. lb # [ 272.328080] systemd[1412]: Stopped target Timers. lb # [ 272.329170] systemd[1412]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 272.330807] systemd[1412]: Closed D-Bus User Message Bus Socket. lb # [ 272.333114] systemd[1412]: Stopped Create User Files and Directories. lb # [ 272.334573] systemd[1412]: Removed slice User Application Slice. lb # [ 272.336170] systemd[1412]: Reached target Shutdown. lb # [ 272.337311] systemd[1412]: Finished Exit the Session. lb # [ 272.338579] systemd[1412]: Reached target Exit the Session. lb # [ 272.361623] systemd-logind[499]: Removed session 27. lb # [ 272.369251] systemd[1]: user@0.service: Deactivated successfully. lb # [ 272.373743] systemd[1]: Stopped User Manager for UID 0. lb # [ 272.443825] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 272.485247] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 272.489432] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 272.494466] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 272.776722] garage[898]: 2026-11-12T09:22:54.535869Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo lb # [ 272.782397] garage[898]: 2026-11-12T09:22:54.541555Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 271.904824] nix-daemon[1059]: reaped child process 1879, status = succeeded worker1 # [ 272.015034] nix-daemon[1059]: accepted connection from pid 1895, user nix-grpc-daemon (trusted) worker1 # [ 272.039053] nix-daemon[1059]: reaped child process 1898, status = succeeded lb # [ 273.343611] niks3-server[1454]: 2026/11/12 09:22:55 INFO Received push request method=POST path=/api/pushes worker1 # [ 272.055089] nix-grpc-daemon[1104]: time=2026-11-12T09:22:55.847Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 272.057060] nix-grpc-daemon[1104]: time=2026-11-12T09:22:55.847Z level=INFO msg="Uploading z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc-farm-top (248B)" lb # [ 273.355055] garage[898]: 2026-11-12T09:22:55.114501Z INFO garage_api_common::generic_server: 192.168.1.3:39520 PUT /farm/log/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092255Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e6e2cf3303832ab6862689579a6a517771f159c9755214c5375b433c521e8426 worker1 # [ 272.075136] nix-grpc-daemon[1104]: time=2026-11-12T09:22:55.868Z level=INFO msg="Uploading 1 narinfos" lb # [ 273.376934] garage[898]: 2026-11-12T09:22:55.125157Z INFO garage_api_common::generic_server: 192.168.1.3:39522 PUT /farm/z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092255Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=68d72581c60590595457d772768a0717a6582f8408fc54be3a8fbd0b06baab6e worker1 # [ 272.096943] nix-grpc-daemon[1104]: time=2026-11-12T09:22:55.890Z level=INFO msg="Upload complete. (245ms)" lb # [ 273.396502] garage[898]: 2026-11-12T09:22:55.125613Z INFO garage_api_common::generic_server: 192.168.1.3:39524 PUT /farm/nar/0cypkbh15calmx90jgh2waxpq661jalf4c99dgb7j606z61xh0ld.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092255Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=33334a228d0b8398099f088ae0a8c79fad3aae91fd250a5e1154d6d6dbe5878d worker1 # [ 272.104777] nix-grpc-daemon[485]: ts=2026-11-12T09:22:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv assign_id=18 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 273.406846] garage[898]: 2026-11-12T09:22:55.128520Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/0cypkbh15calmx90jgh2waxpq661jalf4c99dgb7j606z61xh0ld.nar.zst lb # [ 273.412428] garage[898]: 2026-11-12T09:22:55.129720Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/log/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv lb # [ 273.416839] garage[898]: 2026-11-12T09:22:55.132421Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.ls worker1 # [ 272.120796] nix-daemon[1059]: reaped child process 1877, status = succeeded lb # [ 273.421265] garage[898]: 2026-11-12T09:22:55.135021Z INFO garage_api_common::generic_server: 192.168.1.3:39524 PUT /farm/z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092255Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7f4ecbdb422918cb8fc70463ec907312d5fe1f4486f10117a71eedcb3ea2e968 lb # [ 273.429949] niks3-server[1454]: 2026/11/12 09:22:55 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign lb # [ 273.432938] niks3-server[1454]: 2026/11/12 09:22:55 INFO Signed narinfos id=30 count=1 lb # [ 273.434423] niks3-server[1454]: 2026/11/12 09:22:55 INFO Registered completed upload object_key=nar/0cypkbh15calmx90jgh2waxpq661jalf4c99dgb7j606z61xh0ld.nar.zst lb # [ 273.437261] niks3-server[1454]: 2026/11/12 09:22:55 INFO Received complete push request method=POST path=/api/pushes/30/complete lb # [ 273.439080] niks3-server[1454]: 2026/11/12 09:22:55 INFO Registered completed upload object_key=log/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv lb # [ 273.441439] niks3-server[1454]: 2026/11/12 09:22:55 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo lb # [ 273.443332] niks3-server[1454]: 2026/11/12 09:22:55 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.ls lb # [ 273.445280] niks3-server[1454]: 2026/11/12 09:22:55 INFO Completed push id=30 objects=12 duration=8.78642ms lb # [ 273.446864] garage[898]: 2026-11-12T09:22:55.153814Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo client # [ 272.155341] sshd-session[1433]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 272.155824] sshd-session[1433]: Disconnected from user root UNKNOWN port 65535 client # [ 272.161241] sshd-session[1411]: pam_unix(sshd:session): session closed for user root client # [ 272.169023] systemd[1]: sshd-vsock@28-29-3:22-2:28.service: Deactivated successfully. client # [ 272.175953] systemd[1]: session-35.scope: Deactivated successfully. client # [ 272.180194] systemd[1]: session-35.scope: Consumed 201ms CPU time over 4.990s wall clock time, 38.2M memory peak, 12.5K incoming IP traffic, 14K outgoing IP traffic. client # [ 272.188934] systemd-logind[427]: Session 35 logged out. Waiting for processes to exit. client # [ 272.192449] systemd-logind[427]: Removed session 35. worker1 # [ 272.539528] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 272.549595] systemd[1648]: Activating special unit Exit the Session... worker1 # [ 272.557336] systemd[1648]: Stopped target Main User Target. worker1 # [ 272.558741] systemd[1648]: Stopped target Basic System. worker1 # [ 272.559938] systemd[1648]: Stopped target Paths. worker1 # [ 272.561620] systemd[1648]: Stopped target Sockets. worker1 # [ 272.562702] systemd[1648]: Stopped target Timers. worker1 # [ 272.565589] systemd[1648]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 272.567253] systemd[1648]: Closed D-Bus User Message Bus Socket. worker1 # [ 272.569700] systemd[1648]: Stopped Create User Files and Directories. worker1 # [ 272.571159] systemd[1648]: Removed slice User Application Slice. worker1 # [ 272.572731] systemd[1648]: Reached target Shutdown. worker1 # [ 272.573878] systemd[1648]: Finished Exit the Session. worker1 # [ 272.575160] systemd[1648]: Reached target Exit the Session. worker1 # [ 272.594418] systemd-logind[539]: Removed session 31. worker1 # [ 272.602566] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 272.605679] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 272.622572] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 272.662763] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 272.668260] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 272.672272] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 274.482584] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 274.490618] systemd[1]: Started SSH per-connection Daemon (vsock:2:29). client # [ 274.574346] sshd-session[1452]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 274.582025] sshd-session[1452]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 274.589038] sshd-session[1452]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 274.597069] systemd-logind[427]: New session '37' of user 'root' with class 'user' and type 'tty'. client # [ 274.608558] systemd[1]: Started Session 37 of User root. client # [ 274.761554] sshd-session[1458]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 274.763310] sshd-session[1458]: Disconnected from user root UNKNOWN port 65535 client # [ 274.765732] sshd-session[1452]: pam_unix(sshd:session): session closed for user root client # [ 274.770052] systemd[1]: sshd-vsock@29-30-3:22-2:29.service: Deactivated successfully. client # [ 274.775430] systemd[1]: session-37.scope: Deactivated successfully. client # [ 274.779891] systemd-logind[427]: Session 37 logged out. Waiting for processes to exit. client # [ 274.782648] systemd-logind[427]: Removed session 37. ok test farm::serial::a_recovery_that_throws_fails_only_its_job ... lb # [ 276.327778] envoy[897]: conn peer=[2001:db8:1::1]:55990 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=6492 tx=4022 ms=4783 worker1 # [ 276.665938] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 276.675378] systemd[1]: Started SSH per-connection Daemon (vsock:2:39). worker1 # [ 276.774995] sshd-session[1904]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 276.785002] sshd-session[1904]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 276.796602] sshd-session[1904]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 276.815088] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 276.828416] systemd-logind[539]: New session '45' of user 'root' with class 'user' and type 'tty'. worker1 # [ 276.852950] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 276.861296] systemd[1]: Starting User Manager for UID 0... worker1 # [ 276.889960] (systemd)[1912]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 276.896007] systemd-logind[539]: New session '46' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 276.985178] systemd[1912]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 277.084324] systemd[1912]: Queued start job for default target Main User Target. worker1 # [ 277.090105] systemd[1912]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 277.091903] systemd[1912]: Created slice User Application Slice. worker1 # [ 277.096269] systemd[1912]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 277.097401] systemd[1912]: Reached target Paths. worker1 # [ 277.098089] systemd[1912]: Reached target Timers. worker1 # [ 277.098782] systemd[1912]: Starting D-Bus User Message Bus Socket... worker1 # [ 277.104196] systemd[1912]: Starting Create User Files and Directories... worker1 # [ 277.147508] systemd[1912]: Finished Create User Files and Directories. worker1 # [ 277.152146] systemd[1912]: Listening on D-Bus User Message Bus Socket. worker1 # [ 277.154620] systemd[1912]: Reached target Sockets. worker1 # [ 277.155408] systemd[1912]: Reached target Basic System. worker1 # [ 277.159084] systemd[1912]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 277.160770] systemd[1912]: Reached target Main User Target. worker1 # [ 277.161589] systemd[1912]: Startup finished in 241ms. worker1 # [ 277.162353] systemd[1]: Started User Manager for UID 0. worker1 # [ 277.165483] systemd[1]: Started Session 45 of User root. worker1 # [ 277.195120] sshd-session[1925]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 277.197778] sshd-session[1925]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 277.199206] sshd-session[1904]: pam_unix(sshd:session): session closed for user root worker1 # [ 277.203459] systemd[1]: sshd-vsock@39-40-5:22-2:39.service: Deactivated successfully. worker1 # [ 277.209217] systemd[1]: session-45.scope: Deactivated successfully. worker1 # [ 277.213575] systemd-logind[539]: Session 45 logged out. Waiting for processes to exit. worker1 # [ 277.215628] systemd-logind[539]: Removed session 45. [e2e] heartbeat t=180s worker2 # [ 282.081450] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 282.089237] systemd[1]: Started SSH per-connection Daemon (vsock:2:28). worker2 # [ 282.188553] sshd-session[1830]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 282.198174] sshd-session[1830]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 282.207451] sshd-session[1830]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 282.224438] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 282.237498] systemd-logind[515]: New session '35' of user 'root' with class 'user' and type 'tty'. worker2 # [ 282.264195] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 282.272435] systemd[1]: Starting User Manager for UID 0... worker2 # [ 282.298134] (systemd)[1838]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 282.303845] systemd-logind[515]: New session '36' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 282.396052] systemd[1838]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 282.495504] systemd[1838]: Queued start job for default target Main User Target. worker2 # [ 282.505074] systemd[1838]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 282.509506] systemd[1838]: Created slice User Application Slice. worker2 # [ 282.510574] systemd[1838]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 282.511656] systemd[1838]: Reached target Paths. worker2 # [ 282.514689] systemd[1838]: Reached target Timers. worker2 # [ 282.515479] systemd[1838]: Starting D-Bus User Message Bus Socket... worker2 # [ 282.520409] systemd[1838]: Starting Create User Files and Directories... worker2 # [ 282.567510] systemd[1838]: Finished Create User Files and Directories. worker2 # [ 282.569511] systemd[1838]: Listening on D-Bus User Message Bus Socket. worker2 # [ 282.573754] systemd[1838]: Reached target Sockets. worker2 # [ 282.574596] systemd[1838]: Reached target Basic System. worker2 # [ 282.575370] systemd[1]: Started User Manager for UID 0. worker2 # [ 282.580278] systemd[1838]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 282.581864] systemd[1838]: Reached target Main User Target. worker2 # [ 282.582709] systemd[1838]: Startup finished in 251ms. worker2 # [ 282.583460] systemd[1]: Started Session 35 of User root. worker2 # [ 282.613150] sshd-session[1851]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 282.614650] sshd-session[1851]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 282.616487] sshd-session[1830]: pam_unix(sshd:session): session closed for user root worker2 # [ 282.620504] systemd[1]: sshd-vsock@28-29-6:22-2:28.service: Deactivated successfully. worker2 # [ 282.625955] systemd[1]: session-35.scope: Deactivated successfully. worker2 # [ 282.630407] systemd-logind[515]: Session 35 logged out. Waiting for processes to exit. worker2 # [ 282.633230] systemd-logind[515]: Removed session 35. client # [ 284.895076] systemd[1]: Stopping User Manager for UID 0... client # [ 284.901502] systemd[1420]: Activating special unit Exit the Session... client # [ 284.907310] systemd[1420]: Stopped target Main User Target. client # [ 284.910948] systemd[1420]: Stopped target Basic System. client # [ 284.912450] systemd[1420]: Stopped target Paths. client # [ 284.913559] systemd[1420]: Stopped target Sockets. client # [ 284.914680] systemd[1420]: Stopped target Timers. client # [ 284.915797] systemd[1420]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 284.917911] systemd[1420]: Closed D-Bus User Message Bus Socket. client # [ 284.919233] systemd[1420]: Stopped Create User Files and Directories. client # [ 284.921516] systemd[1420]: Removed slice User Application Slice. client # [ 284.922893] systemd[1420]: Reached target Shutdown. client # [ 284.924706] systemd[1420]: Finished Exit the Session. client # [ 284.925897] systemd[1420]: Reached target Exit the Session. client # [ 284.950165] systemd-logind[427]: Removed session 36. client # [ 284.957348] systemd[1]: user@0.service: Deactivated successfully. client # [ 284.960246] systemd[1]: Stopped User Manager for UID 0. client # [ 285.021781] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 285.055831] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 285.061276] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 285.065633] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 287.597681] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 287.605844] systemd[1]: Started SSH per-connection Daemon (vsock:2:26). lb # [ 287.709213] sshd-session[1511]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 287.718724] sshd-session[1511]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 287.727524] sshd-session[1511]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 287.752251] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 287.787061] systemd-logind[499]: New session '33' of user 'root' with class 'user' and type 'tty'. lb # [ 287.798618] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 287.803739] systemd[1]: Starting User Manager for UID 0... lb # [ 287.829184] (systemd)[1520]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 287.834681] systemd-logind[499]: New session '34' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 287.926099] systemd[1520]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 288.024365] systemd[1520]: Queued start job for default target Main User Target. lb # [ 288.029000] systemd[1520]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 288.031938] systemd[1520]: Created slice User Application Slice. lb # [ 288.033112] systemd[1520]: Started Daily Cleanup of User's Temporary Directories. lb # [ 288.034574] systemd[1520]: Reached target Paths. lb # [ 288.035650] systemd[1520]: Reached target Timers. lb # [ 288.038553] systemd[1520]: Starting D-Bus User Message Bus Socket... lb # [ 288.041579] systemd[1520]: Starting Create User Files and Directories... lb # [ 288.085834] systemd[1520]: Finished Create User Files and Directories. lb # [ 288.091522] systemd[1520]: Listening on D-Bus User Message Bus Socket. lb # [ 288.094333] systemd[1520]: Reached target Sockets. lb # [ 288.095147] systemd[1520]: Reached target Basic System. lb # [ 288.095967] systemd[1520]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 288.101422] systemd[1520]: Reached target Main User Target. lb # [ 288.102376] systemd[1520]: Startup finished in 238ms. lb # [ 288.103131] systemd[1]: Started User Manager for UID 0. lb # [ 288.105030] systemd[1]: Started Session 33 of User root. lb # [ 288.146345] sshd-session[1533]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 288.149101] sshd-session[1533]: Disconnected from user root UNKNOWN port 65535 lb # [ 288.151080] sshd-session[1511]: pam_unix(sshd:session): session closed for user root lb # [ 288.154979] systemd[1]: sshd-vsock@26-27-4:22-2:26.service: Deactivated successfully. lb # [ 288.161045] systemd[1]: session-33.scope: Deactivated successfully. lb # [ 288.164368] systemd[1]: session-33.scope: Consumed 28ms CPU time over 64ms wall clock time, 6.5M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 288.170007] systemd-logind[499]: Session 33 logged out. Waiting for processes to exit. lb # [ 288.171455] systemd-logind[499]: Removed session 33. worker1 # [ 287.289753] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 287.296799] systemd[1912]: Activating special unit Exit the Session... worker1 # [ 287.301524] systemd[1912]: Stopped target Main User Target. worker1 # [ 287.302979] systemd[1912]: Stopped target Basic System. worker1 # [ 287.309172] systemd[1912]: Stopped target Paths. worker1 # [ 287.310383] systemd[1912]: Stopped target Sockets. worker1 # [ 287.311536] systemd[1912]: Stopped target Timers. worker1 # [ 287.312952] systemd[1912]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 287.314620] systemd[1912]: Closed D-Bus User Message Bus Socket. worker1 # [ 287.315978] systemd[1912]: Stopped Create User Files and Directories. worker1 # [ 287.317540] systemd[1912]: Removed slice User Application Slice. worker1 # [ 287.318906] systemd[1912]: Reached target Shutdown. worker1 # [ 287.320590] systemd[1912]: Finished Exit the Session. worker1 # [ 287.322648] systemd[1912]: Reached target Exit the Session. worker1 # [ 287.345841] systemd-logind[539]: Removed session 46. worker1 # [ 287.353695] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 287.356711] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 287.374572] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 287.416545] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 287.422844] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 287.428111] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 288.801204] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 288.810047] systemd[1]: Started SSH per-connection Daemon (vsock:2:40). worker1 # [ 288.910098] sshd-session[1935]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 288.918600] sshd-session[1935]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 288.929923] sshd-session[1935]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 288.946416] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 288.961245] systemd-logind[539]: New session '47' of user 'root' with class 'user' and type 'tty'. worker1 # [ 288.985699] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 288.994010] systemd[1]: Starting User Manager for UID 0... worker1 # [ 289.022491] (systemd)[1943]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 289.028549] systemd-logind[539]: New session '48' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 289.118053] systemd[1943]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 289.218897] systemd[1943]: Queued start job for default target Main User Target. worker1 # [ 289.229027] systemd[1943]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 289.233393] systemd[1943]: Created slice User Application Slice. worker1 # [ 289.234431] systemd[1943]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 289.235541] systemd[1943]: Reached target Paths. worker1 # [ 289.236613] systemd[1943]: Reached target Timers. worker1 # [ 289.239153] systemd[1943]: Starting D-Bus User Message Bus Socket... worker1 # [ 289.241140] systemd[1943]: Starting Create User Files and Directories... worker1 # [ 289.283960] systemd[1943]: Finished Create User Files and Directories. worker1 # [ 289.288873] systemd[1943]: Listening on D-Bus User Message Bus Socket. worker1 # [ 289.289963] systemd[1943]: Reached target Sockets. worker1 # [ 289.290712] systemd[1943]: Reached target Basic System. worker1 # [ 289.291504] systemd[1943]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 289.296855] systemd[1943]: Reached target Main User Target. worker1 # [ 289.297806] systemd[1943]: Startup finished in 244ms. worker1 # [ 289.298541] systemd[1]: Started User Manager for UID 0. worker1 # [ 289.303387] systemd[1]: Started Session 47 of User root. worker1 # [ 289.333330] sshd-session[1956]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 289.336073] sshd-session[1956]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 289.337396] sshd-session[1935]: pam_unix(sshd:session): session closed for user root worker1 # [ 289.341779] systemd[1]: sshd-vsock@40-41-5:22-2:40.service: Deactivated successfully. worker1 # [ 289.346743] systemd[1]: session-47.scope: Deactivated successfully. worker1 # [ 289.348580] systemd[1]: session-47.scope: Consumed 25ms CPU time over 47ms wall clock time, 3.1M memory peak, 19.5K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 289.353868] systemd-logind[539]: Session 47 logged out. Waiting for processes to exit. worker1 # [ 289.356331] systemd-logind[539]: Removed session 47. worker2 # [ 292.835186] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 292.840903] systemd[1838]: Activating special unit Exit the Session... worker2 # [ 292.846284] systemd[1838]: Stopped target Main User Target. worker2 # [ 292.847812] systemd[1838]: Stopped target Basic System. worker2 # [ 292.853247] systemd[1838]: Stopped target Paths. worker2 # [ 292.854560] systemd[1838]: Stopped target Sockets. worker2 # [ 292.855704] systemd[1838]: Stopped target Timers. worker2 # [ 292.856964] systemd[1838]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 292.858652] systemd[1838]: Closed D-Bus User Message Bus Socket. worker2 # [ 292.859994] systemd[1838]: Stopped Create User Files and Directories. worker2 # [ 292.861552] systemd[1838]: Removed slice User Application Slice. worker2 # [ 292.862898] systemd[1838]: Reached target Shutdown. worker2 # [ 292.865387] systemd[1838]: Finished Exit the Session. worker2 # [ 292.866820] systemd[1838]: Reached target Exit the Session. worker2 # [ 292.890221] systemd-logind[515]: Removed session 36. worker2 # [ 292.899159] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 292.902788] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 292.918640] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 292.958761] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 292.961983] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 292.966681] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 294.883598] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 294.891001] systemd[1]: Started SSH per-connection Daemon (vsock:2:30). client # [ 294.986910] sshd-session[1475]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 294.997153] sshd-session[1475]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 295.005918] sshd-session[1475]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 295.021879] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 295.035217] systemd-logind[427]: New session '38' of user 'root' with class 'user' and type 'tty'. client # [ 295.062432] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 295.076188] systemd[1]: Starting User Manager for UID 0... client # [ 295.115141] (systemd)[1483]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 295.122555] systemd-logind[427]: New session '39' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 295.212512] systemd[1483]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 295.312895] systemd[1483]: Queued start job for default target Main User Target. client # [ 295.321048] systemd[1483]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 295.325508] systemd[1483]: Created slice User Application Slice. client # [ 295.326573] systemd[1483]: Started Daily Cleanup of User's Temporary Directories. client # [ 295.327762] systemd[1483]: Reached target Paths. client # [ 295.331285] systemd[1483]: Reached target Timers. client # [ 295.333503] systemd[1483]: Starting D-Bus User Message Bus Socket... client # [ 295.334501] systemd[1483]: Starting Create User Files and Directories... client # [ 295.382988] systemd[1483]: Finished Create User Files and Directories. client # [ 295.387046] systemd[1483]: Listening on D-Bus User Message Bus Socket. client # [ 295.389897] systemd[1483]: Reached target Sockets. client # [ 295.390709] systemd[1483]: Reached target Basic System. client # [ 295.391505] systemd[1483]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 295.393265] systemd[1483]: Reached target Main User Target. client # [ 295.394072] systemd[1483]: Startup finished in 245ms. client # [ 295.394846] systemd[1]: Started User Manager for UID 0. client # [ 295.396713] systemd[1]: Started Session 38 of User root. client # [ 295.566786] sshd-session[1497]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 295.568745] sshd-session[1497]: Disconnected from user root UNKNOWN port 65535 client # [ 295.570115] sshd-session[1475]: pam_unix(sshd:session): session closed for user root client # [ 295.574918] systemd[1]: sshd-vsock@30-31-3:22-2:30.service: Deactivated successfully. client # [ 295.580182] systemd[1]: session-38.scope: Deactivated successfully. client # [ 295.585010] systemd-logind[427]: Session 38 logged out. Waiting for processes to exit. client # [ 295.587179] systemd-logind[427]: Removed session 38. client # [ 296.497105] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 296.506217] systemd[1]: Started SSH per-connection Daemon (vsock:2:31). client # [ 296.607163] sshd-session[1504]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 296.617238] sshd-session[1504]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 296.625930] sshd-session[1504]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 296.634968] systemd-logind[427]: New session '40' of user 'root' with class 'user' and type 'tty'. client # [ 296.644591] systemd[1]: Started Session 40 of User root. worker1 # [ 296.796711] nix-grpc-daemon[485]: ts=2026-11-12T09:23:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:43866 lb # [ 298.102633] garage[898]: 2026-11-12T09:23:19.861875Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.narinfo lb # [ 298.108619] garage[898]: 2026-11-12T09:23:19.867942Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 296.813035] nix-grpc-daemon[485]: ts=2026-11-12T09:23:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:43866 worker1 # [ 296.825096] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 296.977102] nix-daemon[1059]: accepted connection from pid 1963, user nix-grpc-daemon (trusted) lb # [ 298.300507] niks3-server[1454]: 2026/11/12 09:23:20 INFO Received push request method=POST path=/api/pushes worker1 # [ 297.003252] nix-daemon[1059]: reaped child process 1966, status = succeeded lb # [ 298.313114] systemd[1]: Stopping User Manager for UID 0... lb # [ 298.324675] systemd[1520]: Activating special unit Exit the Session... worker1 # [ 297.025543] nix-grpc-daemon[1104]: time=2026-11-12T09:23:20.818Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 297.027213] nix-grpc-daemon[1104]: time=2026-11-12T09:23:20.818Z level=INFO msg="Uploading 41jfnyhgbq6g15z3xmxdilc1q9ihyhi7-fod-on-ca (120B)" lb # [ 298.333340] systemd[1520]: Stopped target Main User Target. lb # [ 298.334772] garage[898]: 2026-11-12T09:23:20.086713Z INFO garage_api_common::generic_server: 192.168.1.3:39522 PUT /farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092320Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e1f16e01a82a166fa497465e5dd919ba08fadb51ee022152df8ed393eb630014 worker1 # [ 297.048059] nix-grpc-daemon[1104]: time=2026-11-12T09:23:20.841Z level=INFO msg="Uploading 1 narinfos" lb # [ 298.363665] garage[898]: 2026-11-12T09:23:20.088910Z INFO garage_api_common::generic_server: 192.168.1.3:39524 PUT /farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092320Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=04e4c3d072ae6db68fd45a8d8f5ff6ea31f31330a55779424eed65cdf33a6502 lb # [ 298.379715] systemd[1520]: Stopped target Basic System. worker1 # [ 297.082917] nix-grpc-daemon[1104]: time=2026-11-12T09:23:20.876Z level=INFO msg="Upload complete. (244ms)" lb # [ 298.381306] niks3-server[1454]: 2026/11/12 09:23:20 INFO Received sign narinfos request method=POST path=/api/pushes/31/sign worker1 # [ 297.089915] nix-grpc-daemon[485]: ts=2026-11-12T09:23:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:43866 duration_s=0 paths=1 nar_bytes_in=120 lb # [ 298.394200] niks3-server[1454]: 2026/11/12 09:23:20 INFO Signed narinfos id=31 count=1 lb # [ 298.395795] niks3-server[1454]: 2026/11/12 09:23:20 INFO Received complete push request method=POST path=/api/pushes/31/complete worker1 # [ 297.103780] nix-daemon[1059]: reaped child process 1961, status = succeeded lb # [ 298.402726] niks3-server[1454]: 2026/11/12 09:23:20 INFO Registered completed upload object_key=nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst lb # [ 298.405787] niks3-server[1454]: 2026/11/12 09:23:20 INFO Registered completed upload object_key=41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.narinfo client # [ 297.103823] sshd-session[1510]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 298.407998] niks3-server[1454]: 2026/11/12 09:23:20 INFO Registered completed upload object_key=41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls client # [ 297.107165] sshd-session[1510]: Disconnected from user root UNKNOWN port 65535 client # [ 297.109481] sshd-session[1504]: pam_unix(sshd:session): session closed for user root lb # [ 298.410581] garage[898]: 2026-11-12T09:23:20.108438Z INFO garage_api_common::generic_server: 192.168.1.3:39524 PUT /farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092320Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eeaaa19a103770615ecf52c007719a3f49126d3a5b0824ebd171f18e7f8419fb client # [ 297.116396] systemd[1]: sshd-vsock@31-32-3:22-2:31.service: Deactivated successfully. lb # [ 298.420345] garage[898]: 2026-11-12T09:23:20.111745Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls lb # [ 298.423370] garage[898]: 2026-11-12T09:23:20.112498Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst client # [ 297.123332] systemd[1]: session-40.scope: Deactivated successfully. lb # [ 298.430593] garage[898]: 2026-11-12T09:23:20.118958Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.narinfo client # [ 297.126656] systemd[1]: session-40.scope: Consumed 144ms CPU time over 481ms wall clock time, 29.6M memory peak, 7.1K incoming IP traffic, 6K outgoing IP traffic. lb # [ 298.433948] systemd[1520]: Stopped target Paths. lb # [ 298.434684] niks3-server[1454]: 2026/11/12 09:23:20 INFO Completed push id=31 objects=3 duration=27.78414ms lb # [ 298.436558] systemd[1520]: Stopped target Sockets. lb # [ 298.437365] systemd[1520]: Stopped target Timers. lb # [ 298.438057] systemd[1520]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 298.439155] systemd[1520]: Closed D-Bus User Message Bus Socket. lb # [ 298.440346] systemd[1520]: Stopped Create User Files and Directories. client # [ 297.136444] systemd-logind[427]: Session 40 logged out. Waiting for processes to exit. lb # [ 298.441330] systemd[1520]: Removed slice User Application Slice. lb # [ 298.442235] systemd[1520]: Reached target Shutdown. client # [ 297.138346] systemd-logind[427]: Removed session 40. lb # [ 298.442976] systemd[1520]: Finished Exit the Session. lb # [ 298.443921] systemd[1520]: Reached target Exit the Session. lb # [ 298.445182] systemd-logind[499]: Removed session 34. lb # [ 298.445936] systemd[1]: user@0.service: Deactivated successfully. lb # [ 298.446833] systemd[1]: Stopped User Manager for UID 0. lb # [ 298.475151] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 298.510277] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 298.514733] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 298.518029] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 297.292624] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 297.300622] systemd[1]: Started SSH per-connection Daemon (vsock:2:32). client # [ 297.402859] sshd-session[1523]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 297.413211] sshd-session[1523]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 297.422410] sshd-session[1523]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 297.431773] systemd-logind[427]: New session '41' of user 'root' with class 'user' and type 'tty'. client # [ 297.441530] systemd[1]: Started Session 41 of User root. client # [ 297.633014] sshd-session[1529]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 297.634641] sshd-session[1529]: Disconnected from user root UNKNOWN port 65535 client # [ 297.636303] sshd-session[1523]: pam_unix(sshd:session): session closed for user root client # [ 297.641074] systemd[1]: sshd-vsock@32-33-3:22-2:32.service: Deactivated successfully. client # [ 297.646468] systemd[1]: session-41.scope: Deactivated successfully. client # [ 297.651250] systemd-logind[427]: Session 41 logged out. Waiting for processes to exit. client # [ 297.653884] systemd-logind[427]: Removed session 41. worker1 # [ 297.718390] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 297.728884] systemd[1]: Started SSH per-connection Daemon (vsock:2:41). worker1 # [ 297.830051] sshd-session[1968]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 297.838756] sshd-session[1968]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 297.853311] sshd-session[1968]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 297.866474] systemd-logind[539]: New session '49' of user 'root' with class 'user' and type 'tty'. worker1 # [ 297.873597] systemd[1]: Started Session 49 of User root. worker1 # [ 298.089068] sshd-session[1974]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 298.090560] sshd-session[1974]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 298.092174] sshd-session[1968]: pam_unix(sshd:session): session closed for user root worker1 # [ 298.096836] systemd[1]: sshd-vsock@41-42-5:22-2:41.service: Deactivated successfully. worker1 # [ 298.102750] systemd[1]: session-49.scope: Deactivated successfully. worker1 # [ 298.107521] systemd-logind[539]: Session 49 logged out. Waiting for processes to exit. worker1 # [ 298.110209] systemd-logind[539]: Removed session 49. lb # [ 301.863729] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 301.871144] systemd[1]: Started SSH per-connection Daemon (vsock:2:27). lb # [ 301.970711] sshd-session[1545]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 301.980750] sshd-session[1545]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 301.989365] sshd-session[1545]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 302.005341] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 302.018299] systemd-logind[499]: New session '35' of user 'root' with class 'user' and type 'tty'. lb # [ 302.049555] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 302.068494] systemd[1]: Starting User Manager for UID 0... lb # [ 302.101700] (systemd)[1553]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 302.106955] systemd-logind[499]: New session '36' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 302.197445] systemd[1553]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 302.293655] systemd[1553]: Queued start job for default target Main User Target. lb # [ 302.301025] systemd[1553]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 302.305414] systemd[1553]: Created slice User Application Slice. lb # [ 302.306459] systemd[1553]: Started Daily Cleanup of User's Temporary Directories. lb # [ 302.307550] systemd[1553]: Reached target Paths. lb # [ 302.311442] systemd[1553]: Reached target Timers. lb # [ 302.316258] systemd[1553]: Starting D-Bus User Message Bus Socket... lb # [ 302.317251] systemd[1553]: Starting Create User Files and Directories... lb # [ 302.353419] systemd[1553]: Finished Create User Files and Directories. lb # [ 302.359327] systemd[1553]: Listening on D-Bus User Message Bus Socket. lb # [ 302.364228] systemd[1553]: Reached target Sockets. lb # [ 302.365043] systemd[1553]: Reached target Basic System. lb # [ 302.365805] systemd[1553]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 302.367257] systemd[1553]: Reached target Main User Target. lb # [ 302.368292] systemd[1553]: Startup finished in 236ms. lb # [ 302.369973] systemd[1]: Started User Manager for UID 0. lb # [ 302.373490] systemd[1]: Started Session 35 of User root. lb # [ 302.419814] garage[898]: 2026-11-12T09:23:24.178812Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.narinfo lb # [ 302.424664] garage[898]: 2026-11-12T09:23:24.183264Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) GET /farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.narinfo lb # [ 302.456756] garage[898]: 2026-11-12T09:23:24.214757Z INFO garage_api_common::generic_server: 127.0.0.1:45740 (key GK0123456789abcdef01234567) DELETE /farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst lb # [ 302.482387] garage[898]: 2026-11-12T09:23:24.241872Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst lb # [ 302.486518] garage[898]: 2026-11-12T09:23:24.242244Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 302.495355] sshd-session[1567]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 302.497284] sshd-session[1567]: Disconnected from user root UNKNOWN port 65535 lb # [ 302.499357] sshd-session[1545]: pam_unix(sshd:session): session closed for user root lb # [ 302.503890] systemd[1]: sshd-vsock@27-28-4:22-2:27.service: Deactivated successfully. lb # [ 302.509489] systemd[1]: session-35.scope: Deactivated successfully. lb # [ 302.511385] systemd[1]: session-35.scope: Consumed 75ms CPU time over 138ms wall clock time, 11.5M memory peak, 1.6K incoming IP traffic, 1.8K outgoing IP traffic. lb # [ 302.518224] systemd-logind[499]: Session 35 logged out. Waiting for processes to exit. lb # [ 302.519453] systemd-logind[499]: Removed session 35. client # [ 306.911605] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 306.919458] systemd[1]: Started SSH per-connection Daemon (vsock:2:33). client # [ 307.020651] sshd-session[1536]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 307.030496] sshd-session[1536]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 307.039318] sshd-session[1536]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 307.050615] systemd-logind[427]: New session '42' of user 'root' with class 'user' and type 'tty'. client # [ 307.056559] systemd[1]: Started Session 42 of User root. client # [ 307.081686] sshd-session[1542]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 307.084665] sshd-session[1542]: Disconnected from user root UNKNOWN port 65535 client # [ 307.086139] sshd-session[1536]: pam_unix(sshd:session): session closed for user root client # [ 307.090916] systemd[1]: sshd-vsock@33-34-3:22-2:33.service: Deactivated successfully. client # [ 307.096196] systemd[1]: session-42.scope: Deactivated successfully. client # [ 307.101113] systemd-logind[427]: Session 42 logged out. Waiting for processes to exit. client # [ 307.103396] systemd-logind[427]: Removed session 42. [e2e] heartbeat t=210s worker1 # [ 308.289960] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 308.297579] systemd[1943]: Activating special unit Exit the Session... worker1 # [ 308.302934] systemd[1943]: Stopped target Main User Target. worker1 # [ 308.308347] systemd[1943]: Stopped target Basic System. worker1 # [ 308.309697] systemd[1943]: Stopped target Paths. worker1 # [ 308.310817] systemd[1943]: Stopped target Sockets. worker1 # [ 308.311977] systemd[1943]: Stopped target Timers. worker1 # [ 308.313358] systemd[1943]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 308.315011] systemd[1943]: Closed D-Bus User Message Bus Socket. worker1 # [ 308.316564] systemd[1943]: Stopped Create User Files and Directories. worker1 # [ 308.317976] systemd[1943]: Removed slice User Application Slice. worker1 # [ 308.319327] systemd[1943]: Reached target Shutdown. worker1 # [ 308.321491] systemd[1943]: Finished Exit the Session. worker1 # [ 308.322732] systemd[1943]: Reached target Exit the Session. worker1 # [ 308.345706] systemd-logind[539]: Removed session 48. worker1 # [ 308.353089] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 308.355837] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 308.373903] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 308.417819] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 308.421787] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 308.428166] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 309.659946] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 309.667922] systemd[1]: Started SSH per-connection Daemon (vsock:2:34). client # [ 309.761876] sshd-session[1547]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 309.772333] sshd-session[1547]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 309.781391] sshd-session[1547]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 309.790748] systemd-logind[427]: New session '43' of user 'root' with class 'user' and type 'tty'. client # [ 309.800573] systemd[1]: Started Session 43 of User root. worker2 # [ 308.464658] nix-grpc-daemon[1487]: ts=2026-11-12T09:23:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48140 worker1 # [ 310.023911] nix-grpc-daemon[485]: ts=2026-11-12T09:23:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 311.331456] garage[898]: 2026-11-12T09:23:33.089275Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.narinfo lb # [ 311.338740] garage[898]: 2026-11-12T09:23:33.096713Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/d2awhc2ag2qfbs5qxgzxhkxnyvkbaf4a.narinfo lb # [ 311.344748] garage[898]: 2026-11-12T09:23:33.097127Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 310.051209] nix-grpc-daemon[485]: ts=2026-11-12T09:23:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 311.350361] garage[898]: 2026-11-12T09:23:33.097266Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/kvks70i2y71pc3vvc0sjpx009rjr7ffn.narinfo lb # [ 311.354728] garage[898]: 2026-11-12T09:23:33.097440Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 311.358339] garage[898]: 2026-11-12T09:23:33.097524Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) GET /farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.narinfo lb # [ 311.365198] garage[898]: 2026-11-12T09:23:33.123689Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/d2awhc2ag2qfbs5qxgzxhkxnyvkbaf4a.narinfo lb # [ 311.372763] garage[898]: 2026-11-12T09:23:33.124145Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 311.376937] garage[898]: 2026-11-12T09:23:33.124527Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/kvks70i2y71pc3vvc0sjpx009rjr7ffn.narinfo lb # [ 311.382303] garage[898]: 2026-11-12T09:23:33.124761Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 308.530016] nix-grpc-daemon[1487]: ts=2026-11-12T09:23:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 311.385726] garage[898]: 2026-11-12T09:23:33.130667Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/d2awhc2ag2qfbs5qxgzxhkxnyvkbaf4a.narinfo lb # [ 311.393061] garage[898]: 2026-11-12T09:23:33.131063Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 311.402382] garage[898]: 2026-11-12T09:23:33.131176Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/kvks70i2y71pc3vvc0sjpx009rjr7ffn.narinfo lb # [ 311.408336] garage[898]: 2026-11-12T09:23:33.131343Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 308.556132] nix-grpc-daemon[1487]: ts=2026-11-12T09:23:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 311.411524] garage[898]: 2026-11-12T09:23:33.151678Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/1qm909jvmbf1xpkfnk7pzaka2i40kvzl.narinfo lb # [ 311.415604] garage[898]: 2026-11-12T09:23:33.156559Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 311.418703] garage[898]: 2026-11-12T09:23:33.157788Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/i3fqn9njhazkscaajczdph7gspv6flkc.narinfo worker2 # [ 308.567232] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 311.422904] garage[898]: 2026-11-12T09:23:33.158119Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 311.425882] garage[898]: 2026-11-12T09:23:33.158247Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/x2wb1f0xw20vfdvagiww38pnhm2j1px9.narinfo lb # [ 311.429551] garage[898]: 2026-11-12T09:23:33.158414Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 311.432146] garage[898]: 2026-11-12T09:23:33.159483Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/hxj5r1pgqbm6r3rlna5iqdk1463f3bx7.narinfo lb # [ 311.435401] garage[898]: 2026-11-12T09:23:33.159732Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 308.591917] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 308.732844] nix-daemon[976]: accepted connection from pid 1865, user nix-grpc-daemon (trusted) worker2 # [ 308.760489] nix-daemon[976]: reaped child process 1868, status = succeeded lb # [ 311.618581] niks3-server[1454]: 2026/11/12 09:23:33 INFO Received push request method=POST path=/api/pushes worker2 # [ 308.774702] nix-grpc-daemon[1723]: time=2026-11-12T09:23:34.045Z level=INFO msg="Uploading 4 paths to lb (0 already cached)" worker2 # [ 308.778326] nix-grpc-daemon[1723]: time=2026-11-12T09:23:34.045Z level=INFO msg="Uploading x2wb1f0xw20vfdvagiww38pnhm2j1px9-recoverthrows-other.drv (424B)" worker2 # [ 308.780573] nix-grpc-daemon[1723]: time=2026-11-12T09:23:34.045Z level=INFO msg="Uploading i3fqn9njhazkscaajczdph7gspv6flkc-fod-on-ca.drv (688B)" lb # [ 311.627501] garage[898]: 2026-11-12T09:23:33.386809Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/nar/1mplgxj9hm1fmzq28va4fz2rhsqp5glvc7ck7b1qxgl3zd9c0g04.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092333Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=780408488389abc8514c588cd6ff03baa19a70007c9619355f4607646a25dfca worker2 # [ 308.782586] nix-grpc-daemon[1723]: time=2026-11-12T09:23:34.045Z level=INFO msg="Uploading hxj5r1pgqbm6r3rlna5iqdk1463f3bx7-floating-ca.drv (400B)" worker2 # [ 308.785866] nix-grpc-daemon[1723]: time=2026-11-12T09:23:34.045Z level=INFO msg="Uploading 1qm909jvmbf1xpkfnk7pzaka2i40kvzl-uses-fod-on-ca.drv (536B)" lb # [ 311.654110] garage[898]: 2026-11-12T09:23:33.398528Z INFO garage_api_common::generic_server: 192.168.1.4:54238 PUT /farm/i3fqn9njhazkscaajczdph7gspv6flkc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092333Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e8002b7a2bfb66fe04ce5b8d155f11404d7e185007cc648a4ce1ca4994b78636 worker2 # [ 308.818702] nix-grpc-daemon[1723]: time=2026-11-12T09:23:34.090Z level=INFO msg="Uploading 4 narinfos" lb # [ 311.678846] garage[898]: 2026-11-12T09:23:33.399226Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/nar/13q70rjmif59za9j1vp0lf3jwh7w1r3jsi50zycvn804l1gcwpam.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092333Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d15378f62561c29a00cb9f133d6b632923c0a3ea73ffee1511ee8eba40f8064f lb # [ 311.700852] garage[898]: 2026-11-12T09:23:33.400048Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/nar/0hy1d1l6423z9qg9n3v4mmjaaz6xi4v55kyafq2wjw1p8kjqdrzf.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092333Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=34a0c9f3af1ef9bca9626705f8ed690476f70e40d93f00718e6e477fa093498c worker2 # [ 308.859673] nix-grpc-daemon[1723]: time=2026-11-12T09:23:34.132Z level=INFO msg="Upload complete. (258ms)" lb # [ 311.713766] garage[898]: 2026-11-12T09:23:33.400471Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/nar/03zy88sqba2zzy63d33swvjgky9sm43f54lbk4pzhgnlkbz43y2k.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092333Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=52227f938f039ebf7282d817a652ec31121c9a1596a3642d3f6d56ce32b56016 lb # [ 311.722152] niks3-server[1454]: 2026/11/12 09:23:33 INFO Registered completed upload object_key=nar/1mplgxj9hm1fmzq28va4fz2rhsqp5glvc7ck7b1qxgl3zd9c0g04.nar.zst worker2 # [ 308.868485] nix-grpc-daemon[1487]: ts=2026-11-12T09:23:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 paths=4 nar_bytes_in=2048 worker2 # [ 308.882219] nix-daemon[976]: reaped child process 1861, status = succeeded worker1 # [ 310.434739] nix-grpc-daemon[485]: ts=2026-11-12T09:23:34Z level=debug event=want client=13 drv=1qm909jvmbf1xpkfnk7pzaka2i40kvzl-uses-fod-on-ca.drv cached=0 lb # [ 311.740336] niks3-server[1454]: 2026/11/12 09:23:33 INFO Registered completed upload object_key=i3fqn9njhazkscaajczdph7gspv6flkc.ls worker1 # [ 310.441136] nix-grpc-daemon[485]: ts=2026-11-12T09:23:34Z level=debug event=assigned drv=1qm909jvmbf1xpkfnk7pzaka2i40kvzl-uses-fod-on-ca.drv worker=192.168.1.4:50051 clients=1 lb # [ 311.742603] niks3-server[1454]: 2026/11/12 09:23:33 INFO Received sign narinfos request method=POST path=/api/pushes/32/sign worker2 # [ 308.887947] nix-grpc-daemon[1487]: ts=2026-11-12T09:23:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 311.744585] niks3-server[1454]: 2026/11/12 09:23:33 INFO Registered completed upload object_key=nar/13q70rjmif59za9j1vp0lf3jwh7w1r3jsi50zycvn804l1gcwpam.nar.zst lb # [ 311.747101] niks3-server[1454]: 2026/11/12 09:23:33 INFO Signed narinfos id=32 count=4 lb # [ 311.748464] niks3-server[1454]: 2026/11/12 09:23:33 INFO Registered completed upload object_key=1qm909jvmbf1xpkfnk7pzaka2i40kvzl.ls worker2 # [ 308.895417] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 311.750282] niks3-server[1454]: 2026/11/12 09:23:33 INFO Registered completed upload object_key=nar/03zy88sqba2zzy63d33swvjgky9sm43f54lbk4pzhgnlkbz43y2k.nar.zst worker1 # [ 310.450628] nix-grpc-daemon[485]: ts=2026-11-12T09:23:34Z level=debug event=want client=13 drv=x2wb1f0xw20vfdvagiww38pnhm2j1px9-recoverthrows-other.drv cached=0 lb # [ 311.752716] niks3-server[1454]: 2026/11/12 09:23:33 INFO Registered completed upload object_key=x2wb1f0xw20vfdvagiww38pnhm2j1px9.ls lb # [ 311.755685] niks3-server[1454]: 2026/11/12 09:23:33 INFO Registered completed upload object_key=nar/0hy1d1l6423z9qg9n3v4mmjaaz6xi4v55kyafq2wjw1p8kjqdrzf.nar.zst worker1 # [ 310.456363] nix-grpc-daemon[485]: ts=2026-11-12T09:23:34Z level=debug event=assigned drv=x2wb1f0xw20vfdvagiww38pnhm2j1px9-recoverthrows-other.drv worker=192.168.1.3:50051 clients=1 lb # [ 311.758066] niks3-server[1454]: 2026/11/12 09:23:33 INFO Registered completed upload object_key=hxj5r1pgqbm6r3rlna5iqdk1463f3bx7.ls lb # [ 311.759775] niks3-server[1454]: 2026/11/12 09:23:33 INFO Received complete push request method=POST path=/api/pushes/32/complete lb # [ 311.763762] niks3-server[1454]: 2026/11/12 09:23:33 INFO Registered completed upload object_key=x2wb1f0xw20vfdvagiww38pnhm2j1px9.narinfo worker1 # [ 310.464381] nix-grpc-daemon[485]: ts=2026-11-12T09:23:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 311.765988] niks3-server[1454]: 2026/11/12 09:23:33 INFO Completed push id=32 objects=12 duration=15.39702ms worker2 # [ 308.911545] nix-grpc-daemon[1487]: copying path '/nix/store/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7-fod-on-ca' from 'http://lb:5751'... lb # [ 311.767516] niks3-server[1454]: 2026/11/12 09:23:33 INFO Registered completed upload object_key=hxj5r1pgqbm6r3rlna5iqdk1463f3bx7.narinfo worker1 # [ 310.467919] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 311.769466] niks3-server[1454]: 2026/11/12 09:23:33 INFO Registered completed upload object_key=1qm909jvmbf1xpkfnk7pzaka2i40kvzl.narinfo lb # [ 311.773144] niks3-server[1454]: 2026/11/12 09:23:33 INFO Registered completed upload object_key=i3fqn9njhazkscaajczdph7gspv6flkc.narinfo worker2 # [ 308.920484] nix-grpc-daemon[1487]: warning: file 'nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst' does not exist in binary cache 'http://lb:5751' lb # [ 311.775048] garage[898]: 2026-11-12T09:23:33.400724Z INFO garage_api_common::generic_server: 192.168.1.4:54250 PUT /farm/x2wb1f0xw20vfdvagiww38pnhm2j1px9.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092333Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=43db8b1e3e9e82fc85989077e4d3e6305ff8e7e87c4d4ee5219cfc62451c2d6b lb # [ 311.782842] garage[898]: 2026-11-12T09:23:33.403705Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/nar/1mplgxj9hm1fmzq28va4fz2rhsqp5glvc7ck7b1qxgl3zd9c0g04.nar.zst worker1 # [ 310.484425] nix-grpc-daemon[485]: copying path '/nix/store/x2wb1f0xw20vfdvagiww38pnhm2j1px9-recoverthrows-other.drv' from 'http://lb:5751'... worker2 # [ 308.936515] nix-daemon[976]: reaped child process 1871, status = succeeded lb # [ 311.786106] garage[898]: 2026-11-12T09:23:33.404206Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/hxj5r1pgqbm6r3rlna5iqdk1463f3bx7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092333Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=869f91b552228d2d782eabf5db1b1c98b860fb8e12a4ef53e71355975e9e79c8 lb # [ 311.793847] garage[898]: 2026-11-12T09:23:33.407219Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/1qm909jvmbf1xpkfnk7pzaka2i40kvzl.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092333Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=646f35000b64f2733ffa3f04a5d44615442197764be045dd5e314ae62d8c121c lb # [ 311.799521] garage[898]: 2026-11-12T09:23:33.409250Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/nar/13q70rjmif59za9j1vp0lf3jwh7w1r3jsi50zycvn804l1gcwpam.nar.zst worker1 # [ 310.499978] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 311.802580] garage[898]: 2026-11-12T09:23:33.409782Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/i3fqn9njhazkscaajczdph7gspv6flkc.ls lb # [ 311.805452] garage[898]: 2026-11-12T09:23:33.431521Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/1qm909jvmbf1xpkfnk7pzaka2i40kvzl.ls lb # [ 311.808038] garage[898]: 2026-11-12T09:23:33.435348Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/x2wb1f0xw20vfdvagiww38pnhm2j1px9.ls lb # [ 311.810822] garage[898]: 2026-11-12T09:23:33.435852Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nar/03zy88sqba2zzy63d33swvjgky9sm43f54lbk4pzhgnlkbz43y2k.nar.zst worker1 # [ 310.515427] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 311.814579] garage[898]: 2026-11-12T09:23:33.437677Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/0hy1d1l6423z9qg9n3v4mmjaaz6xi4v55kyafq2wjw1p8kjqdrzf.nar.zst lb # [ 311.817665] garage[898]: 2026-11-12T09:23:33.447634Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/x2wb1f0xw20vfdvagiww38pnhm2j1px9.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092333Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5f5be611ceb991bee6b61a373d2eca61a7e96e94651153dd4225286c62356e5f lb # [ 311.823203] garage[898]: 2026-11-12T09:23:33.447959Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/1qm909jvmbf1xpkfnk7pzaka2i40kvzl.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092333Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=098f5e4f92d776cc83b0432c8cd3509928ada12fb35fa23c548353b47305dd9b lb # [ 311.828919] garage[898]: 2026-11-12T09:23:33.449468Z INFO garage_api_common::generic_server: 192.168.1.4:54250 PUT /farm/hxj5r1pgqbm6r3rlna5iqdk1463f3bx7.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092333Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=95128c19be5696f358e76a1ec18f6d94b655251f40f7d956dca5f1f2c156a001 lb # [ 311.834328] garage[898]: 2026-11-12T09:23:33.449871Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/i3fqn9njhazkscaajczdph7gspv6flkc.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092333Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b402a3e3ff042e91a2b5b536a5c6a80f6e86e15e92335caeb82902fb2452cb7 lb # [ 311.840207] garage[898]: 2026-11-12T09:23:33.450079Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/hxj5r1pgqbm6r3rlna5iqdk1463f3bx7.ls lb # [ 311.842729] garage[898]: 2026-11-12T09:23:33.453040Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/x2wb1f0xw20vfdvagiww38pnhm2j1px9.narinfo lb # [ 311.845544] garage[898]: 2026-11-12T09:23:33.456703Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/i3fqn9njhazkscaajczdph7gspv6flkc.narinfo lb # [ 311.848212] garage[898]: 2026-11-12T09:23:33.468201Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/1qm909jvmbf1xpkfnk7pzaka2i40kvzl.narinfo lb # [ 311.850791] garage[898]: 2026-11-12T09:23:33.470861Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/hxj5r1pgqbm6r3rlna5iqdk1463f3bx7.narinfo lb # [ 311.853595] garage[898]: 2026-11-12T09:23:33.522369Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.narinfo lb # [ 311.856402] garage[898]: 2026-11-12T09:23:33.523183Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.narinfo lb # [ 311.859080] garage[898]: 2026-11-12T09:23:33.531865Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst lb # [ 311.862104] garage[898]: 2026-11-12T09:23:33.532228Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 311.864139] garage[898]: 2026-11-12T09:23:33.532724Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/x2wb1f0xw20vfdvagiww38pnhm2j1px9.narinfo lb # [ 311.866726] garage[898]: 2026-11-12T09:23:33.541380Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/x2wb1f0xw20vfdvagiww38pnhm2j1px9.narinfo lb # [ 311.869512] garage[898]: 2026-11-12T09:23:33.552739Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/1mplgxj9hm1fmzq28va4fz2rhsqp5glvc7ck7b1qxgl3zd9c0g04.nar.zst lb # [ 311.872461] garage[898]: 2026-11-12T09:23:33.553388Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/nar/1mplgxj9hm1fmzq28va4fz2rhsqp5glvc7ck7b1qxgl3zd9c0g04.nar.zst lb # [ 312.557231] systemd[1]: Stopping User Manager for UID 0... lb # [ 312.563824] systemd[1553]: Activating special unit Exit the Session... lb # [ 312.569013] systemd[1553]: Stopped target Main User Target. lb # [ 312.574573] systemd[1553]: Stopped target Basic System. lb # [ 312.575914] systemd[1553]: Stopped target Paths. lb # [ 312.578314] systemd[1553]: Stopped target Sockets. lb # [ 312.579624] systemd[1553]: Stopped target Timers. lb # [ 312.581778] systemd[1553]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 312.583743] systemd[1553]: Closed D-Bus User Message Bus Socket. lb # [ 312.585442] systemd[1553]: Stopped Create User Files and Directories. lb # [ 312.586910] systemd[1553]: Removed slice User Application Slice. lb # [ 312.588413] systemd[1553]: Reached target Shutdown. lb # [ 312.589567] systemd[1553]: Finished Exit the Session. lb # [ 312.590701] systemd[1553]: Reached target Exit the Session. lb # [ 312.605686] systemd-logind[499]: Removed session 36. lb # [ 312.613229] systemd[1]: user@0.service: Deactivated successfully. lb # [ 312.618635] systemd[1]: Stopped User Manager for UID 0. lb # [ 312.672492] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 312.704568] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 312.709850] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 312.715548] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 312.879476] garage[898]: 2026-11-12T09:23:34.638542Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/d2awhc2ag2qfbs5qxgzxhkxnyvkbaf4a.narinfo lb # [ 312.885629] garage[898]: 2026-11-12T09:23:34.644348Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 311.965133] nix-daemon[1059]: reaped child process 1993, status = succeeded worker1 # [ 312.080851] nix-daemon[1059]: accepted connection from pid 2009, user nix-grpc-daemon (trusted) lb # [ 313.403827] niks3-server[1454]: 2026/11/12 09:23:35 INFO Received push request method=POST path=/api/pushes worker1 # [ 312.108246] nix-daemon[1059]: reaped child process 2012, status = succeeded worker1 # [ 312.116632] nix-grpc-daemon[1104]: time=2026-11-12T09:23:35.906Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 312.118482] nix-grpc-daemon[1104]: time=2026-11-12T09:23:35.906Z level=INFO msg="Uploading d2awhc2ag2qfbs5qxgzxhkxnyvkbaf4a-recoverthrows-other (128B)" worker1 # [ 312.132094] nix-grpc-daemon[1104]: time=2026-11-12T09:23:35.925Z level=INFO msg="Uploading 1 narinfos" lb # [ 313.416301] garage[898]: 2026-11-12T09:23:35.175733Z INFO garage_api_common::generic_server: 192.168.1.3:39524 PUT /farm/log/x2wb1f0xw20vfdvagiww38pnhm2j1px9-recoverthrows-other.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092335Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7453f404e593fb88f67e06e5c6f70abdc4174338a900dd11a8ea9d7ba391ea12 lb # [ 313.441437] garage[898]: 2026-11-12T09:23:35.186478Z INFO garage_api_common::generic_server: 192.168.1.3:39520 PUT /farm/d2awhc2ag2qfbs5qxgzxhkxnyvkbaf4a.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092335Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cceb4c541fafad8d78c0ccae03fc1fd001d943bc3419c5c6f8f42e48228a168e worker1 # [ 312.154073] nix-grpc-daemon[1104]: time=2026-11-12T09:23:35.947Z level=INFO msg="Upload complete. (223ms)" worker1 # [ 312.160659] nix-grpc-daemon[485]: ts=2026-11-12T09:23:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=1 drv=x2wb1f0xw20vfdvagiww38pnhm2j1px9-recoverthrows-other.drv assign_id=20 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 313.453042] garage[898]: 2026-11-12T09:23:35.186962Z INFO garage_api_common::generic_server: 192.168.1.3:39522 PUT /farm/nar/0dkrdc6bflvzj9kmwk4ivw3c3gbcyy0hgjsc6z20s1nsr31mr3qa.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092335Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3de8ea4732b8783fd60c1edd76935d1461772281ec8f37f6a2d93f4c30b67f70 lb # [ 313.467773] garage[898]: 2026-11-12T09:23:35.190085Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/0dkrdc6bflvzj9kmwk4ivw3c3gbcyy0hgjsc6z20s1nsr31mr3qa.nar.zst worker1 # [ 312.175680] nix-daemon[1059]: reaped child process 1991, status = succeeded lb # [ 313.473621] garage[898]: 2026-11-12T09:23:35.193328Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/log/x2wb1f0xw20vfdvagiww38pnhm2j1px9-recoverthrows-other.drv lb # [ 313.478548] garage[898]: 2026-11-12T09:23:35.194056Z INFO garage_api_common::generic_server: 192.168.1.3:39522 PUT /farm/d2awhc2ag2qfbs5qxgzxhkxnyvkbaf4a.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092335Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=778191701521191af219b868686c1db2775ebe3a864b568695b1c0ee95396e95 lb # [ 313.487271] garage[898]: 2026-11-12T09:23:35.197420Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/d2awhc2ag2qfbs5qxgzxhkxnyvkbaf4a.ls lb # [ 313.491408] niks3-server[1454]: 2026/11/12 09:23:35 INFO Received sign narinfos request method=POST path=/api/pushes/33/sign lb # [ 313.493965] niks3-server[1454]: 2026/11/12 09:23:35 INFO Signed narinfos id=33 count=1 lb # [ 313.495550] niks3-server[1454]: 2026/11/12 09:23:35 INFO Received complete push request method=POST path=/api/pushes/33/complete client # [ 312.192599] sshd-session[1553]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 312.192902] sshd-session[1553]: Disconnected from user root UNKNOWN port 65535 lb # [ 313.497972] niks3-server[1454]: 2026/11/12 09:23:35 INFO Registered completed upload object_key=log/x2wb1f0xw20vfdvagiww38pnhm2j1px9-recoverthrows-other.drv client # [ 312.197661] sshd-session[1547]: pam_unix(sshd:session): session closed for user root lb # [ 313.500668] niks3-server[1454]: 2026/11/12 09:23:35 INFO Registered completed upload object_key=nar/0dkrdc6bflvzj9kmwk4ivw3c3gbcyy0hgjsc6z20s1nsr31mr3qa.nar.zst lb # [ 313.503358] niks3-server[1454]: 2026/11/12 09:23:35 INFO Completed push id=33 objects=4 duration=17.3684ms lb # [ 313.505303] niks3-server[1454]: 2026/11/12 09:23:35 INFO Registered completed upload object_key=d2awhc2ag2qfbs5qxgzxhkxnyvkbaf4a.narinfo lb # [ 313.507589] niks3-server[1454]: 2026/11/12 09:23:35 INFO Registered completed upload object_key=d2awhc2ag2qfbs5qxgzxhkxnyvkbaf4a.ls client # [ 312.204981] systemd[1]: sshd-vsock@34-35-3:22-2:34.service: Deactivated successfully. lb # [ 313.509898] garage[898]: 2026-11-12T09:23:35.200538Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/d2awhc2ag2qfbs5qxgzxhkxnyvkbaf4a.narinfo client # [ 312.211438] systemd[1]: session-43.scope: Deactivated successfully. client # [ 312.214699] systemd[1]: session-43.scope: Consumed 191ms CPU time over 2.413s wall clock time, 40.2M memory peak, 9K incoming IP traffic, 10.9K outgoing IP traffic. client # [ 312.225174] systemd-logind[427]: Session 43 logged out. Waiting for processes to exit. client # [ 312.227154] systemd-logind[427]: Removed session 43. client # [ 314.119485] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 314.127537] systemd[1]: Started SSH per-connection Daemon (vsock:2:35). client # [ 314.226246] sshd-session[1571]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 314.236544] sshd-session[1571]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 314.245654] sshd-session[1571]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 314.256673] systemd-logind[427]: New session '44' of user 'root' with class 'user' and type 'tty'. client # [ 314.265020] systemd[1]: Started Session 44 of User root. client # [ 314.412629] sshd-session[1577]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 314.414167] sshd-session[1577]: Disconnected from user root UNKNOWN port 65535 client # [ 314.415768] sshd-session[1571]: pam_unix(sshd:session): session closed for user root client # [ 314.420309] systemd[1]: sshd-vsock@35-36-3:22-2:35.service: Deactivated successfully. client # [ 314.425775] systemd[1]: session-44.scope: Deactivated successfully. client # [ 314.430065] systemd-logind[427]: Session 44 logged out. Waiting for processes to exit. client # [ 314.432863] systemd-logind[427]: Removed session 44. lb # [ 316.327415] envoy[897]: conn peer=[2001:db8:1::1]:50136 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=5073 tx=2035 ms=2211 client # [ 316.446741] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 316.454385] systemd[1]: Started SSH per-connection Daemon (vsock:2:36). client # [ 316.548320] sshd-session[1584]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 316.557309] sshd-session[1584]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 316.566140] sshd-session[1584]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 316.575623] systemd-logind[427]: New session '45' of user 'root' with class 'user' and type 'tty'. client # [ 316.583056] systemd[1]: Started Session 45 of User root. worker1 # [ 316.744992] nix-grpc-daemon[485]: ts=2026-11-12T09:23:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36426 worker2 # [ 315.195858] nix-grpc-daemon[1487]: ts=2026-11-12T09:23:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 318.054476] garage[898]: 2026-11-12T09:23:39.813772Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/d2awhc2ag2qfbs5qxgzxhkxnyvkbaf4a.narinfo worker2 # [ 315.210032] nix-grpc-daemon[1487]: copying path '/nix/store/d2awhc2ag2qfbs5qxgzxhkxnyvkbaf4a-recoverthrows-other' from 'http://lb:5751'... lb # [ 318.061323] garage[898]: 2026-11-12T09:23:39.820560Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) GET /farm/d2awhc2ag2qfbs5qxgzxhkxnyvkbaf4a.narinfo lb # [ 318.072274] garage[898]: 2026-11-12T09:23:39.831705Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/0dkrdc6bflvzj9kmwk4ivw3c3gbcyy0hgjsc6z20s1nsr31mr3qa.nar.zst lb # [ 318.083111] garage[898]: 2026-11-12T09:23:39.841934Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) GET /farm/nar/0dkrdc6bflvzj9kmwk4ivw3c3gbcyy0hgjsc6z20s1nsr31mr3qa.nar.zst client # [ 316.817056] sshd-session[1590]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 316.821706] sshd-session[1590]: Disconnected from user root UNKNOWN port 65535 client # [ 316.825561] sshd-session[1584]: pam_unix(sshd:session): session closed for user root client # [ 316.831013] systemd[1]: sshd-vsock@36-37-3:22-2:36.service: Deactivated successfully. client # [ 316.838580] systemd[1]: session-45.scope: Deactivated successfully. client # [ 316.841387] systemd[1]: session-45.scope: Consumed 156ms CPU time over 260ms wall clock time, 27.8M memory peak, 6K incoming IP traffic, 4.1K outgoing IP traffic. client # [ 316.849768] systemd-logind[427]: Session 45 logged out. Waiting for processes to exit. client # [ 316.851515] systemd-logind[427]: Removed session 45. ok test farm::serial::an_input_whose_nar_the_cache_lost_is_built_again ... worker1 # [ 318.971713] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 318.980375] systemd[1]: Started SSH per-connection Daemon (vsock:2:42). worker1 # [ 319.082365] sshd-session[2015]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 319.093055] sshd-session[2015]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 319.103210] sshd-session[2015]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 319.124528] systemd-logind[539]: New session '50' of user 'root' with class 'user' and type 'tty'. worker1 # [ 319.132335] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 319.167326] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 319.174808] systemd[1]: Starting User Manager for UID 0... worker1 # [ 319.201846] (systemd)[2023]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 319.208181] systemd-logind[539]: New session '51' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 319.298119] systemd[2023]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 319.395957] systemd[2023]: Queued start job for default target Main User Target. worker1 # [ 319.405036] systemd[2023]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 319.408062] systemd[2023]: Created slice User Application Slice. worker1 # [ 319.409511] systemd[2023]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 319.410601] systemd[2023]: Reached target Paths. worker1 # [ 319.411325] systemd[2023]: Reached target Timers. worker1 # [ 319.414850] systemd[2023]: Starting D-Bus User Message Bus Socket... worker1 # [ 319.417173] systemd[2023]: Starting Create User Files and Directories... worker1 # [ 319.459046] systemd[2023]: Finished Create User Files and Directories. worker1 # [ 319.463505] systemd[2023]: Listening on D-Bus User Message Bus Socket. worker1 # [ 319.466175] systemd[2023]: Reached target Sockets. worker1 # [ 319.466935] systemd[2023]: Reached target Basic System. worker1 # [ 319.467741] systemd[2023]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 319.471492] systemd[2023]: Reached target Main User Target. worker1 # [ 319.475352] systemd[2023]: Startup finished in 240ms. worker1 # [ 319.477020] systemd[1]: Started User Manager for UID 0. worker1 # [ 319.477836] systemd[1]: Started Session 50 of User root. worker1 # [ 319.504985] sshd-session[2037]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 319.507515] sshd-session[2037]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 319.509557] sshd-session[2015]: pam_unix(sshd:session): session closed for user root worker1 # [ 319.513166] systemd[1]: sshd-vsock@42-43-5:22-2:42.service: Deactivated successfully. worker1 # [ 319.518489] systemd[1]: session-50.scope: Deactivated successfully. worker1 # [ 319.522700] systemd-logind[539]: Session 50 logged out. Waiting for processes to exit. worker1 # [ 319.525365] systemd-logind[539]: Removed session 50. worker2 # [ 319.916425] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 319.925923] systemd[1]: Started SSH per-connection Daemon (vsock:2:29). worker2 # [ 320.026718] sshd-session[1876]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 320.035696] sshd-session[1876]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 320.047209] sshd-session[1876]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 320.068494] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 320.079698] systemd-logind[515]: New session '37' of user 'root' with class 'user' and type 'tty'. worker2 # [ 320.110119] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 320.116836] systemd[1]: Starting User Manager for UID 0... worker2 # [ 320.153075] (systemd)[1884]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 320.160955] systemd-logind[515]: New session '38' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 320.257871] systemd[1884]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 320.362941] systemd[1884]: Queued start job for default target Main User Target. worker2 # [ 320.373122] systemd[1884]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 320.378264] systemd[1884]: Created slice User Application Slice. worker2 # [ 320.379413] systemd[1884]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 320.383716] systemd[1884]: Reached target Paths. worker2 # [ 320.385706] systemd[1884]: Reached target Timers. worker2 # [ 320.386576] systemd[1884]: Starting D-Bus User Message Bus Socket... worker2 # [ 320.387613] systemd[1884]: Starting Create User Files and Directories... worker2 # [ 320.439436] systemd[1884]: Finished Create User Files and Directories. worker2 # [ 320.443413] systemd[1884]: Listening on D-Bus User Message Bus Socket. worker2 # [ 320.447885] systemd[1884]: Reached target Sockets. worker2 # [ 320.452346] systemd[1884]: Reached target Basic System. worker2 # [ 320.453233] systemd[1884]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 320.454744] systemd[1884]: Reached target Main User Target. worker2 # [ 320.455583] systemd[1884]: Startup finished in 264ms. worker2 # [ 320.457621] systemd[1]: Started User Manager for UID 0. worker2 # [ 320.458455] systemd[1]: Started Session 37 of User root. worker2 # [ 320.487476] sshd-session[1897]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 320.490203] sshd-session[1897]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 320.491992] sshd-session[1876]: pam_unix(sshd:session): session closed for user root worker2 # [ 320.495803] systemd[1]: sshd-vsock@29-30-6:22-2:29.service: Deactivated successfully. worker2 # [ 320.501471] systemd[1]: session-37.scope: Deactivated successfully. worker2 # [ 320.505867] systemd-logind[515]: Session 37 logged out. Waiting for processes to exit. worker2 # [ 320.508817] systemd-logind[515]: Removed session 37. lb # [ 323.664655] postgres[809]: [809] LOG: checkpoint starting: time lb # [ 325.299538] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 325.303914] systemd[1]: Started SSH per-connection Daemon (vsock:2:28). lb # [ 325.420330] sshd-session[1600]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 325.429081] sshd-session[1600]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 325.437701] sshd-session[1600]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 325.461712] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 325.498632] systemd-logind[499]: New session '37' of user 'root' with class 'user' and type 'tty'. lb # [ 325.509452] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 325.514549] systemd[1]: Starting User Manager for UID 0... lb # [ 325.541985] (systemd)[1609]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 325.548414] systemd-logind[499]: New session '38' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 325.638614] systemd[1609]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 325.737576] systemd[1609]: Queued start job for default target Main User Target. lb # [ 325.745025] systemd[1609]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 325.748172] systemd[1609]: Created slice User Application Slice. lb # [ 325.749289] systemd[1609]: Started Daily Cleanup of User's Temporary Directories. lb # [ 325.750448] systemd[1609]: Reached target Paths. lb # [ 325.751314] systemd[1609]: Reached target Timers. lb # [ 325.754231] systemd[1609]: Starting D-Bus User Message Bus Socket... lb # [ 325.757433] systemd[1609]: Starting Create User Files and Directories... lb # [ 325.805607] systemd[1609]: Finished Create User Files and Directories. lb # [ 325.807486] systemd[1609]: Listening on D-Bus User Message Bus Socket. lb # [ 325.809956] systemd[1609]: Reached target Sockets. lb # [ 325.810760] systemd[1609]: Reached target Basic System. lb # [ 325.811573] systemd[1609]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 325.815361] systemd[1609]: Reached target Main User Target. lb # [ 325.816454] systemd[1609]: Startup finished in 244ms. lb # [ 325.817215] systemd[1]: Started User Manager for UID 0. lb # [ 325.821876] systemd[1]: Started Session 37 of User root. lb # [ 325.854734] sshd-session[1622]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 325.857716] sshd-session[1622]: Disconnected from user root UNKNOWN port 65535 lb # [ 325.858802] sshd-session[1600]: pam_unix(sshd:session): session closed for user root lb # [ 325.863468] systemd[1]: sshd-vsock@28-29-4:22-2:28.service: Deactivated successfully. lb # [ 325.869011] systemd[1]: session-37.scope: Deactivated successfully. lb # [ 325.873129] systemd[1]: session-37.scope: Consumed 26ms CPU time over 49ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 325.877273] systemd-logind[499]: Session 37 logged out. Waiting for processes to exit. lb # [ 325.878515] systemd-logind[499]: Removed session 37. lb # [ 326.325343] envoy[897]: conn peer=[2001:db8:1::1]:54428 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=589 tx=634 ms=57 worker1 # [ 325.950789] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 325.958722] systemd[1]: Started SSH per-connection Daemon (vsock:2:43). worker1 # [ 326.060000] sshd-session[2043]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 326.068261] sshd-session[2043]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 326.078595] sshd-session[2043]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 326.088330] systemd-logind[539]: New session '52' of user 'root' with class 'user' and type 'tty'. worker1 # [ 326.095205] systemd[1]: Started Session 52 of User root. worker1 # [ 326.128682] sshd-session[2049]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 326.130543] sshd-session[2049]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 326.133019] sshd-session[2043]: pam_unix(sshd:session): session closed for user root worker1 # [ 326.138310] systemd[1]: sshd-vsock@43-44-5:22-2:43.service: Deactivated successfully. worker1 # [ 326.144384] systemd[1]: session-52.scope: Deactivated successfully. worker1 # [ 326.146435] systemd[1]: session-52.scope: Consumed 28ms CPU time over 53ms wall clock time, 3.1M memory peak, 19.6K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 326.153711] systemd-logind[539]: Session 52 logged out. Waiting for processes to exit. worker1 # [ 326.155016] systemd-logind[539]: Removed session 52. client # [ 326.894138] systemd[1]: Stopping User Manager for UID 0... client # [ 326.901676] systemd[1483]: Activating special unit Exit the Session... client # [ 326.908131] systemd[1483]: Stopped target Main User Target. client # [ 326.909670] systemd[1483]: Stopped target Basic System. client # [ 326.910937] systemd[1483]: Stopped target Paths. client # [ 326.914814] systemd[1483]: Stopped target Sockets. client # [ 326.917291] systemd[1483]: Stopped target Timers. client # [ 326.918453] systemd[1483]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 326.920404] systemd[1483]: Closed D-Bus User Message Bus Socket. client # [ 326.921828] systemd[1483]: Stopped Create User Files and Directories. client # [ 326.923332] systemd[1483]: Removed slice User Application Slice. client # [ 326.925123] systemd[1483]: Reached target Shutdown. client # [ 326.926332] systemd[1483]: Finished Exit the Session. client # [ 326.927643] systemd[1483]: Reached target Exit the Session. client # [ 326.935297] systemd-logind[427]: Removed session 39. client # [ 326.942606] systemd[1]: user@0.service: Deactivated successfully. client # [ 326.948302] systemd[1]: Stopped User Manager for UID 0. client # [ 327.013535] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 327.054141] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 327.059383] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 327.063576] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 329.054004] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 329.062182] systemd[1]: Started SSH per-connection Daemon (vsock:2:37). client # [ 329.163655] sshd-session[1609]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 329.171662] sshd-session[1609]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 329.182005] sshd-session[1609]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 329.212483] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 329.247415] systemd-logind[427]: New session '46' of user 'root' with class 'user' and type 'tty'. client # [ 329.259336] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 329.266529] systemd[1]: Starting User Manager for UID 0... client # [ 329.295008] (systemd)[1618]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 329.302128] systemd-logind[427]: New session '47' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 329.395000] systemd[1618]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 329.498480] systemd[1618]: Queued start job for default target Main User Target. client # [ 329.509126] systemd[1618]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 329.513529] systemd[1618]: Created slice User Application Slice. client # [ 329.514638] systemd[1618]: Started Daily Cleanup of User's Temporary Directories. client # [ 329.515817] systemd[1618]: Reached target Paths. client # [ 329.519584] systemd[1618]: Reached target Timers. client # [ 329.521546] systemd[1618]: Starting D-Bus User Message Bus Socket... client # [ 329.522567] systemd[1618]: Starting Create User Files and Directories... client # [ 329.565838] systemd[1618]: Listening on D-Bus User Message Bus Socket. client # [ 329.568088] systemd[1618]: Finished Create User Files and Directories. client # [ 329.569163] systemd[1618]: Reached target Sockets. client # [ 329.573449] systemd[1618]: Reached target Basic System. client # [ 329.574403] systemd[1618]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 329.575963] systemd[1618]: Reached target Main User Target. client # [ 329.581696] systemd[1618]: Startup finished in 251ms. client # [ 329.582549] systemd[1]: Started User Manager for UID 0. client # [ 329.583435] systemd[1]: Started Session 46 of User root. client # [ 329.914415] sshd-session[1632]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 329.917104] sshd-session[1632]: Disconnected from user root UNKNOWN port 65535 client # [ 329.919510] sshd-session[1609]: pam_unix(sshd:session): session closed for user root client # [ 329.923453] systemd[1]: sshd-vsock@37-38-3:22-2:37.service: Deactivated successfully. client # [ 329.929189] systemd[1]: session-46.scope: Deactivated successfully. client # [ 329.934171] systemd-logind[427]: Session 46 logged out. Waiting for processes to exit. client # [ 329.936843] systemd-logind[427]: Removed session 46. worker2 # [ 330.585411] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 330.591798] systemd[1884]: Activating special unit Exit the Session... worker2 # [ 330.596874] systemd[1884]: Stopped target Main User Target. worker2 # [ 330.598364] systemd[1884]: Stopped target Basic System. worker2 # [ 330.599684] systemd[1884]: Stopped target Paths. worker2 # [ 330.605989] systemd[1884]: Stopped target Sockets. worker2 # [ 330.607253] systemd[1884]: Stopped target Timers. worker2 # [ 330.608792] systemd[1884]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 330.610709] systemd[1884]: Closed D-Bus User Message Bus Socket. worker2 # [ 330.612379] systemd[1884]: Stopped Create User Files and Directories. worker2 # [ 330.613905] systemd[1884]: Removed slice User Application Slice. worker2 # [ 330.615362] systemd[1884]: Reached target Shutdown. worker2 # [ 330.616823] systemd[1884]: Finished Exit the Session. worker2 # [ 330.618029] systemd[1884]: Reached target Exit the Session. worker2 # [ 330.629799] systemd-logind[515]: Removed session 38. worker2 # [ 330.637509] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 330.643224] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 330.658682] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 330.697475] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 330.702436] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 330.707703] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 333.702833] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 333.710956] systemd[1]: Started SSH per-connection Daemon (vsock:2:38). client # [ 333.825327] sshd-session[1647]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 333.836234] sshd-session[1647]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 333.849888] sshd-session[1647]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 333.860479] systemd-logind[427]: New session '48' of user 'root' with class 'user' and type 'tty'. client # [ 333.869138] systemd[1]: Started Session 48 of User root. worker1 # [ 334.039439] nix-grpc-daemon[485]: ts=2026-11-12T09:23:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:43336 lb # [ 335.346473] garage[898]: 2026-11-12T09:23:57.104833Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/8czw0g7az5a6hghghx5mk0m9byhg8nwp.narinfo lb # [ 335.346931] garage[898]: 2026-11-12T09:23:57.105290Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 334.051939] nix-grpc-daemon[485]: ts=2026-11-12T09:23:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:43336 worker1 # [ 334.062097] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 334.211619] nix-daemon[1059]: accepted connection from pid 2056, user nix-grpc-daemon (trusted) worker1 # [ 334.234381] nix-daemon[1059]: reaped child process 2059, status = succeeded lb # [ 335.540567] niks3-server[1454]: 2026/11/12 09:23:57 INFO Received push request method=POST path=/api/pushes worker1 # [ 334.250372] nix-grpc-daemon[1104]: time=2026-11-12T09:23:58.043Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 334.252332] nix-grpc-daemon[1104]: time=2026-11-12T09:23:58.043Z level=INFO msg="Uploading 8czw0g7az5a6hghghx5mk0m9byhg8nwp-local-input-lostnar (120B)" lb # [ 335.550443] garage[898]: 2026-11-12T09:23:57.309857Z INFO garage_api_common::generic_server: 192.168.1.3:39520 PUT /farm/8czw0g7az5a6hghghx5mk0m9byhg8nwp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092357Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9924ca32dada98c6c6dafea8d373dc878d857317d22e6a1cf82437252412b862 lb # [ 335.558450] garage[898]: 2026-11-12T09:23:57.310306Z INFO garage_api_common::generic_server: 192.168.1.3:39522 PUT /farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092357Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=74ae27c5ef404f8f0aba39e9c7cb47ac56995fe500ceb7be9e03641b8a868983 worker1 # [ 334.266498] nix-grpc-daemon[1104]: time=2026-11-12T09:23:58.060Z level=INFO msg="Uploading 1 narinfos" lb # [ 335.575225] garage[898]: 2026-11-12T09:23:57.325934Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst lb # [ 335.578562] garage[898]: 2026-11-12T09:23:57.326394Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/8czw0g7az5a6hghghx5mk0m9byhg8nwp.ls worker1 # [ 334.282312] nix-grpc-daemon[1104]: time=2026-11-12T09:23:58.076Z level=INFO msg="Upload complete. (205ms)" lb # [ 335.581887] garage[898]: 2026-11-12T09:23:57.326580Z INFO garage_api_common::generic_server: 192.168.1.3:39522 PUT /farm/8czw0g7az5a6hghghx5mk0m9byhg8nwp.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092357Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f152689312165b654d11fc9c7f49f95436d26dd7215f4568493f40d497ea0475 lb # [ 335.587918] garage[898]: 2026-11-12T09:23:57.332187Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/8czw0g7az5a6hghghx5mk0m9byhg8nwp.narinfo worker1 # [ 334.288927] nix-grpc-daemon[485]: ts=2026-11-12T09:23:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:43336 duration_s=0 paths=1 nar_bytes_in=120 lb # [ 335.590976] niks3-server[1454]: 2026/11/12 09:23:57 INFO Received sign narinfos request method=POST path=/api/pushes/34/sign lb # [ 335.592612] niks3-server[1454]: 2026/11/12 09:23:57 INFO Signed narinfos id=34 count=1 lb # [ 335.593694] niks3-server[1454]: 2026/11/12 09:23:57 INFO Registered completed upload object_key=nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst lb # [ 335.595697] niks3-server[1454]: 2026/11/12 09:23:57 INFO Received complete push request method=POST path=/api/pushes/34/complete lb # [ 335.597386] niks3-server[1454]: 2026/11/12 09:23:57 INFO Registered completed upload object_key=8czw0g7az5a6hghghx5mk0m9byhg8nwp.ls lb # [ 335.598983] niks3-server[1454]: 2026/11/12 09:23:57 INFO Registered completed upload object_key=8czw0g7az5a6hghghx5mk0m9byhg8nwp.narinfo worker1 # [ 334.300412] nix-daemon[1059]: reaped child process 2054, status = succeeded lb # [ 335.600703] niks3-server[1454]: 2026/11/12 09:23:57 INFO Completed push id=34 objects=3 duration=12.34078ms client # [ 334.306444] sshd-session[1653]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 334.309767] sshd-session[1653]: Disconnected from user root UNKNOWN port 65535 client # [ 334.311826] sshd-session[1647]: pam_unix(sshd:session): session closed for user root client # [ 334.318530] systemd[1]: sshd-vsock@38-39-3:22-2:38.service: Deactivated successfully. client # [ 334.327524] systemd[1]: session-48.scope: Deactivated successfully. client # [ 334.330744] systemd[1]: session-48.scope: Consumed 152ms CPU time over 461ms wall clock time, 29.6M memory peak, 7.2K incoming IP traffic, 6K outgoing IP traffic. client # [ 334.340666] systemd-logind[427]: Session 48 logged out. Waiting for processes to exit. client # [ 334.342569] systemd-logind[427]: Removed session 48. lb # [ 336.057310] systemd[1]: Stopping User Manager for UID 0... lb # [ 336.062287] systemd[1609]: Activating special unit Exit the Session... lb # [ 336.071226] systemd[1609]: Stopped target Main User Target. lb # [ 336.074785] systemd[1609]: Stopped target Basic System. lb # [ 336.076275] systemd[1609]: Stopped target Paths. lb # [ 336.077510] systemd[1609]: Stopped target Sockets. lb # [ 336.078647] systemd[1609]: Stopped target Timers. lb # [ 336.079765] systemd[1609]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 336.082604] systemd[1609]: Closed D-Bus User Message Bus Socket. lb # [ 336.084448] systemd[1609]: Stopped Create User Files and Directories. lb # [ 336.085920] systemd[1609]: Removed slice User Application Slice. lb # [ 336.087335] systemd[1609]: Reached target Shutdown. lb # [ 336.088656] systemd[1609]: Finished Exit the Session. lb # [ 336.089845] systemd[1609]: Reached target Exit the Session. lb # [ 336.105857] systemd-logind[499]: Removed session 38. lb # [ 336.113582] systemd[1]: user@0.service: Deactivated successfully. lb # [ 336.116890] systemd[1]: Stopped User Manager for UID 0. lb # [ 336.182123] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 336.219477] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 336.225246] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 336.229161] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 336.290278] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 336.296569] systemd[2023]: Activating special unit Exit the Session... worker1 # [ 336.303399] systemd[2023]: Stopped target Main User Target. worker1 # [ 336.306499] systemd[2023]: Stopped target Basic System. worker1 # [ 336.307886] systemd[2023]: Stopped target Paths. worker1 # [ 336.310284] systemd[2023]: Stopped target Sockets. worker1 # [ 336.311479] systemd[2023]: Stopped target Timers. worker1 # [ 336.312896] systemd[2023]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 336.314537] systemd[2023]: Closed D-Bus User Message Bus Socket. worker1 # [ 336.315987] systemd[2023]: Stopped Create User Files and Directories. client # [ 336.313302] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 336.318455] systemd[2023]: Removed slice User Application Slice. worker1 # [ 336.319873] systemd[2023]: Reached target Shutdown. worker1 # [ 336.321213] systemd[2023]: Finished Exit the Session. worker1 # [ 336.322370] systemd[2023]: Reached target Exit the Session. client # [ 336.322033] systemd[1]: Started SSH per-connection Daemon (vsock:2:39). worker1 # [ 336.349700] systemd-logind[539]: Removed session 51. worker1 # [ 336.357470] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 336.362688] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 336.378010] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 336.420959] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 336.417951] sshd-session[1667]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 336.424726] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 336.430796] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 336.427685] sshd-session[1667]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 336.436480] sshd-session[1667]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 336.445455] systemd-logind[427]: New session '49' of user 'root' with class 'user' and type 'tty'. client # [ 336.456584] systemd[1]: Started Session 49 of User root. client # [ 336.636656] sshd-session[1673]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 336.638103] sshd-session[1673]: Disconnected from user root UNKNOWN port 65535 client # [ 336.639852] sshd-session[1667]: pam_unix(sshd:session): session closed for user root client # [ 336.644434] systemd[1]: sshd-vsock@39-40-3:22-2:39.service: Deactivated successfully. client # [ 336.649848] systemd[1]: session-49.scope: Deactivated successfully. client # [ 336.654128] systemd-logind[427]: Session 49 logged out. Waiting for processes to exit. client # [ 336.656962] systemd-logind[427]: Removed session 49. worker1 # [ 336.865591] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 336.873470] systemd[1]: Started SSH per-connection Daemon (vsock:2:44). worker1 # [ 336.976684] sshd-session[2065]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 336.987667] sshd-session[2065]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 336.996953] sshd-session[2065]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 337.014472] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 337.029713] systemd-logind[539]: New session '53' of user 'root' with class 'user' and type 'tty'. worker1 # [ 337.053955] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 337.062665] systemd[1]: Starting User Manager for UID 0... worker1 # [ 337.090851] (systemd)[2073]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 337.098748] systemd-logind[539]: New session '54' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 337.188529] systemd[2073]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 337.289635] systemd[2073]: Queued start job for default target Main User Target. worker1 # [ 337.297146] systemd[2073]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 337.301633] systemd[2073]: Created slice User Application Slice. worker1 # [ 337.302713] systemd[2073]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 337.303822] systemd[2073]: Reached target Paths. worker1 # [ 337.307949] systemd[2073]: Reached target Timers. worker1 # [ 337.310346] systemd[2073]: Starting D-Bus User Message Bus Socket... worker1 # [ 337.311376] systemd[2073]: Starting Create User Files and Directories... worker1 # [ 337.357980] systemd[2073]: Finished Create User Files and Directories. worker1 # [ 337.362655] systemd[2073]: Listening on D-Bus User Message Bus Socket. worker1 # [ 337.366481] systemd[2073]: Reached target Sockets. worker1 # [ 337.367392] systemd[2073]: Reached target Basic System. worker1 # [ 337.370009] systemd[2073]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 337.371598] systemd[2073]: Reached target Main User Target. worker1 # [ 337.372659] systemd[2073]: Startup finished in 248ms. worker1 # [ 337.373719] systemd[1]: Started User Manager for UID 0. worker1 # [ 337.376661] systemd[1]: Started Session 53 of User root. worker1 # [ 337.578643] sshd-session[2086]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 337.580744] sshd-session[2086]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 337.583104] sshd-session[2065]: pam_unix(sshd:session): session closed for user root worker1 # [ 337.588268] systemd[1]: sshd-vsock@44-45-5:22-2:44.service: Deactivated successfully. worker1 # [ 337.593891] systemd[1]: session-53.scope: Deactivated successfully. worker1 # [ 337.598636] systemd-logind[539]: Session 53 logged out. Waiting for processes to exit. worker1 # [ 337.602026] systemd-logind[539]: Removed session 53. lb # [ 339.065839] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 339.073705] systemd[1]: Started SSH per-connection Daemon (vsock:2:29). lb # [ 339.171109] sshd-session[1632]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 339.179493] sshd-session[1632]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 339.190795] sshd-session[1632]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 339.220514] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 339.252876] systemd-logind[499]: New session '39' of user 'root' with class 'user' and type 'tty'. lb # [ 339.271765] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 339.279449] systemd[1]: Starting User Manager for UID 0... lb # [ 339.306175] (systemd)[1641]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 339.312458] systemd-logind[499]: New session '40' of user 'root' with class 'manager-early' and type 'unspecified'. [e2e] heartbeat t=240s lb # [ 339.402328] systemd[1641]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 339.501414] systemd[1641]: Queued start job for default target Main User Target. lb # [ 339.509047] systemd[1641]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 339.512311] systemd[1641]: Created slice User Application Slice. lb # [ 339.515709] systemd[1641]: Started Daily Cleanup of User's Temporary Directories. lb # [ 339.518874] systemd[1641]: Reached target Paths. lb # [ 339.519649] systemd[1641]: Reached target Timers. lb # [ 339.522215] systemd[1641]: Starting D-Bus User Message Bus Socket... lb # [ 339.523203] systemd[1641]: Starting Create User Files and Directories... lb # [ 339.567659] systemd[1641]: Finished Create User Files and Directories. lb # [ 339.572290] systemd[1641]: Listening on D-Bus User Message Bus Socket. lb # [ 339.575203] systemd[1641]: Reached target Sockets. lb # [ 339.578380] systemd[1641]: Reached target Basic System. lb # [ 339.579310] systemd[1641]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 339.580912] systemd[1641]: Reached target Main User Target. lb # [ 339.581719] systemd[1641]: Startup finished in 245ms. lb # [ 339.582474] systemd[1]: Started User Manager for UID 0. lb # [ 339.586660] systemd[1]: Started Session 39 of User root. lb # [ 339.627146] garage[898]: 2026-11-12T09:24:01.386196Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/8czw0g7az5a6hghghx5mk0m9byhg8nwp.narinfo lb # [ 339.631449] garage[898]: 2026-11-12T09:24:01.390479Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/8czw0g7az5a6hghghx5mk0m9byhg8nwp.narinfo lb # [ 339.660247] garage[898]: 2026-11-12T09:24:01.419905Z INFO garage_api_common::generic_server: 127.0.0.1:53740 (key GK0123456789abcdef01234567) DELETE /farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst lb # [ 339.685029] garage[898]: 2026-11-12T09:24:01.444538Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst lb # [ 339.688917] garage[898]: 2026-11-12T09:24:01.444915Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 339.697131] sshd-session[1654]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 339.698591] sshd-session[1654]: Disconnected from user root UNKNOWN port 65535 lb # [ 339.700616] sshd-session[1632]: pam_unix(sshd:session): session closed for user root lb # [ 339.704976] systemd[1]: sshd-vsock@29-30-4:22-2:29.service: Deactivated successfully. lb # [ 339.709822] systemd[1]: session-39.scope: Deactivated successfully. lb # [ 339.711568] systemd[1]: session-39.scope: Consumed 71ms CPU time over 126ms wall clock time, 8.1M memory peak, 1.6K incoming IP traffic, 1.8K outgoing IP traffic. lb # [ 339.717270] systemd-logind[499]: Session 39 logged out. Waiting for processes to exit. lb # [ 339.719758] systemd-logind[499]: Removed session 39. worker1 # [ 338.542516] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 338.550410] systemd[1]: Started SSH per-connection Daemon (vsock:2:45). worker1 # [ 338.650955] sshd-session[2093]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 338.660990] sshd-session[2093]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 338.669953] sshd-session[2093]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 338.679143] systemd-logind[539]: New session '55' of user 'root' with class 'user' and type 'tty'. worker1 # [ 338.685351] systemd[1]: Started Session 55 of User root. worker1 # [ 338.718685] sshd-session[2099]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 338.721492] sshd-session[2099]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 338.722886] sshd-session[2093]: pam_unix(sshd:session): session closed for user root worker1 # [ 338.727761] systemd[1]: sshd-vsock@45-46-5:22-2:45.service: Deactivated successfully. worker1 # [ 338.733051] systemd[1]: session-55.scope: Deactivated successfully. worker1 # [ 338.734686] systemd[1]: session-55.scope: Consumed 27ms CPU time over 49ms wall clock time, 5.1M memory peak, 19.6K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 338.740218] systemd-logind[539]: Session 55 logged out. Waiting for processes to exit. worker1 # [ 338.742524] systemd-logind[539]: Removed session 55. worker2 # [ 337.357450] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 337.367101] systemd[1]: Started SSH per-connection Daemon (vsock:2:30). worker2 # [ 337.465714] sshd-session[1907]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 337.474357] sshd-session[1907]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 337.484641] sshd-session[1907]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 337.506483] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 337.516664] systemd-logind[515]: New session '39' of user 'root' with class 'user' and type 'tty'. worker2 # [ 337.550957] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 337.559343] systemd[1]: Starting User Manager for UID 0... worker2 # [ 337.588406] (systemd)[1915]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 337.595386] systemd-logind[515]: New session '40' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 337.694687] systemd[1915]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 337.800310] systemd[1915]: Queued start job for default target Main User Target. worker2 # [ 337.809070] systemd[1915]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 337.813307] systemd[1915]: Created slice User Application Slice. worker2 # [ 337.814387] systemd[1915]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 337.815466] systemd[1915]: Reached target Paths. worker2 # [ 337.818778] systemd[1915]: Reached target Timers. worker2 # [ 337.819580] systemd[1915]: Starting D-Bus User Message Bus Socket... worker2 # [ 337.822896] systemd[1915]: Starting Create User Files and Directories... worker2 # [ 337.868882] systemd[1915]: Finished Create User Files and Directories. worker2 # [ 337.873728] systemd[1915]: Listening on D-Bus User Message Bus Socket. worker2 # [ 337.876280] systemd[1915]: Reached target Sockets. worker2 # [ 337.877142] systemd[1915]: Reached target Basic System. worker2 # [ 337.877974] systemd[1915]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 337.882710] systemd[1915]: Reached target Main User Target. worker2 # [ 337.883628] systemd[1915]: Startup finished in 261ms. worker2 # [ 337.884517] systemd[1]: Started User Manager for UID 0. worker2 # [ 337.889345] systemd[1]: Started Session 39 of User root. worker2 # [ 337.923060] sshd-session[1928]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 337.925943] sshd-session[1928]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 337.927248] sshd-session[1907]: pam_unix(sshd:session): session closed for user root worker2 # [ 337.932202] systemd[1]: sshd-vsock@30-31-6:22-2:30.service: Deactivated successfully. worker2 # [ 337.937660] systemd[1]: session-39.scope: Deactivated successfully. worker2 # [ 337.940863] systemd[1]: session-39.scope: Consumed 27ms CPU time over 50ms wall clock time, 4.8M memory peak, 11.6K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 337.946373] systemd-logind[515]: Session 39 logged out. Waiting for processes to exit. worker2 # [ 337.947638] systemd-logind[515]: Removed session 39. client # [ 340.009587] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 340.017877] systemd[1]: Started SSH per-connection Daemon (vsock:2:40). client # [ 340.113392] sshd-session[1680]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 340.122817] sshd-session[1680]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 340.131959] sshd-session[1680]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 340.141277] systemd-logind[427]: New session '50' of user 'root' with class 'user' and type 'tty'. client # [ 340.152634] systemd[1]: Started Session 50 of User root. worker1 # [ 340.332376] nix-grpc-daemon[485]: ts=2026-11-12T09:24:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36426 worker2 # [ 338.782999] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 341.643441] garage[898]: 2026-11-12T09:24:03.401782Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/8czw0g7az5a6hghghx5mk0m9byhg8nwp.narinfo worker2 # [ 338.801626] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 341.650973] garage[898]: 2026-11-12T09:24:03.409129Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/d7ka0sszspq3x50bicbh5cf1qabsf8nq.narinfo lb # [ 341.651229] garage[898]: 2026-11-12T09:24:03.409547Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 341.651333] garage[898]: 2026-11-12T09:24:03.409709Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) GET /farm/8czw0g7az5a6hghghx5mk0m9byhg8nwp.narinfo lb # [ 341.651397] garage[898]: 2026-11-12T09:24:03.410008Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/xxvaqdwcbizmqhi4hsgk6dby3naii5gb.narinfo lb # [ 341.651449] garage[898]: 2026-11-12T09:24:03.410182Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 341.660870] garage[898]: 2026-11-12T09:24:03.420272Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/xxvaqdwcbizmqhi4hsgk6dby3naii5gb.narinfo lb # [ 341.685649] garage[898]: 2026-11-12T09:24:03.420700Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 341.691523] garage[898]: 2026-11-12T09:24:03.444523Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/d7ka0sszspq3x50bicbh5cf1qabsf8nq.narinfo lb # [ 341.696963] garage[898]: 2026-11-12T09:24:03.444895Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 338.848697] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 341.701397] garage[898]: 2026-11-12T09:24:03.450151Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/d7ka0sszspq3x50bicbh5cf1qabsf8nq.narinfo lb # [ 341.705760] garage[898]: 2026-11-12T09:24:03.450532Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 341.712717] garage[898]: 2026-11-12T09:24:03.450648Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/xxvaqdwcbizmqhi4hsgk6dby3naii5gb.narinfo lb # [ 341.717941] garage[898]: 2026-11-12T09:24:03.450933Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 341.722552] garage[898]: 2026-11-12T09:24:03.469906Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r.narinfo worker2 # [ 338.871565] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 341.727134] garage[898]: 2026-11-12T09:24:03.470318Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 341.730613] garage[898]: 2026-11-12T09:24:03.471005Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3.narinfo worker2 # [ 338.881419] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 341.735409] garage[898]: 2026-11-12T09:24:03.471253Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 341.738533] garage[898]: 2026-11-12T09:24:03.471682Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/a5z4rvwdd5vpif5jpr68xjazm7799462.narinfo lb # [ 341.742530] garage[898]: 2026-11-12T09:24:03.471918Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 338.903892] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 339.036428] nix-daemon[976]: accepted connection from pid 1939, user nix-grpc-daemon (trusted) lb # [ 341.913634] niks3-server[1454]: 2026/11/12 09:24:03 INFO Received push request method=POST path=/api/pushes worker2 # [ 339.064189] nix-daemon[976]: reaped child process 1942, status = succeeded worker2 # [ 339.071872] nix-grpc-daemon[1723]: time=2026-11-12T09:24:04.343Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker2 # [ 339.073968] nix-grpc-daemon[1723]: time=2026-11-12T09:24:04.343Z level=INFO msg="Uploading nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r-local-input-lostnar.drv (456B)" worker2 # [ 339.075890] nix-grpc-daemon[1723]: time=2026-11-12T09:24:04.343Z level=INFO msg="Uploading k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3-uses-input-lostnarvip.drv (608B)" worker2 # [ 339.078107] nix-grpc-daemon[1723]: time=2026-11-12T09:24:04.343Z level=INFO msg="Uploading a5z4rvwdd5vpif5jpr68xjazm7799462-uses-input-lostnarw2.drv (608B)" worker2 # [ 339.094653] nix-grpc-daemon[1723]: time=2026-11-12T09:24:04.367Z level=INFO msg="Uploading 3 narinfos" lb # [ 341.925361] garage[898]: 2026-11-12T09:24:03.684734Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/nar/1h5ilsra315pmg0jlkwf7g173nrkiqcps9p3s5h7hdh4f0xvg11b.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092403Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a1835b391f008cae3497103a23cb27dc80b2c644c300aff584121927d818fb21 lb # [ 341.953326] garage[898]: 2026-11-12T09:24:03.695579Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/a5z4rvwdd5vpif5jpr68xjazm7799462.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092403Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0188272fca4b702dd5ec6da5e46290f6335db8800043ef38388b876a2b162a19 lb # [ 341.974855] garage[898]: 2026-11-12T09:24:03.695994Z INFO garage_api_common::generic_server: 192.168.1.4:54250 PUT /farm/nar/0d521r17h9z81c0ls3p1hc7h03hx6k4bb10fw1p4jygzy3cy9wk8.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092403Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d7813ed7791199b7e0f11a93d8845e634435130f8e1777809e139b1e511baee4 lb # [ 341.990915] garage[898]: 2026-11-12T09:24:03.696378Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/nar/1fy3xsbq8d9pr5cvgvsrxmcgn5q294j4yn7n9kiygbx7ljdic2hh.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092403Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b196ce5a9f2187ed875ab79810fcb4b38f48328d5222b6a56a541f3bcc4929ad worker2 # [ 339.146133] nix-grpc-daemon[1723]: time=2026-11-12T09:24:04.419Z level=INFO msg="Upload complete. (232ms)" lb # [ 342.002134] garage[898]: 2026-11-12T09:24:03.696612Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092403Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=474c578dce0b3ddd465ed805d1c6a0ef1ae28353a33bfa1ba1386d438cfca692 lb # [ 342.009571] niks3-server[1454]: 2026/11/12 09:24:03 INFO Received sign narinfos request method=POST path=/api/pushes/35/sign worker2 # [ 339.156003] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 paths=3 nar_bytes_in=1672 lb # [ 342.011682] niks3-server[1454]: 2026/11/12 09:24:03 INFO Registered completed upload object_key=nar/1h5ilsra315pmg0jlkwf7g173nrkiqcps9p3s5h7hdh4f0xvg11b.nar.zst lb # [ 342.014903] niks3-server[1454]: 2026/11/12 09:24:03 INFO Signed narinfos id=35 count=3 lb # [ 342.017350] niks3-server[1454]: 2026/11/12 09:24:03 INFO Registered completed upload object_key=nar/1fy3xsbq8d9pr5cvgvsrxmcgn5q294j4yn7n9kiygbx7ljdic2hh.nar.zst worker2 # [ 339.165804] nix-daemon[976]: reaped child process 1935, status = succeeded lb # [ 342.020324] niks3-server[1454]: 2026/11/12 09:24:03 INFO Registered completed upload object_key=nar/0d521r17h9z81c0ls3p1hc7h03hx6k4bb10fw1p4jygzy3cy9wk8.nar.zst lb # [ 342.023001] niks3-server[1454]: 2026/11/12 09:24:03 INFO Registered completed upload object_key=a5z4rvwdd5vpif5jpr68xjazm7799462.ls lb # [ 342.027064] niks3-server[1454]: 2026/11/12 09:24:03 INFO Registered completed upload object_key=nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r.ls worker1 # [ 340.725824] nix-grpc-daemon[485]: ts=2026-11-12T09:24:04Z level=debug event=want client=14 drv=a5z4rvwdd5vpif5jpr68xjazm7799462-uses-input-lostnarw2.drv cached=0 lb # [ 342.030165] niks3-server[1454]: 2026/11/12 09:24:03 INFO Received complete push request method=POST path=/api/pushes/35/complete lb # [ 342.032611] niks3-server[1454]: 2026/11/12 09:24:03 INFO Completed push id=35 objects=9 duration=14.38654ms worker2 # [ 339.177752] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 342.034177] niks3-server[1454]: 2026/11/12 09:24:03 INFO Registered completed upload object_key=k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3.ls lb # [ 342.036144] niks3-server[1454]: 2026/11/12 09:24:03 INFO Registered completed upload object_key=a5z4rvwdd5vpif5jpr68xjazm7799462.narinfo lb # [ 342.038019] niks3-server[1454]: 2026/11/12 09:24:03 INFO Registered completed upload object_key=k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3.narinfo worker1 # [ 340.737876] nix-grpc-daemon[485]: ts=2026-11-12T09:24:04Z level=debug event=assigned drv=a5z4rvwdd5vpif5jpr68xjazm7799462-uses-input-lostnarw2.drv worker=192.168.1.4:50051 clients=1 lb # [ 342.039937] niks3-server[1454]: 2026/11/12 09:24:03 INFO Registered completed upload object_key=nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r.narinfo worker2 # [ 339.187772] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 342.042107] garage[898]: 2026-11-12T09:24:03.696903Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092403Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2a6ad559e229d774f987bb8755d53c44cb2671f8a4a26c827ec95f9e285e22cc worker1 # [ 340.748538] nix-grpc-daemon[485]: ts=2026-11-12T09:24:04Z level=debug event=want client=14 drv=k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3-uses-input-lostnarvip.drv cached=0 lb # [ 342.048831] garage[898]: 2026-11-12T09:24:03.700267Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/nar/1h5ilsra315pmg0jlkwf7g173nrkiqcps9p3s5h7hdh4f0xvg11b.nar.zst lb # [ 342.052104] garage[898]: 2026-11-12T09:24:03.707691Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nar/1fy3xsbq8d9pr5cvgvsrxmcgn5q294j4yn7n9kiygbx7ljdic2hh.nar.zst worker2 # [ 339.199293] nix-grpc-daemon[1487]: copying path '/nix/store/8czw0g7az5a6hghghx5mk0m9byhg8nwp-local-input-lostnar' from 'http://lb:5751'... worker1 # [ 340.754285] nix-grpc-daemon[485]: ts=2026-11-12T09:24:04Z level=debug event=assigned drv=k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3-uses-input-lostnarvip.drv worker=192.168.1.3:50051 clients=1 lb # [ 342.055877] garage[898]: 2026-11-12T09:24:03.708337Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r.ls worker1 # [ 340.758780] nix-grpc-daemon[485]: ts=2026-11-12T09:24:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 342.062030] garage[898]: 2026-11-12T09:24:03.708587Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/a5z4rvwdd5vpif5jpr68xjazm7799462.ls worker1 # [ 340.763556] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 342.065155] garage[898]: 2026-11-12T09:24:03.708825Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/0d521r17h9z81c0ls3p1hc7h03hx6k4bb10fw1p4jygzy3cy9wk8.nar.zst worker2 # [ 339.209697] nix-grpc-daemon[1487]: warning: file 'nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst' does not exist in binary cache 'http://lb:5751' worker1 # [ 340.770464] nix-grpc-daemon[485]: ts=2026-11-12T09:24:04Z level=debug event=assigned drv=a5z4rvwdd5vpif5jpr68xjazm7799462-uses-input-lostnarw2.drv worker=192.168.1.4:50051 clients=1 lb # [ 342.071209] garage[898]: 2026-11-12T09:24:03.709069Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092403Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0e78d750d29ac761b28d1023d95b907eb162c444583d3677c2fb3f3c02bb10ec worker1 # [ 340.777264] nix-grpc-daemon[485]: copying path '/nix/store/nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r-local-input-lostnar.drv' from 'http://lb:5751'... worker2 # [ 339.227113] nix-daemon[976]: reaped child process 1945, status = succeeded lb # [ 342.079318] garage[898]: 2026-11-12T09:24:03.722184Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092403Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cb8ceb707997c3ced73641e2df7cd02b60955e853ad79df87210599f5ff94c0f worker1 # [ 340.785522] nix-grpc-daemon[485]: ts=2026-11-12T09:24:04Z level=debug event=want client=14 drv=nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r-local-input-lostnar.drv cached=0 lb # [ 342.087295] garage[898]: 2026-11-12T09:24:03.723088Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/a5z4rvwdd5vpif5jpr68xjazm7799462.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092403Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4ffd74e3ae449b0c6206955456cf133d154a87efd59bb69ea92ed07450e84e96 lb # [ 342.093161] garage[898]: 2026-11-12T09:24:03.733695Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r.narinfo worker1 # [ 340.794286] nix-grpc-daemon[485]: copying path '/nix/store/k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3-uses-input-lostnarvip.drv' from 'http://lb:5751'... lb # [ 342.095787] garage[898]: 2026-11-12T09:24:03.734262Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3.ls lb # [ 342.098535] garage[898]: 2026-11-12T09:24:03.743674Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3.narinfo lb # [ 342.101423] garage[898]: 2026-11-12T09:24:03.748354Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/a5z4rvwdd5vpif5jpr68xjazm7799462.narinfo worker1 # [ 340.802529] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 342.104072] garage[898]: 2026-11-12T09:24:03.816206Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3.narinfo lb # [ 342.106785] garage[898]: 2026-11-12T09:24:03.820528Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) GET /farm/k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3.narinfo lb # [ 342.109481] garage[898]: 2026-11-12T09:24:03.821295Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst lb # [ 342.112612] garage[898]: 2026-11-12T09:24:03.821501Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 342.114634] garage[898]: 2026-11-12T09:24:03.829664Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r.narinfo lb # [ 342.119212] garage[898]: 2026-11-12T09:24:03.830618Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) GET /farm/nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r.narinfo worker1 # [ 340.821042] nix-grpc-daemon[485]: copying path '/nix/store/8czw0g7az5a6hghghx5mk0m9byhg8nwp-local-input-lostnar' from 'http://lb:5751'... lb # [ 342.122069] garage[898]: 2026-11-12T09:24:03.838120Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/nar/1h5ilsra315pmg0jlkwf7g173nrkiqcps9p3s5h7hdh4f0xvg11b.nar.zst lb # [ 342.125119] garage[898]: 2026-11-12T09:24:03.838775Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) GET /farm/nar/1h5ilsra315pmg0jlkwf7g173nrkiqcps9p3s5h7hdh4f0xvg11b.nar.zst lb # [ 342.129047] garage[898]: 2026-11-12T09:24:03.845922Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/nar/0d521r17h9z81c0ls3p1hc7h03hx6k4bb10fw1p4jygzy3cy9wk8.nar.zst worker1 # [ 340.830527] nix-grpc-daemon[485]: warning: file 'nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst' does not exist in binary cache 'http://lb:5751' lb # [ 342.131970] garage[898]: 2026-11-12T09:24:03.846547Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) GET /farm/nar/0d521r17h9z81c0ls3p1hc7h03hx6k4bb10fw1p4jygzy3cy9wk8.nar.zst lb # [ 342.135989] garage[898]: 2026-11-12T09:24:03.878004Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/8czw0g7az5a6hghghx5mk0m9byhg8nwp.narinfo worker1 # [ 340.836830] nix-grpc-daemon[485]: ts=2026-11-12T09:24:04Z level=debug event=assigned drv=k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3-uses-input-lostnarvip.drv worker=192.168.1.3:50051 clients=1 lb # [ 342.139325] garage[898]: 2026-11-12T09:24:03.878601Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) GET /farm/8czw0g7az5a6hghghx5mk0m9byhg8nwp.narinfo lb # [ 342.142311] garage[898]: 2026-11-12T09:24:03.888513Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst lb # [ 342.145593] garage[898]: 2026-11-12T09:24:03.888816Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 340.849169] nix-grpc-daemon[485]: ts=2026-11-12T09:24:04Z level=debug event=assigned drv=nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r-local-input-lostnar.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 340.854292] nix-grpc-daemon[485]: ts=2026-11-12T09:24:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 340.866034] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 340.871546] nix-daemon[1059]: reaped child process 2111, status = succeeded worker1 # [ 340.882510] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 343.326341] garage[898]: 2026-11-12T09:24:05.085068Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst lb # [ 343.326514] garage[898]: 2026-11-12T09:24:05.085530Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 342.302096] nix-grpc-daemon[485]: ts=2026-11-12T09:24:06Z level=info event=niks3_push_started pid=2134 worker1 # [ 342.340690] nix-daemon[1059]: reaped child process 2117, status = succeeded worker1 # [ 342.474243] nix-grpc-daemon[2134]: time=2026-11-12T09:24:06.267Z level=INFO msg="Configuring client TLS" cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker1.pem key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker1.key ca="" worker1 # [ 342.591061] nix-daemon[1059]: accepted connection from pid 2145, user nix-grpc-daemon (trusted) worker1 # [ 342.615774] nix-daemon[1059]: reaped child process 2150, status = succeeded lb # [ 343.924697] niks3-server[1454]: 2026/11/12 09:24:05 INFO Received push request method=POST path=/api/pushes lb # [ 343.934787] garage[898]: 2026-11-12T09:24:05.694081Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst lb # [ 343.941550] garage[898]: 2026-11-12T09:24:05.694530Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 342.644115] nix-grpc-daemon[2134]: time=2026-11-12T09:24:06.435Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 342.645814] nix-grpc-daemon[2134]: time=2026-11-12T09:24:06.436Z level=INFO msg="Uploading 8czw0g7az5a6hghghx5mk0m9byhg8nwp-local-input-lostnar (120B)" lb # [ 343.945248] garage[898]: 2026-11-12T09:24:05.699982Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/8czw0g7az5a6hghghx5mk0m9byhg8nwp.ls lb # [ 343.949388] garage[898]: 2026-11-12T09:24:05.700521Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/8czw0g7az5a6hghghx5mk0m9byhg8nwp.narinfo lb # [ 343.956538] niks3-server[1454]: 2026/11/12 09:24:05 INFO Object in database but missing from S3 key=nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst lb # [ 343.959733] niks3-server[1454]: 2026/11/12 09:24:05 WARN Found objects in DB but missing from S3, will re-upload count=1 lb # [ 343.972705] garage[898]: 2026-11-12T09:24:05.715330Z INFO garage_api_common::generic_server: 192.168.1.3:53700 PUT /farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092405Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8580e9361b8ac41b1cc7e52a1157726c93ac4260f17331d1f9f5ace331bba753 worker1 # [ 342.683705] nix-grpc-daemon[2134]: time=2026-11-12T09:24:06.477Z level=INFO msg="Upload complete. (205ms)" lb # [ 343.983870] garage[898]: 2026-11-12T09:24:05.715957Z INFO garage_api_common::generic_server: 192.168.1.3:53684 PUT /farm/log/nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r-local-input-lostnar.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092405Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bd12145bf5b84e59b8b5e3a01187ae4a551115adb937cde8ad1b8f1fde4f4bf3 worker1 # [ 342.690813] nix-grpc-daemon[485]: ts=2026-11-12T09:24:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=1 drv=nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r-local-input-lostnar.drv assign_id=25 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 343.994430] garage[898]: 2026-11-12T09:24:05.725439Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst lb # [ 343.999690] garage[898]: 2026-11-12T09:24:05.731783Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/log/nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r-local-input-lostnar.drv worker1 # [ 342.706909] nix-daemon[1059]: reaped child process 2115, status = succeeded lb # [ 344.005868] niks3-server[1454]: 2026/11/12 09:24:05 INFO Received complete push request method=POST path=/api/pushes/36/complete lb # [ 344.008768] niks3-server[1454]: 2026/11/12 09:24:05 INFO Registered completed upload object_key=nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst lb # [ 344.014039] niks3-server[1454]: 2026/11/12 09:24:05 INFO Completed push id=36 objects=4 duration=14.59202ms worker1 # [ 342.714385] nix-grpc-daemon[485]: ts=2026-11-12T09:24:06Z level=debug event=want client=14 drv=a5z4rvwdd5vpif5jpr68xjazm7799462-uses-input-lostnarw2.drv cached=0 lb # [ 344.016277] niks3-server[1454]: 2026/11/12 09:24:05 INFO Registered completed upload object_key=log/nd82h4ndkxfwzsw4ck9hnbm83gp7jw6r-local-input-lostnar.drv worker1 # [ 342.718184] nix-grpc-daemon[485]: ts=2026-11-12T09:24:06Z level=debug event=assigned drv=a5z4rvwdd5vpif5jpr68xjazm7799462-uses-input-lostnarw2.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 341.169932] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 worker1 # [ 342.725133] nix-grpc-daemon[485]: ts=2026-11-12T09:24:06Z level=debug event=want client=14 drv=k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3-uses-input-lostnarvip.drv cached=0 worker1 # [ 342.727867] nix-grpc-daemon[485]: ts=2026-11-12T09:24:06Z level=debug event=assigned drv=k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3-uses-input-lostnarvip.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 341.180124] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker1 # [ 342.735433] nix-grpc-daemon[485]: ts=2026-11-12T09:24:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 342.741756] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker2 # [ 341.190197] nix-grpc-daemon[1487]: copying path '/nix/store/8czw0g7az5a6hghghx5mk0m9byhg8nwp-local-input-lostnar' from 'http://lb:5751'... worker1 # [ 342.749564] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 344.049454] garage[898]: 2026-11-12T09:24:05.808865Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst lb # [ 344.056260] garage[898]: 2026-11-12T09:24:05.815097Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) GET /farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst worker2 # [ 341.209063] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 344.350482] garage[898]: 2026-11-12T09:24:06.109124Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/xxvaqdwcbizmqhi4hsgk6dby3naii5gb.narinfo lb # [ 344.355676] garage[898]: 2026-11-12T09:24:06.109560Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 341.845973] nix-daemon[976]: reaped child process 1952, status = succeeded worker2 # [ 341.971704] nix-daemon[976]: accepted connection from pid 1968, user nix-grpc-daemon (trusted) lb # [ 344.846467] niks3-server[1454]: 2026/11/12 09:24:06 INFO Received push request method=POST path=/api/pushes worker2 # [ 341.998828] nix-daemon[976]: reaped child process 1971, status = succeeded worker2 # [ 342.001585] nix-grpc-daemon[1723]: time=2026-11-12T09:24:07.273Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 344.855125] garage[898]: 2026-11-12T09:24:06.614512Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/xxvaqdwcbizmqhi4hsgk6dby3naii5gb.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092406Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2bc3cd8d9974475119a787eaf27a2093a84bd6763b0f53a83eebcdb4edc28697 worker2 # [ 342.015449] nix-grpc-daemon[1723]: time=2026-11-12T09:24:07.288Z level=INFO msg="Uploading 1 narinfos" lb # [ 344.875960] garage[898]: 2026-11-12T09:24:06.625320Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/log/a5z4rvwdd5vpif5jpr68xjazm7799462-uses-input-lostnarw2.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092406Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6d91d8ebd5f0175679b04a80416c987585a4d3d7c27561301190ddb49c422b68 lb # [ 344.886852] garage[898]: 2026-11-12T09:24:06.628587Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/xxvaqdwcbizmqhi4hsgk6dby3naii5gb.ls lb # [ 344.893055] garage[898]: 2026-11-12T09:24:06.629183Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/xxvaqdwcbizmqhi4hsgk6dby3naii5gb.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092406Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=47bc4ea3719a0443e52f3b104247fcf504dd89fb368bf63ec55e7f4515d3da57 worker2 # [ 342.049095] nix-grpc-daemon[1723]: time=2026-11-12T09:24:07.322Z level=INFO msg="Upload complete. (224ms)" lb # [ 344.903281] garage[898]: 2026-11-12T09:24:06.634030Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/xxvaqdwcbizmqhi4hsgk6dby3naii5gb.narinfo lb # [ 344.909749] garage[898]: 2026-11-12T09:24:06.634551Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/log/a5z4rvwdd5vpif5jpr68xjazm7799462-uses-input-lostnarw2.drv lb # [ 344.914762] niks3-server[1454]: 2026/11/12 09:24:06 INFO Received sign narinfos request method=POST path=/api/pushes/37/sign lb # [ 344.917961] niks3-server[1454]: 2026/11/12 09:24:06 INFO Signed narinfos id=37 count=1 lb # [ 344.919729] niks3-server[1454]: 2026/11/12 09:24:06 INFO Received complete push request method=POST path=/api/pushes/37/complete worker2 # [ 342.056207] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 drv=a5z4rvwdd5vpif5jpr68xjazm7799462-uses-input-lostnarw2.drv assign_id=26 outputs=1 inputs=1 inputs_fetched=1 input_bytes=120 input_s=0 lb # [ 344.922372] niks3-server[1454]: 2026/11/12 09:24:06 INFO Registered completed upload object_key=xxvaqdwcbizmqhi4hsgk6dby3naii5gb.ls worker2 # [ 342.071554] nix-daemon[976]: reaped child process 1949, status = succeeded lb # [ 344.925727] niks3-server[1454]: 2026/11/12 09:24:06 INFO Registered completed upload object_key=xxvaqdwcbizmqhi4hsgk6dby3naii5gb.narinfo lb # [ 344.928377] niks3-server[1454]: 2026/11/12 09:24:06 INFO Completed push id=37 objects=4 duration=29.7106ms lb # [ 344.930312] niks3-server[1454]: 2026/11/12 09:24:06 INFO Registered completed upload object_key=log/a5z4rvwdd5vpif5jpr68xjazm7799462-uses-input-lostnarw2.drv lb # [ 345.316259] garage[898]: 2026-11-12T09:24:07.075535Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/d7ka0sszspq3x50bicbh5cf1qabsf8nq.narinfo lb # [ 345.321001] garage[898]: 2026-11-12T09:24:07.075964Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 344.408459] nix-daemon[1059]: reaped child process 2157, status = succeeded worker1 # [ 344.510142] nix-daemon[1059]: accepted connection from pid 2173, user nix-grpc-daemon (trusted) lb # [ 345.833109] niks3-server[1454]: 2026/11/12 09:24:07 INFO Received push request method=POST path=/api/pushes worker1 # [ 344.537621] nix-daemon[1059]: reaped child process 2176, status = succeeded worker1 # [ 344.542002] nix-grpc-daemon[1104]: time=2026-11-12T09:24:08.334Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 345.842975] garage[898]: 2026-11-12T09:24:07.601613Z INFO garage_api_common::generic_server: 192.168.1.3:39520 PUT /farm/log/k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3-uses-input-lostnarvip.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092407Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d4464483388eec3f697b792ac3b582227f31a28eea238c5170521cdf9f0ae8d6 worker1 # [ 344.558234] nix-grpc-daemon[1104]: time=2026-11-12T09:24:08.351Z level=INFO msg="Uploading 1 narinfos" lb # [ 345.867431] garage[898]: 2026-11-12T09:24:07.612247Z INFO garage_api_common::generic_server: 192.168.1.3:39522 PUT /farm/d7ka0sszspq3x50bicbh5cf1qabsf8nq.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092407Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=43110dda7610587ee97c9ec0d19629347215c25e6bb5e2d408be9c330ad5a911 lb # [ 345.878859] garage[898]: 2026-11-12T09:24:07.615713Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/d7ka0sszspq3x50bicbh5cf1qabsf8nq.ls worker1 # [ 344.585022] nix-grpc-daemon[1104]: time=2026-11-12T09:24:08.378Z level=INFO msg="Upload complete. (225ms)" lb # [ 345.883911] garage[898]: 2026-11-12T09:24:07.617857Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/log/k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3-uses-input-lostnarvip.drv worker1 # [ 344.592698] nix-grpc-daemon[485]: ts=2026-11-12T09:24:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=1 drv=k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3-uses-input-lostnarvip.drv assign_id=27 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 345.890577] garage[898]: 2026-11-12T09:24:07.618378Z INFO garage_api_common::generic_server: 192.168.1.3:39522 PUT /farm/d7ka0sszspq3x50bicbh5cf1qabsf8nq.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092407Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b8f7d6fb7df5996c039276d1bbe16420e881672712400f4ecdb4f7a1d7596339 lb # [ 345.900263] garage[898]: 2026-11-12T09:24:07.624044Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/d7ka0sszspq3x50bicbh5cf1qabsf8nq.narinfo lb # [ 345.904792] niks3-server[1454]: 2026/11/12 09:24:07 INFO Received sign narinfos request method=POST path=/api/pushes/38/sign worker1 # [ 344.607789] nix-daemon[1059]: reaped child process 2155, status = succeeded lb # [ 345.907721] niks3-server[1454]: 2026/11/12 09:24:07 INFO Signed narinfos id=38 count=1 lb # [ 345.910351] niks3-server[1454]: 2026/11/12 09:24:07 INFO Received complete push request method=POST path=/api/pushes/38/complete lb # [ 345.913081] niks3-server[1454]: 2026/11/12 09:24:07 INFO Registered completed upload object_key=d7ka0sszspq3x50bicbh5cf1qabsf8nq.ls lb # [ 345.915688] niks3-server[1454]: 2026/11/12 09:24:07 INFO Registered completed upload object_key=log/k3zq1jbxj2hv40pcnbz3xdpwhgadzpf3-uses-input-lostnarvip.drv lb # [ 345.918873] niks3-server[1454]: 2026/11/12 09:24:07 INFO Registered completed upload object_key=d7ka0sszspq3x50bicbh5cf1qabsf8nq.narinfo lb # [ 345.921415] niks3-server[1454]: 2026/11/12 09:24:07 INFO Completed push id=38 objects=4 duration=23.28662ms client # [ 344.633457] sshd-session[1686]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 344.633674] sshd-session[1686]: Disconnected from user root UNKNOWN port 65535 client # [ 344.638658] sshd-session[1680]: pam_unix(sshd:session): session closed for user root client # [ 344.645277] systemd[1]: sshd-vsock@40-41-3:22-2:40.service: Deactivated successfully. client # [ 344.653768] systemd[1]: session-50.scope: Deactivated successfully. client # [ 344.658063] systemd[1]: session-50.scope: Consumed 201ms CPU time over 4.503s wall clock time, 42M memory peak, 13.1K incoming IP traffic, 15.5K outgoing IP traffic. client # [ 344.666581] systemd-logind[427]: Session 50 logged out. Waiting for processes to exit. client # [ 344.668720] systemd-logind[427]: Removed session 50. lb # [ 346.328244] envoy[897]: conn peer=[2001:db8:1::1]:58790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=8399 tx=4556 ms=4290 worker1 # [ 346.081578] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 346.090025] systemd[1]: Started SSH per-connection Daemon (vsock:2:46). worker1 # [ 346.189634] sshd-session[2178]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 346.199658] sshd-session[2178]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 346.209035] sshd-session[2178]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 346.220471] systemd-logind[539]: New session '56' of user 'root' with class 'user' and type 'tty'. worker1 # [ 346.229160] systemd[1]: Started Session 56 of User root. worker1 # [ 346.269507] sshd-session[2184]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 346.272349] sshd-session[2184]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 346.274329] sshd-session[2178]: pam_unix(sshd:session): session closed for user root worker1 # [ 346.278978] systemd[1]: sshd-vsock@46-47-5:22-2:46.service: Deactivated successfully. worker1 # [ 346.284623] systemd[1]: session-56.scope: Deactivated successfully. worker1 # [ 346.286364] systemd[1]: session-56.scope: Consumed 30ms CPU time over 57ms wall clock time, 5.1M memory peak, 19.7K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 346.292275] systemd-logind[539]: Session 56 logged out. Waiting for processes to exit. worker1 # [ 346.294371] systemd-logind[539]: Removed session 56. worker2 # [ 344.913007] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 344.918621] systemd[1]: Started SSH per-connection Daemon (vsock:2:31). worker2 # [ 345.013417] sshd-session[1973]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 345.022819] sshd-session[1973]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 345.031329] sshd-session[1973]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 345.040454] systemd-logind[515]: New session '41' of user 'root' with class 'user' and type 'tty'. worker2 # [ 345.047214] systemd[1]: Started Session 41 of User root. worker2 # [ 345.078017] sshd-session[1979]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 345.080489] sshd-session[1979]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 345.082443] sshd-session[1973]: pam_unix(sshd:session): session closed for user root worker2 # [ 345.086488] systemd[1]: sshd-vsock@31-32-6:22-2:31.service: Deactivated successfully. worker2 # [ 345.091533] systemd[1]: session-41.scope: Deactivated successfully. worker2 # [ 345.093481] systemd[1]: session-41.scope: Consumed 26ms CPU time over 48ms wall clock time, 3.1M memory peak, 12.8K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 345.098615] systemd-logind[515]: Session 41 logged out. Waiting for processes to exit. worker2 # [ 345.101246] systemd-logind[515]: Removed session 41. ok test farm::serial::balancer_auth_client_cert_token_nothing_unknown_cn ... worker1 # [ 346.679212] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 346.687478] systemd[1]: Started SSH per-connection Daemon (vsock:2:47). worker1 # [ 346.785307] sshd-session[2189]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 346.795666] sshd-session[2189]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 346.805583] sshd-session[2189]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 346.816135] systemd-logind[539]: New session '57' of user 'root' with class 'user' and type 'tty'. worker1 # [ 346.824563] systemd[1]: Started Session 57 of User root. worker1 # [ 346.860181] sshd-session[2195]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 346.861795] sshd-session[2195]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 346.863488] sshd-session[2189]: pam_unix(sshd:session): session closed for user root worker1 # [ 346.868137] systemd[1]: sshd-vsock@47-48-5:22-2:47.service: Deactivated successfully. worker1 # [ 346.874351] systemd[1]: session-57.scope: Deactivated successfully. worker1 # [ 346.879586] systemd-logind[539]: Session 57 logged out. Waiting for processes to exit. worker1 # [ 346.882923] systemd-logind[539]: Removed session 57. worker2 # [ 345.853915] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 345.866112] systemd[1]: Started SSH per-connection Daemon (vsock:2:32). worker2 # [ 345.972624] sshd-session[1984]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 345.982906] sshd-session[1984]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 345.992237] sshd-session[1984]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 346.003700] systemd-logind[515]: New session '42' of user 'root' with class 'user' and type 'tty'. worker2 # [ 346.009024] systemd[1]: Started Session 42 of User root. worker2 # [ 346.044638] sshd-session[1990]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 346.047795] sshd-session[1990]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 346.050013] sshd-session[1984]: pam_unix(sshd:session): session closed for user root worker2 # [ 346.054303] systemd[1]: sshd-vsock@32-33-6:22-2:32.service: Deactivated successfully. worker2 # [ 346.060679] systemd[1]: session-42.scope: Deactivated successfully. worker2 # [ 346.065797] systemd-logind[515]: Session 42 logged out. Waiting for processes to exit. worker2 # [ 346.069358] systemd-logind[515]: Removed session 42. lb # [ 349.220170] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 349.224092] systemd[1]: Started SSH per-connection Daemon (vsock:2:30). lb # [ 349.325073] sshd-session[1676]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 349.335597] sshd-session[1676]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 349.345495] sshd-session[1676]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 349.355363] systemd-logind[499]: New session '41' of user 'root' with class 'user' and type 'tty'. lb # [ 349.362926] systemd[1]: Started Session 41 of User root. lb # [ 349.397725] sshd-session[1682]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 349.400585] sshd-session[1682]: Disconnected from user root UNKNOWN port 65535 lb # [ 349.402896] sshd-session[1676]: pam_unix(sshd:session): session closed for user root lb # [ 349.407183] systemd[1]: sshd-vsock@30-31-4:22-2:30.service: Deactivated successfully. lb # [ 349.414880] systemd[1]: session-41.scope: Deactivated successfully. lb # [ 349.418552] systemd[1]: session-41.scope: Consumed 29ms CPU time over 56ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 349.423923] systemd-logind[499]: Session 41 logged out. Waiting for processes to exit. lb # [ 349.425328] systemd-logind[499]: Removed session 41. worker1 # [ 348.503888] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 348.507885] systemd[1]: Started SSH per-connection Daemon (vsock:2:48). worker1 # [ 348.609585] sshd-session[2201]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 348.618840] sshd-session[2201]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 348.627515] sshd-session[2201]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 348.636522] systemd-logind[539]: New session '58' of user 'root' with class 'user' and type 'tty'. worker1 # [ 348.649726] systemd[1]: Started Session 58 of User root. worker1 # [ 348.688002] sshd-session[2207]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 348.690525] sshd-session[2207]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 348.692860] sshd-session[2201]: pam_unix(sshd:session): session closed for user root worker1 # [ 348.697137] systemd[1]: sshd-vsock@48-49-5:22-2:48.service: Deactivated successfully. worker1 # [ 348.702351] systemd[1]: session-58.scope: Deactivated successfully. worker1 # [ 348.705920] systemd[1]: session-58.scope: Consumed 29ms CPU time over 55ms wall clock time, 6.8M memory peak, 19.7K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 348.710684] systemd-logind[539]: Session 58 logged out. Waiting for processes to exit. worker1 # [ 348.711900] systemd-logind[539]: Removed session 58. client # [ 349.088099] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 349.091767] systemd[1]: Started SSH per-connection Daemon (vsock:2:41). client # [ 349.188470] sshd-session[1704]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 349.196681] sshd-session[1704]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 349.204597] sshd-session[1704]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 349.213309] systemd-logind[427]: New session '51' of user 'root' with class 'user' and type 'tty'. client # [ 349.224589] systemd[1]: Started Session 51 of User root. client # [ 349.263490] sshd-session[1710]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 349.267174] sshd-session[1710]: Disconnected from user root UNKNOWN port 65535 client # [ 349.268960] sshd-session[1704]: pam_unix(sshd:session): session closed for user root client # [ 349.273913] systemd[1]: sshd-vsock@41-42-3:22-2:41.service: Deactivated successfully. client # [ 349.280431] systemd[1]: session-51.scope: Deactivated successfully. client # [ 349.285274] systemd-logind[427]: Session 51 logged out. Waiting for processes to exit. client # [ 349.288627] systemd-logind[427]: Removed session 51. client # [ 349.898519] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 349.905951] systemd[1]: Started SSH per-connection Daemon (vsock:2:42). client # [ 350.004606] sshd-session[1715]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 350.013312] sshd-session[1715]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 350.021273] sshd-session[1715]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 350.031808] systemd-logind[427]: New session '52' of user 'root' with class 'user' and type 'tty'. client # [ 350.036556] systemd[1]: Started Session 52 of User root. worker2 # [ 348.649760] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 351.511047] garage[898]: 2026-11-12T09:24:13.269233Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/65qxpij1lpr90li04q3cg5lk7x3rhgwh.narinfo lb # [ 351.511400] garage[898]: 2026-11-12T09:24:13.269721Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 350.224725] nix-grpc-daemon[485]: ts=2026-11-12T09:24:14Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 351.529757] garage[898]: 2026-11-12T09:24:13.289193Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/65qxpij1lpr90li04q3cg5lk7x3rhgwh.narinfo lb # [ 351.534980] garage[898]: 2026-11-12T09:24:13.289638Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 350.236741] nix-grpc-daemon[485]: ts=2026-11-12T09:24:14Z level=debug event=path_info_miss path=65qxpij1lpr90li04q3cg5lk7x3rhgwh-nixos-system-client-test error="error: path '/nix/store/65qxpij1lpr90li04q3cg5lk7x3rhgwh-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 350.245273] nix-grpc-daemon[485]: ts=2026-11-12T09:24:14Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36426 lb # [ 351.546159] garage[898]: 2026-11-12T09:24:13.305551Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/65qxpij1lpr90li04q3cg5lk7x3rhgwh.narinfo lb # [ 351.551269] garage[898]: 2026-11-12T09:24:13.305986Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 350.252945] nix-grpc-daemon[485]: ts=2026-11-12T09:24:14Z level=debug event=path_info_miss path=65qxpij1lpr90li04q3cg5lk7x3rhgwh-nixos-system-client-test error="error: path '/nix/store/65qxpij1lpr90li04q3cg5lk7x3rhgwh-nixos-system-client-test' is required, but there is no substituter that can build it" client # [ 350.277736] sshd-session[1721]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 350.281630] sshd-session[1721]: Disconnected from user root UNKNOWN port 65535 client # [ 350.283719] sshd-session[1715]: pam_unix(sshd:session): session closed for user root client # [ 350.290168] systemd[1]: sshd-vsock@42-43-3:22-2:42.service: Deactivated successfully. client # [ 350.297856] systemd[1]: session-52.scope: Deactivated successfully. client # [ 350.302783] systemd[1]: session-52.scope: Consumed 158ms CPU time over 263ms wall clock time, 27.6M memory peak, 5.9K incoming IP traffic, 4.4K outgoing IP traffic. client # [ 350.308859] systemd-logind[427]: Session 52 logged out. Waiting for processes to exit. client # [ 350.310402] systemd-logind[427]: Removed session 52. client # [ 351.415878] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 351.424198] systemd[1]: Started SSH per-connection Daemon (vsock:2:43). client # [ 351.528715] sshd-session[1735]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 351.539309] sshd-session[1735]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 351.549025] sshd-session[1735]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 351.559280] systemd-logind[427]: New session '53' of user 'root' with class 'user' and type 'tty'. client # [ 351.564708] systemd[1]: Started Session 53 of User root. client # [ 351.627822] sshd-session[1741]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 351.630969] sshd-session[1741]: Disconnected from user root UNKNOWN port 65535 client # [ 351.632463] sshd-session[1735]: pam_unix(sshd:session): session closed for user root client # [ 351.636996] systemd[1]: sshd-vsock@43-44-3:22-2:43.service: Deactivated successfully. client # [ 351.642690] systemd[1]: session-53.scope: Deactivated successfully. client # [ 351.645916] systemd[1]: session-53.scope: Consumed 38ms CPU time over 79ms wall clock time, 8.5M memory peak, 1001B incoming IP traffic, 560B outgoing IP traffic. client # [ 351.650975] systemd-logind[427]: Session 53 logged out. Waiting for processes to exit. client # [ 351.652553] systemd-logind[427]: Removed session 53. client # [ 352.070530] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 352.079885] systemd[1]: Started SSH per-connection Daemon (vsock:2:44). client # [ 352.174729] sshd-session[1749]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 352.185051] sshd-session[1749]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 352.194549] sshd-session[1749]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 352.207427] systemd-logind[427]: New session '54' of user 'root' with class 'user' and type 'tty'. client # [ 352.213641] systemd[1]: Started Session 54 of User root. client # [ 352.247663] sshd-session[1755]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 352.251027] sshd-session[1755]: Disconnected from user root UNKNOWN port 65535 client # [ 352.252797] sshd-session[1749]: pam_unix(sshd:session): session closed for user root client # [ 352.258305] systemd[1]: sshd-vsock@44-45-3:22-2:44.service: Deactivated successfully. client # [ 352.264554] systemd[1]: session-54.scope: Deactivated successfully. client # [ 352.269498] systemd-logind[427]: Session 54 logged out. Waiting for processes to exit. client # [ 352.272894] systemd-logind[427]: Removed session 54. client # [ 352.304598] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 352.311484] systemd[1]: Started SSH per-connection Daemon (vsock:2:45). client # [ 352.400848] sshd-session[1760]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 352.409918] sshd-session[1760]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 352.417217] sshd-session[1760]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 352.425382] systemd-logind[427]: New session '55' of user 'root' with class 'user' and type 'tty'. client # [ 352.437145] systemd[1]: Started Session 55 of User root. client # [ 352.462358] sshd-session[1766]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 352.463810] sshd-session[1766]: Disconnected from user root UNKNOWN port 65535 client # [ 352.465848] sshd-session[1760]: pam_unix(sshd:session): session closed for user root client # [ 352.470106] systemd[1]: sshd-vsock@45-46-3:22-2:45.service: Deactivated successfully. client # [ 352.474481] systemd[1]: session-55.scope: Deactivated successfully. client # [ 352.479179] systemd-logind[427]: Session 55 logged out. Waiting for processes to exit. client # [ 352.481757] systemd-logind[427]: Removed session 55. client # [ 352.604129] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 352.612871] systemd[1]: Started SSH per-connection Daemon (vsock:2:46). client # [ 352.700675] sshd-session[1771]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 352.710215] sshd-session[1771]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 352.718076] sshd-session[1771]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 352.727724] systemd-logind[427]: New session '56' of user 'root' with class 'user' and type 'tty'. client # [ 352.735077] systemd[1]: Started Session 56 of User root. client # [ 352.758019] sshd-session[1777]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 352.760817] sshd-session[1777]: Disconnected from user root UNKNOWN port 65535 client # [ 352.762938] sshd-session[1771]: pam_unix(sshd:session): session closed for user root client # [ 352.767108] systemd[1]: sshd-vsock@46-47-3:22-2:46.service: Deactivated successfully. client # [ 352.773321] systemd[1]: session-56.scope: Deactivated successfully. client # [ 352.778345] systemd-logind[427]: Session 56 logged out. Waiting for processes to exit. client # [ 352.781186] systemd-logind[427]: Removed session 56. client # [ 352.890103] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 352.898672] systemd[1]: Started SSH per-connection Daemon (vsock:2:47). client # [ 352.999656] sshd-session[1782]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 353.009942] sshd-session[1782]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 353.019015] sshd-session[1782]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 353.027680] systemd-logind[427]: New session '57' of user 'root' with class 'user' and type 'tty'. client # [ 353.032443] systemd[1]: Started Session 57 of User root. worker2 # [ 351.651007] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:16Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 351.654371] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:16Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:48140 lb # [ 354.510105] garage[898]: 2026-11-12T09:24:16.268571Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/65qxpij1lpr90li04q3cg5lk7x3rhgwh.narinfo lb # [ 354.510348] garage[898]: 2026-11-12T09:24:16.269025Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 353.224519] nix-grpc-daemon[485]: ts=2026-11-12T09:24:17Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:36426 lb # [ 354.529909] garage[898]: 2026-11-12T09:24:16.289350Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/65qxpij1lpr90li04q3cg5lk7x3rhgwh.narinfo lb # [ 354.535243] garage[898]: 2026-11-12T09:24:16.289786Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 353.236572] nix-grpc-daemon[485]: ts=2026-11-12T09:24:17Z level=debug event=path_info_miss path=65qxpij1lpr90li04q3cg5lk7x3rhgwh-nixos-system-client-test error="error: path '/nix/store/65qxpij1lpr90li04q3cg5lk7x3rhgwh-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 351.689496] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:16Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:48140 lb # [ 354.550877] garage[898]: 2026-11-12T09:24:16.310120Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/65qxpij1lpr90li04q3cg5lk7x3rhgwh.narinfo lb # [ 354.555929] garage[898]: 2026-11-12T09:24:16.310559Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 351.704235] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:16Z level=debug event=path_info_miss path=65qxpij1lpr90li04q3cg5lk7x3rhgwh-nixos-system-client-test error="error: path '/nix/store/65qxpij1lpr90li04q3cg5lk7x3rhgwh-nixos-system-client-test' is required, but there is no substituter that can build it" client # [ 353.279811] sshd-session[1788]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 353.283727] sshd-session[1788]: Disconnected from user root UNKNOWN port 65535 client # [ 353.285675] sshd-session[1782]: pam_unix(sshd:session): session closed for user root client # [ 353.291281] systemd[1]: sshd-vsock@47-48-3:22-2:47.service: Deactivated successfully. client # [ 353.298672] systemd[1]: session-57.scope: Deactivated successfully. client # [ 353.303166] systemd[1]: session-57.scope: Consumed 160ms CPU time over 268ms wall clock time, 27.8M memory peak, 4.2K incoming IP traffic, 5K outgoing IP traffic. client # [ 353.308862] systemd-logind[427]: Session 57 logged out. Waiting for processes to exit. client # [ 353.310266] systemd-logind[427]: Removed session 57. client # [ 354.282173] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 354.291323] systemd[1]: Started SSH per-connection Daemon (vsock:2:48). client # [ 354.459082] sshd-session[1808]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 354.467846] sshd-session[1808]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 354.475499] sshd-session[1808]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 354.487372] systemd-logind[427]: New session '58' of user 'root' with class 'user' and type 'tty'. client # [ 354.493642] systemd[1]: Started Session 58 of User root. client # [ 354.522635] sshd-session[1814]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 354.525464] sshd-session[1814]: Disconnected from user root UNKNOWN port 65535 client # [ 354.527445] sshd-session[1808]: pam_unix(sshd:session): session closed for user root client # [ 354.532384] systemd[1]: sshd-vsock@48-49-3:22-2:48.service: Deactivated successfully. client # [ 354.538499] systemd[1]: session-58.scope: Deactivated successfully. client # [ 354.543798] systemd-logind[427]: Session 58 logged out. Waiting for processes to exit. client # [ 354.546513] systemd-logind[427]: Removed session 58. client # [ 354.676440] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 354.685863] systemd[1]: Started SSH per-connection Daemon (vsock:2:49). client # [ 354.790197] sshd-session[1819]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 354.798904] sshd-session[1819]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 354.806491] sshd-session[1819]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 354.815094] systemd-logind[427]: New session '59' of user 'root' with class 'user' and type 'tty'. client # [ 354.820618] systemd[1]: Started Session 59 of User root. client # [ 354.846279] sshd-session[1825]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 354.849348] sshd-session[1825]: Disconnected from user root UNKNOWN port 65535 client # [ 354.850718] sshd-session[1819]: pam_unix(sshd:session): session closed for user root client # [ 354.855705] systemd[1]: sshd-vsock@49-50-3:22-2:49.service: Deactivated successfully. client # [ 354.862050] systemd[1]: session-59.scope: Deactivated successfully. client # [ 354.867381] systemd-logind[427]: Session 59 logged out. Waiting for processes to exit. client # [ 354.870407] systemd-logind[427]: Removed session 59. client # [ 355.004338] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 355.011143] systemd[1]: Started SSH per-connection Daemon (vsock:2:50). lb # [ 356.326366] envoy[897]: conn peer=[2001:db8:1::1]:49016 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=364 ms=64 lb # [ 356.326769] envoy[897]: conn peer=[2001:db8:1::1]:41726 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=71 client # [ 355.091395] sshd-session[1830]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 355.099593] sshd-session[1830]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 355.107023] sshd-session[1830]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 355.115273] systemd-logind[427]: New session '60' of user 'root' with class 'user' and type 'tty'. client # [ 355.120923] systemd[1]: Started Session 60 of User root. worker1 # [ 355.286794] nix-grpc-daemon[485]: ts=2026-11-12T09:24:19Z level=info event=denied method=QueryMissing cn=- role=none client # [ 355.301970] sshd-session[1836]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 355.304891] sshd-session[1836]: Disconnected from user root UNKNOWN port 65535 client # [ 355.306351] sshd-session[1830]: pam_unix(sshd:session): session closed for user root client # [ 355.311718] systemd[1]: sshd-vsock@50-51-3:22-2:50.service: Deactivated successfully. client # [ 355.317135] systemd[1]: session-60.scope: Deactivated successfully. client # [ 355.319029] systemd[1]: session-60.scope: Consumed 154ms CPU time over 197ms wall clock time, 25.6M memory peak, 3.7K incoming IP traffic, 2.6K outgoing IP traffic. client # [ 355.325764] systemd-logind[427]: Session 60 logged out. Waiting for processes to exit. client # [ 355.327070] systemd-logind[427]: Removed session 60. client # [ 355.421988] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 355.429720] systemd[1]: Started SSH per-connection Daemon (vsock:2:51). client # [ 355.531449] sshd-session[1850]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 355.540948] sshd-session[1850]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 355.549087] sshd-session[1850]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 355.560310] systemd-logind[427]: New session '61' of user 'root' with class 'user' and type 'tty'. client # [ 355.564554] systemd[1]: Started Session 61 of User root. client # [ 355.586865] sshd-session[1856]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 355.589669] sshd-session[1856]: Disconnected from user root UNKNOWN port 65535 client # [ 355.591052] sshd-session[1850]: pam_unix(sshd:session): session closed for user root client # [ 355.595252] systemd[1]: sshd-vsock@51-52-3:22-2:51.service: Deactivated successfully. client # [ 355.600701] systemd[1]: session-61.scope: Deactivated successfully. client # [ 355.604934] systemd-logind[427]: Session 61 logged out. Waiting for processes to exit. client # [ 355.606937] systemd-logind[427]: Removed session 61. client # [ 355.755568] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 355.763396] systemd[1]: Started SSH per-connection Daemon (vsock:2:52). client # [ 355.856881] sshd-session[1861]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 355.865905] sshd-session[1861]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 355.874808] sshd-session[1861]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 355.883568] systemd-logind[427]: New session '62' of user 'root' with class 'user' and type 'tty'. client # [ 355.889409] systemd[1]: Started Session 62 of User root. worker1 # [ 356.052115] nix-grpc-daemon[485]: ts=2026-11-12T09:24:19Z level=info event=denied method=QueryMissing cn=stranger role=none client # [ 356.070624] sshd-session[1867]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 356.073430] sshd-session[1867]: Disconnected from user root UNKNOWN port 65535 client # [ 356.074701] sshd-session[1861]: pam_unix(sshd:session): session closed for user root client # [ 356.079640] systemd[1]: sshd-vsock@52-53-3:22-2:52.service: Deactivated successfully. client # [ 356.084843] systemd[1]: session-62.scope: Deactivated successfully. client # [ 356.086555] systemd[1]: session-62.scope: Consumed 151ms CPU time over 197ms wall clock time, 25.6M memory peak, 5.3K incoming IP traffic, 3.8K outgoing IP traffic. client # [ 356.093308] systemd-logind[427]: Session 62 logged out. Waiting for processes to exit. client # [ 356.094515] systemd-logind[427]: Removed session 62. ok test farm::serial::clean_scheduler_restart_peers_are_told_and_running_builds_survive ... worker1 # [ 356.241449] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 356.250168] systemd[1]: Started SSH per-connection Daemon (vsock:2:49). worker1 # [ 356.344936] sshd-session[2212]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 356.352844] sshd-session[2212]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 356.363068] sshd-session[2212]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 356.374347] systemd-logind[539]: New session '59' of user 'root' with class 'user' and type 'tty'. worker1 # [ 356.380563] systemd[1]: Started Session 59 of User root. worker1 # [ 356.412965] sshd-session[2218]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 356.415632] sshd-session[2218]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 356.417107] sshd-session[2212]: pam_unix(sshd:session): session closed for user root worker1 # [ 356.421234] systemd[1]: sshd-vsock@49-50-5:22-2:49.service: Deactivated successfully. worker1 # [ 356.426680] systemd[1]: session-59.scope: Deactivated successfully. worker1 # [ 356.431220] systemd-logind[539]: Session 59 logged out. Waiting for processes to exit. worker1 # [ 356.433879] systemd-logind[539]: Removed session 59. worker2 # [ 355.223103] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 355.231471] systemd[1]: Started SSH per-connection Daemon (vsock:2:33). worker2 # [ 355.331061] sshd-session[2001]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 355.339428] sshd-session[2001]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 355.350088] sshd-session[2001]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 355.359099] systemd-logind[515]: New session '43' of user 'root' with class 'user' and type 'tty'. worker2 # [ 355.364608] systemd[1]: Started Session 43 of User root. worker2 # [ 355.396399] sshd-session[2007]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 355.399127] sshd-session[2007]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 355.400658] sshd-session[2001]: pam_unix(sshd:session): session closed for user root worker2 # [ 355.406378] systemd[1]: sshd-vsock@33-34-6:22-2:33.service: Deactivated successfully. worker2 # [ 355.412343] systemd[1]: session-43.scope: Deactivated successfully. worker2 # [ 355.417256] systemd-logind[515]: Session 43 logged out. Waiting for processes to exit. worker2 # [ 355.419941] systemd-logind[515]: Removed session 43. lb # [ 358.354751] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 358.364154] systemd[1]: Started SSH per-connection Daemon (vsock:2:31). lb # [ 358.460714] sshd-session[1687]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 358.470268] sshd-session[1687]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 358.479007] sshd-session[1687]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 358.489663] systemd-logind[499]: New session '42' of user 'root' with class 'user' and type 'tty'. lb # [ 358.496618] systemd[1]: Started Session 42 of User root. lb # [ 358.534444] sshd-session[1693]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 358.537178] sshd-session[1693]: Disconnected from user root UNKNOWN port 65535 lb # [ 358.538734] sshd-session[1687]: pam_unix(sshd:session): session closed for user root lb # [ 358.543228] systemd[1]: sshd-vsock@31-32-4:22-2:31.service: Deactivated successfully. lb # [ 358.548557] systemd[1]: session-42.scope: Deactivated successfully. lb # [ 358.550309] systemd[1]: session-42.scope: Consumed 29ms CPU time over 53ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 358.555468] systemd-logind[499]: Session 42 logged out. Waiting for processes to exit. lb # [ 358.557924] systemd-logind[499]: Removed session 42. worker1 # [ 357.544730] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 357.552540] systemd[1]: Started SSH per-connection Daemon (vsock:2:50). worker1 # [ 357.651460] sshd-session[2224]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 357.660290] sshd-session[2224]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 357.670663] sshd-session[2224]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 357.679983] systemd-logind[539]: New session '60' of user 'root' with class 'user' and type 'tty'. worker1 # [ 357.688195] systemd[1]: Started Session 60 of User root. worker1 # [ 357.721113] sshd-session[2230]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 357.722568] sshd-session[2230]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 357.724795] sshd-session[2224]: pam_unix(sshd:session): session closed for user root worker1 # [ 357.728601] systemd[1]: sshd-vsock@50-51-5:22-2:50.service: Deactivated successfully. worker1 # [ 357.734151] systemd[1]: session-60.scope: Deactivated successfully. worker1 # [ 357.736655] systemd[1]: session-60.scope: Consumed 26ms CPU time over 51ms wall clock time, 3.1M memory peak, 20.1K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 357.741446] systemd-logind[539]: Session 60 logged out. Waiting for processes to exit. worker1 # [ 357.743732] systemd-logind[539]: Removed session 60. client # [ 357.881221] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 357.889006] systemd[1]: Started SSH per-connection Daemon (vsock:2:53). client # [ 357.988341] sshd-session[1881]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 357.998534] sshd-session[1881]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 358.007968] sshd-session[1881]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 358.017671] systemd-logind[427]: New session '63' of user 'root' with class 'user' and type 'tty'. client # [ 358.028725] systemd[1]: Started Session 63 of User root. client # [ 358.067964] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.pem&client-key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.key" --eval-store auto -f /nix/store/v7sckhacjvxxq8xv667z4hgvbaqhw2dd-slow.nix --argstr tag rs. client # [ 358.082793] sshd-session[1887]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 358.084396] sshd-session[1887]: Disconnected from user root UNKNOWN port 65535 client # [ 358.086311] sshd-session[1881]: pam_unix(sshd:session): session closed for user root client # [ 358.092301] systemd[1]: sshd-vsock@53-54-3:22-2:53.service: Deactivated successfully. client # [ 358.097788] systemd[1]: session-63.scope: Deactivated successfully. client # [ 358.105495] systemd-logind[427]: Session 63 logged out. Waiting for processes to exit. client # [ 358.110318] systemd-logind[427]: Removed session 63. worker1 # [ 358.159857] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 358.168332] systemd[1]: Started SSH per-connection Daemon (vsock:2:51). worker1 # [ 358.268515] sshd-session[2235]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 358.270251] nix[1890]: don't know how to build these paths: client # [ 358.272078] nix[1890]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker1 # [ 358.276992] nix-grpc-daemon[485]: ts=2026-11-12T09:24:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36426 worker2 # [ 356.726561] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 worker1 # [ 358.282226] sshd-session[2235]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 359.587222] garage[898]: 2026-11-12T09:24:21.345408Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo lb # [ 359.587453] garage[898]: 2026-11-12T09:24:21.345915Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 358.293482] sshd-session[2235]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 356.744857] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 worker1 # [ 358.304843] systemd-logind[539]: New session '61' of user 'root' with class 'user' and type 'tty'. lb # [ 359.603858] garage[898]: 2026-11-12T09:24:21.363313Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo lb # [ 359.608953] garage[898]: 2026-11-12T09:24:21.363743Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 358.313990] systemd[1]: Started Session 61 of User root. lb # [ 359.613874] garage[898]: 2026-11-12T09:24:21.372916Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo lb # [ 359.618552] garage[898]: 2026-11-12T09:24:21.373310Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 356.772232] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 359.631457] garage[898]: 2026-11-12T09:24:21.390924Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo lb # [ 359.636615] garage[898]: 2026-11-12T09:24:21.391342Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 358.337703] nix[1890]: copying 1 paths to 'lb:50051'... client # [ 358.341040] nix[1890]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker1 # [ 358.348656] nix-grpc-daemon[485]: ts=2026-11-12T09:24:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36426 worker1 # [ 358.361293] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 358.367239] sshd-session[2241]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 358.376803] sshd-session[2241]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 358.378188] systemd[1]: sshd-vsock@51-52-5:22-2:51.service: Deactivated successfully. worker1 # [ 358.379670] sshd-session[2235]: pam_unix(sshd:session): session closed for user root worker1 # [ 358.394060] systemd[1]: session-61.scope: Deactivated successfully. worker1 # [ 358.395340] systemd-logind[539]: Session 61 logged out. Waiting for processes to exit. worker1 # [ 358.400939] systemd-logind[539]: Removed session 61. worker1 # [ 358.401746] nix-daemon[1059]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker2 # [ 356.893946] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 356.908406] systemd[1]: Started SSH per-connection Daemon (vsock:2:34). worker1 # [ 358.540494] nix-daemon[1059]: accepted connection from pid 2250, user nix-grpc-daemon (trusted) worker2 # [ 357.010909] sshd-session[2013]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 358.566524] nix-daemon[1059]: reaped child process 2253, status = succeeded lb # [ 359.870310] niks3-server[1454]: 2026/11/12 09:24:21 INFO Received push request method=POST path=/api/pushes worker2 # [ 357.020295] sshd-session[2013]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 358.577663] nix-grpc-daemon[1104]: time=2026-11-12T09:24:22.370Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 358.579527] nix-grpc-daemon[1104]: time=2026-11-12T09:24:22.370Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" worker2 # [ 357.031153] sshd-session[2013]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 359.878106] garage[898]: 2026-11-12T09:24:21.637107Z INFO garage_api_common::generic_server: 192.168.1.3:39522 PUT /farm/nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092421Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=321fb111f6a1bd4d406d7e0656817cbd2712a04207005ee5dc6473db3ad4b338 worker1 # [ 358.593764] nix-grpc-daemon[1104]: time=2026-11-12T09:24:22.387Z level=INFO msg="Uploading 1 narinfos" worker2 # [ 357.043600] systemd-logind[515]: New session '44' of user 'root' with class 'user' and type 'tty'. worker1 # [ 358.601072] nix-grpc-daemon[1104]: time=2026-11-12T09:24:22.394Z level=INFO msg="Upload complete. (192ms)" worker2 # [ 357.049413] systemd[1]: Started Session 44 of User root. worker1 # [ 358.608386] nix-grpc-daemon[485]: ts=2026-11-12T09:24:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36426 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 359.901796] garage[898]: 2026-11-12T09:24:21.637754Z INFO garage_api_common::generic_server: 192.168.1.3:39520 PUT /farm/ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092421Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=76ced98a8b2205def6e9e14b29bb8fbfa06fd7f4e9e3c9dbd9ed8cb1f4e1fbce lb # [ 359.911130] garage[898]: 2026-11-12T09:24:21.650349Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst worker1 # [ 358.616910] nix-daemon[1059]: reaped child process 2244, status = succeeded lb # [ 359.917634] garage[898]: 2026-11-12T09:24:21.653868Z INFO garage_api_common::generic_server: 192.168.1.3:39522 PUT /farm/ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092421Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c1a56c6171929075e82b5ab4e4771da488a6a26a42bd26c6167f59438a1b4c87 lb # [ 359.927725] garage[898]: 2026-11-12T09:24:21.654355Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 359.932986] garage[898]: 2026-11-12T09:24:21.658992Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker2 # [ 357.085323] sshd-session[2019]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 359.938991] niks3-server[1454]: 2026/11/12 09:24:21 INFO Received sign narinfos request method=POST path=/api/pushes/39/sign worker1 # [ 358.640176] nix-grpc-daemon[485]: ts=2026-11-12T09:24:22Z level=debug event=want client=15 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker2 # [ 357.088236] sshd-session[2019]: Disconnected from user root UNKNOWN port 65535 lb # [ 359.942128] niks3-server[1454]: 2026/11/12 09:24:21 INFO Signed narinfos id=39 count=1 worker1 # [ 358.642705] nix-grpc-daemon[485]: ts=2026-11-12T09:24:22Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 357.091322] sshd-session[2013]: pam_unix(sshd:session): session closed for user root lb # [ 359.943892] niks3-server[1454]: 2026/11/12 09:24:21 INFO Received complete push request method=POST path=/api/pushes/39/complete lb # [ 359.947421] niks3-server[1454]: 2026/11/12 09:24:21 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst worker2 # [ 357.096436] systemd[1]: sshd-vsock@34-35-6:22-2:34.service: Deactivated successfully. lb # [ 359.951505] niks3-server[1454]: 2026/11/12 09:24:21 INFO Completed push id=39 objects=3 duration=4.40952ms lb # [ 359.953840] niks3-server[1454]: 2026/11/12 09:24:21 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker2 # [ 357.101418] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 359.956610] niks3-server[1454]: 2026/11/12 09:24:21 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls worker2 # [ 357.115116] systemd[1]: session-44.scope: Deactivated successfully. worker2 # [ 357.117592] systemd-logind[515]: Session 44 logged out. Waiting for processes to exit. worker2 # [ 357.119173] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 357.125159] systemd-logind[515]: Removed session 44. worker2 # [ 357.157490] nix-grpc-daemon[1487]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' from 'http://lb:5751'... lb # [ 359.987504] garage[898]: 2026-11-12T09:24:21.746993Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo lb # [ 360.004673] garage[898]: 2026-11-12T09:24:21.763351Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) GET /farm/ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo lb # [ 360.017062] garage[898]: 2026-11-12T09:24:21.776208Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst lb # [ 360.021685] garage[898]: 2026-11-12T09:24:21.780850Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) GET /farm/nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst worker2 # [ 357.176197] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 357.187098] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) client # [ 358.736337] nix[1890]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... lb # [ 360.501894] garage[898]: 2026-11-12T09:24:22.261090Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo lb # [ 360.506808] garage[898]: 2026-11-12T09:24:22.261521Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 359.302703] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 359.311500] systemd[1]: Started SSH per-connection Daemon (vsock:2:52). worker1 # [ 359.411304] sshd-session[2257]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 359.420304] sshd-session[2257]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 359.430052] sshd-session[2257]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 359.441079] systemd-logind[539]: New session '62' of user 'root' with class 'user' and type 'tty'. worker1 # [ 359.451938] systemd[1]: Started Session 62 of User root. worker1 # [ 359.484881] sshd-session[2263]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 359.486492] sshd-session[2263]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 359.488570] sshd-session[2257]: pam_unix(sshd:session): session closed for user root worker1 # [ 359.492636] systemd[1]: sshd-vsock@52-53-5:22-2:52.service: Deactivated successfully. worker1 # [ 359.498452] systemd[1]: session-62.scope: Deactivated successfully. worker1 # [ 359.503009] systemd-logind[539]: Session 62 logged out. Waiting for processes to exit. worker1 # [ 359.505693] systemd-logind[539]: Removed session 62. worker2 # [ 358.375589] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 358.379183] systemd[1]: Started SSH per-connection Daemon (vsock:2:35). worker2 # [ 358.514704] sshd-session[2046]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 358.524221] sshd-session[2046]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 358.536350] sshd-session[2046]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 358.551706] systemd-logind[515]: New session '45' of user 'root' with class 'user' and type 'tty'. worker2 # [ 358.557211] systemd[1]: Started Session 45 of User root. worker2 # [ 358.776432] sshd-session[2052]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 358.778017] sshd-session[2052]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 358.779053] sshd-session[2046]: pam_unix(sshd:session): session closed for user root worker2 # [ 358.817219] systemd[1]: sshd-vsock@35-36-6:22-2:35.service: Deactivated successfully. worker2 # [ 358.818572] systemd[1]: session-45.scope: Deactivated successfully. worker2 # [ 358.823290] systemd-logind[515]: Session 45 logged out. Waiting for processes to exit. worker2 # [ 358.828453] systemd-logind[515]: Removed session 45. worker1 # [ 360.569359] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 360.578245] systemd[1]: Started SSH per-connection Daemon (vsock:2:53). worker1 # [ 360.674313] sshd-session[2268]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 360.683756] sshd-session[2268]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 360.692454] sshd-session[2268]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 360.703281] systemd-logind[539]: New session '63' of user 'root' with class 'user' and type 'tty'. worker1 # [ 360.708606] systemd[1]: Started Session 63 of User root. worker1 # [ 360.744902] sshd-session[2274]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 360.747639] sshd-session[2274]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 360.749103] sshd-session[2268]: pam_unix(sshd:session): session closed for user root worker1 # [ 360.753569] systemd[1]: sshd-vsock@53-54-5:22-2:53.service: Deactivated successfully. worker1 # [ 360.758581] systemd[1]: session-63.scope: Deactivated successfully. worker1 # [ 360.763729] systemd-logind[539]: Session 63 logged out. Waiting for processes to exit. worker1 # [ 360.766508] systemd-logind[539]: Removed session 63. worker2 # [ 360.050437] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 360.051872] systemd[1]: Started SSH per-connection Daemon (vsock:2:36). worker2 # [ 360.179919] sshd-session[2057]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 360.193381] sshd-session[2057]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 360.205558] sshd-session[2057]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 360.219893] systemd-logind[515]: New session '46' of user 'root' with class 'user' and type 'tty'. worker2 # [ 360.225267] systemd[1]: Started Session 46 of User root. worker2 # [ 360.420469] sshd-session[2063]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 360.421963] sshd-session[2063]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 360.423009] sshd-session[2057]: pam_unix(sshd:session): session closed for user root worker2 # [ 360.464860] systemd[1]: sshd-vsock@36-37-6:22-2:36.service: Deactivated successfully. worker2 # [ 360.466231] systemd[1]: session-46.scope: Deactivated successfully. worker2 # [ 360.471228] systemd-logind[515]: Session 46 logged out. Waiting for processes to exit. worker2 # [ 360.476210] systemd-logind[515]: Removed session 46. lb # [ 363.384189] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 363.388262] systemd[1]: Started SSH per-connection Daemon (vsock:2:32). lb # [ 363.484596] sshd-session[1700]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 363.494576] sshd-session[1700]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 363.503443] sshd-session[1700]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 363.512490] systemd-logind[499]: New session '43' of user 'root' with class 'user' and type 'tty'. lb # [ 363.525224] systemd[1]: Started Session 43 of User root. lb # [ 363.571508] sshd-session[1706]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 363.574326] sshd-session[1706]: Disconnected from user root UNKNOWN port 65535 lb # [ 363.576348] sshd-session[1700]: pam_unix(sshd:session): session closed for user root lb # [ 363.580280] systemd[1]: sshd-vsock@32-33-4:22-2:32.service: Deactivated successfully. lb # [ 363.585712] systemd[1]: session-43.scope: Deactivated successfully. lb # [ 363.587673] systemd[1]: session-43.scope: Consumed 31ms CPU time over 62ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 363.594994] systemd-logind[499]: Session 43 logged out. Waiting for processes to exit. lb # [ 363.596231] systemd-logind[499]: Removed session 43. lb # [ 363.669396] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 363.678043] systemd[1]: Started SSH per-connection Daemon (vsock:2:33). lb # [ 363.782668] sshd-session[1711]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 363.791594] sshd-session[1711]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 363.800518] sshd-session[1711]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 363.810900] systemd-logind[499]: New session '44' of user 'root' with class 'user' and type 'tty'. lb # [ 363.816548] systemd[1]: Started Session 44 of User root. lb # [ 363.851237] sshd-session[1718]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 363.853037] sshd-session[1718]: Disconnected from user root UNKNOWN port 65535 lb # [ 363.854316] sshd-session[1711]: pam_unix(sshd:session): session closed for user root lb # [ 363.858403] systemd[1]: sshd-vsock@33-34-4:22-2:33.service: Deactivated successfully. lb # [ 363.863892] systemd[1]: session-44.scope: Deactivated successfully. lb # [ 363.867301] systemd[1]: session-44.scope: Consumed 27ms CPU time over 48ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 363.871296] systemd-logind[499]: Session 44 logged out. Waiting for processes to exit. lb # [ 363.873710] systemd-logind[499]: Removed session 44. lb # [ 366.327948] envoy[897]: conn peer=[2001:db8:1::1]:41728 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=9 lb # [ 366.330618] envoy[897]: conn peer=[2001:db8:1::1]:41736 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=14 worker2 # [ 366.248600] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 366.254039] systemd[1]: Started SSH per-connection Daemon (vsock:2:37). worker2 # [ 366.391228] sshd-session[2068]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 366.405737] sshd-session[2068]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 366.415453] sshd-session[2068]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 366.431680] systemd-logind[515]: New session '47' of user 'root' with class 'user' and type 'tty'. worker2 # [ 366.437248] systemd[1]: Started Session 47 of User root. [e2e] heartbeat t=270s client # [ 368.143704] systemd[1]: Stopping User Manager for UID 0... client # [ 368.150967] systemd[1618]: Activating special unit Exit the Session... client # [ 368.156901] systemd[1618]: Stopped target Main User Target. client # [ 368.158368] systemd[1618]: Stopped target Basic System. client # [ 368.159636] systemd[1618]: Stopped target Paths. client # [ 368.164792] systemd[1618]: Stopped target Sockets. client # [ 368.166012] systemd[1618]: Stopped target Timers. client # [ 368.167154] systemd[1618]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 368.169748] systemd[1618]: Closed D-Bus User Message Bus Socket. client # [ 368.171265] systemd[1618]: Stopped Create User Files and Directories. client # [ 368.173140] systemd[1618]: Removed slice User Application Slice. client # [ 368.174526] systemd[1618]: Reached target Shutdown. client # [ 368.175737] systemd[1618]: Finished Exit the Session. client # [ 368.177042] systemd[1618]: Reached target Exit the Session. client # [ 368.197939] systemd-logind[427]: Removed session 47. client # [ 368.206479] systemd[1]: user@0.service: Deactivated successfully. client # [ 368.212411] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 366.670519] sshd-session[2074]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 366.671982] sshd-session[2074]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 366.673492] sshd-session[2068]: pam_unix(sshd:session): session closed for user root worker2 # [ 366.716485] systemd[1]: sshd-vsock@37-38-6:22-2:37.service: Deactivated successfully. worker2 # [ 366.725430] systemd[1]: session-47.scope: Deactivated successfully. worker2 # [ 366.727576] systemd-logind[515]: Session 47 logged out. Waiting for processes to exit. client # [ 368.280919] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 366.732300] systemd-logind[515]: Removed session 47. client # [ 368.316875] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 368.323635] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 368.326927] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 369.504913] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 369.512638] systemd[1]: Started SSH per-connection Daemon (vsock:2:54). worker1 # [ 369.613501] sshd-session[2279]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 369.623320] sshd-session[2279]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 369.632737] sshd-session[2279]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 369.644437] systemd-logind[539]: New session '64' of user 'root' with class 'user' and type 'tty'. worker1 # [ 369.648595] systemd[1]: Started Session 64 of User root. worker1 # [ 369.679991] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 369.683176] sshd-session[2285]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 369.685562] sshd-session[2285]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 369.686637] sshd-session[2279]: pam_unix(sshd:session): session closed for user root worker1 # [ 369.690229] systemd[1]: sshd-vsock@54-55-5:22-2:54.service: Deactivated successfully. worker1 # [ 369.695676] systemd[1]: session-64.scope: Deactivated successfully. worker1 # [ 369.701402] systemd-logind[539]: Session 64 logged out. Waiting for processes to exit. worker1 # [ 369.704489] systemd-logind[539]: Removed session 64. worker1 # [ 370.412760] nix-grpc-daemon[485]: ts=2026-11-12T09:24:34Z level=info event=draining worker1 # [ 370.415065] nix-grpc-daemon[485]: ts=2026-11-12T09:24:34Z level=info event=signal_exit lb # [ 372.370808] niks3-server[1454]: 2026/11/12 09:24:34 INFO lead: released remote=192.168.1.3:46670 worker2 # [ 370.518104] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:35Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 373.371861] envoy[897]: [2026-11-12 09:24:35.129][897][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker1 # [ 372.076534] nix-grpc-daemon[485]: ts=2026-11-12T09:24:35Z level=info event=scheduler_restarting worker1 # [ 372.079109] nix-grpc-daemon[485]: ts=2026-11-12T09:24:35Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 373.373070] envoy[897]: [2026-11-12 09:24:35.129][897][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker1 # [ 372.084443] nix-grpc-daemon[485]: ts=2026-11-12T09:24:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:46232 worker1 # [ 372.086920] nix-grpc-daemon[485]: ts=2026-11-12T09:24:35Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 372.096329] nix-grpc-daemon[485]: ts=2026-11-12T09:24:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:46232 worker1 # [ 372.098825] nix-grpc-daemon[485]: ts=2026-11-12T09:24:35Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 372.218619] nix-daemon[1059]: reaped child process 1126, status = succeeded worker1 # [ 372.221243] nix-daemon[1059]: reaped child process 1170, status = succeeded worker1 # [ 372.222375] nix-daemon[1059]: reaped child process 1207, status = succeeded worker1 # [ 372.223451] nix-daemon[1059]: reaped child process 1224, status = succeeded worker1 # [ 372.224751] nix-daemon[1059]: reaped child process 1263, status = succeeded worker1 # [ 372.225727] nix-daemon[1059]: reaped child process 1580, status = succeeded worker1 # [ 372.226773] nix-daemon[1059]: reaped child process 1987, status = succeeded worker1 # [ 372.227721] nix-daemon[1059]: reaped child process 2106, status = succeeded worker1 # [ 372.228875] nix-daemon[1059]: reaped child process 1069, status = succeeded worker1 # [ 372.229827] nix-daemon[1059]: reaped child process 1371, status = succeeded worker1 # [ 372.230792] nix-daemon[1059]: reaped child process 1819, status = succeeded worker1 # [ 372.231729] nix-daemon[1059]: reaped child process 1410, status = succeeded worker1 # [ 372.233153] nix-daemon[1059]: reaped child process 2248, status = succeeded worker1 # [ 372.234104] nix-daemon[1059]: reaped child process 1072, status = succeeded worker2 # [ 370.718406] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 370.721053] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 372.287966] nix-grpc-daemon[485]: ts=2026-11-12T09:24:36Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 372.296979] nix-grpc-daemon[485]: ts=2026-11-12T09:24:36Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 370.924595] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 370.926871] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 371.127478] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 371.129893] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 374.057748] systemd[1]: Stopping User Manager for UID 0... lb # [ 374.064097] systemd[1641]: Activating special unit Exit the Session... lb # [ 374.070662] systemd[1641]: Stopped target Main User Target. lb # [ 374.076595] systemd[1641]: Stopped target Basic System. lb # [ 374.077946] systemd[1641]: Stopped target Paths. lb # [ 374.079058] systemd[1641]: Stopped target Sockets. lb # [ 374.080579] systemd[1641]: Stopped target Timers. lb # [ 374.081715] systemd[1641]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 374.083376] systemd[1641]: Closed D-Bus User Message Bus Socket. lb # [ 374.084988] systemd[1641]: Stopped Create User Files and Directories. lb # [ 374.086524] systemd[1641]: Removed slice User Application Slice. lb # [ 374.087889] systemd[1641]: Reached target Shutdown. lb # [ 374.089253] systemd[1641]: Finished Exit the Session. lb # [ 374.090460] systemd[1641]: Reached target Exit the Session. lb # [ 374.118637] systemd-logind[499]: Removed session 40. lb # [ 374.127347] systemd[1]: user@0.service: Deactivated successfully. lb # [ 374.130499] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 371.331502] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 371.336265] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 374.204546] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 374.245486] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 374.251982] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 374.255494] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 371.535202] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 371.540598] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 371.741400] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 371.743602] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 371.944266] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 371.946564] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 372.147212] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 372.149488] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 373.757436] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 373.758676] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 373.759078] systemd[1]: nix-grpc-daemon.service: Consumed 5.526s CPU time over 5min 58.057s wall clock time, 105.3M memory peak, 1.1M incoming IP traffic, 941.2K outgoing IP traffic. worker1 # [ 373.777184] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 372.350235] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 372.356307] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 373.913340] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:37Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 373.916084] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 373.920671] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 373.929413] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:37Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 373.931532] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 375.239062] niks3-server[1454]: 2026/11/12 09:24:36 INFO lead: acquired remote=192.168.1.3:55118 worker1 # [ 373.979860] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 373.982005] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 372.554095] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 372.556147] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 374.182765] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 374.186024] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 372.757032] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 372.760214] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 374.386800] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 374.390212] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 372.960931] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 372.968227] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 374.591093] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 374.594585] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 373.164849] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 373.172219] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 374.796309] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 374.805758] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 374.807919] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 374.816305] systemd[1]: Started SSH per-connection Daemon (vsock:2:55). worker1 # [ 374.912713] sshd-session[2348]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 374.922394] sshd-session[2348]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 373.368200] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 373.376237] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 374.932582] sshd-session[2348]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 374.945316] systemd-logind[539]: New session '65' of user 'root' with class 'user' and type 'tty'. worker1 # [ 374.948601] systemd[1]: Started Session 65 of User root. worker1 # [ 374.985000] sshd-session[2354]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 374.986602] sshd-session[2354]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 374.988355] sshd-session[2348]: pam_unix(sshd:session): session closed for user root worker1 # [ 374.993051] systemd[1]: sshd-vsock@55-56-5:22-2:55.service: Deactivated successfully. worker1 # [ 374.998489] systemd[1]: session-65.scope: Deactivated successfully. worker1 # [ 375.003074] systemd-logind[539]: Session 65 logged out. Waiting for processes to exit. worker1 # [ 375.006170] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 375.009818] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 375.011738] systemd-logind[539]: Removed session 65. lb # [ 376.327905] envoy[897]: conn peer=[2001:db8:1::3]:40648 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=7389 tx=3138 ms=330219 worker2 # [ 373.572730] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 373.576230] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 373.615425] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 373.624428] systemd[1]: Started SSH per-connection Daemon (vsock:2:38). worker1 # [ 375.210165] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 375.214076] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 373.751956] sshd-session[2079]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 373.763972] sshd-session[2079]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 373.776662] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 373.785684] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 373.787995] sshd-session[2079]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 373.805615] systemd-logind[515]: New session '48' of user 'root' with class 'user' and type 'tty'. worker2 # [ 373.807233] systemd[1]: Started Session 48 of User root. worker1 # [ 375.414841] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 375.418227] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 373.983636] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 373.988477] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 374.004343] sshd-session[2085]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 374.005818] sshd-session[2085]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 374.006870] sshd-session[2079]: pam_unix(sshd:session): session closed for user root worker2 # [ 374.037302] systemd[1]: sshd-vsock@38-39-6:22-2:38.service: Deactivated successfully. worker2 # [ 374.038604] systemd[1]: session-48.scope: Deactivated successfully. worker2 # [ 374.048229] systemd-logind[515]: Session 48 logged out. Waiting for processes to exit. worker2 # [ 374.049665] systemd-logind[515]: Removed session 48. worker1 # [ 375.619198] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 375.622817] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 375.666709] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 375.676749] systemd[1]: Started SSH per-connection Daemon (vsock:2:56). worker2 # [ 374.184658] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 374.187983] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 375.771355] sshd-session[2359]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 375.779192] sshd-session[2359]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 375.789374] sshd-session[2359]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 375.800119] systemd-logind[539]: New session '66' of user 'root' with class 'user' and type 'tty'. worker1 # [ 375.807258] systemd[1]: Started Session 66 of User root. worker1 # [ 375.823359] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 375.827165] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 375.843378] sshd-session[2365]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 375.846729] sshd-session[2365]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 375.847833] sshd-session[2359]: pam_unix(sshd:session): session closed for user root worker1 # [ 375.851679] systemd[1]: sshd-vsock@56-57-5:22-2:56.service: Deactivated successfully. worker1 # [ 375.857630] systemd[1]: session-66.scope: Deactivated successfully. worker1 # [ 375.862002] systemd-logind[539]: Session 66 logged out. Waiting for processes to exit. worker1 # [ 375.864808] systemd-logind[539]: Removed session 66. worker2 # [ 374.384654] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 374.392222] systemd[1]: Started SSH per-connection Daemon (vsock:2:39). worker2 # [ 374.393679] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 374.395243] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 376.028834] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 376.032662] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 374.534216] sshd-session[2090]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 374.544201] sshd-session[2090]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 374.559361] sshd-session[2090]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 374.572133] systemd-logind[515]: New session '49' of user 'root' with class 'user' and type 'tty'. worker2 # [ 374.580156] systemd[1]: Started Session 49 of User root. worker2 # [ 374.594523] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 374.601389] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 376.233527] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 376.237037] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 374.731684] sshd-session[2096]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 374.735570] sshd-session[2096]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 374.737391] sshd-session[2090]: pam_unix(sshd:session): session closed for user root worker2 # [ 374.741967] systemd[1]: sshd-vsock@39-40-6:22-2:39.service: Deactivated successfully. worker2 # [ 374.746748] systemd[1]: session-49.scope: Deactivated successfully. worker2 # [ 374.751961] systemd-logind[515]: Session 49 logged out. Waiting for processes to exit. worker2 # [ 374.755152] systemd-logind[515]: Removed session 49. worker2 # [ 374.799605] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 374.802780] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 374.846904] nix-daemon[976]: reaped child process 2030, status = succeeded worker1 # [ 376.437767] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 376.441375] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 374.904097] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 374.914374] systemd[1]: Started SSH per-connection Daemon (vsock:2:40). worker2 # [ 374.992625] nix-daemon[976]: accepted connection from pid 2102, user nix-grpc-daemon (trusted) worker2 # [ 375.005270] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 375.006813] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 377.889415] niks3-server[1454]: 2026/11/12 09:24:39 INFO Received push request method=POST path=/api/pushes worker2 # [ 375.045619] nix-grpc-daemon[1723]: time=2026-11-12T09:24:40.315Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 375.047374] nix-grpc-daemon[1723]: time=2026-11-12T09:24:40.316Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 377.898970] garage[898]: 2026-11-12T09:24:39.658061Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092439Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d3066b02e3ae783d0403f8f1a3529b4039ee1b23bc6c07fc7bf2619e49b27f76 worker2 # [ 375.056408] nix-daemon[976]: reaped child process 2106, status = succeeded lb # [ 377.925014] garage[898]: 2026-11-12T09:24:39.668862Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092439Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a5151138a961b26e8add5e938388c17dfcc05c402cf4ad2380dafd42f62f5f8f worker2 # [ 375.087963] nix-grpc-daemon[1723]: time=2026-11-12T09:24:40.360Z level=INFO msg="Uploading 1 narinfos" worker1 # [ 376.642153] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:40Z level=info event=scheduler_connected addr=lb:50051 lb # [ 377.941419] garage[898]: 2026-11-12T09:24:39.669993Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092439Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=daa44beb3abd5225303983466caf594effad905aae93fa307972d49121fcbe5e worker1 # [ 376.651739] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 375.100527] sshd-session[2105]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 375.108674] sshd-session[2105]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 377.952166] garage[898]: 2026-11-12T09:24:39.675110Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls worker2 # [ 375.112473] nix-grpc-daemon[1723]: time=2026-11-12T09:24:40.385Z level=INFO msg="Upload complete. (292ms)" lb # [ 377.967191] garage[898]: 2026-11-12T09:24:39.676677Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker2 # [ 375.120923] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=18 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=28 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 377.976442] garage[898]: 2026-11-12T09:24:39.680150Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 377.981677] niks3-server[1454]: 2026/11/12 09:24:39 INFO Received sign narinfos request method=POST path=/api/pushes/40/sign lb # [ 377.983813] niks3-server[1454]: 2026/11/12 09:24:39 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 377.986165] niks3-server[1454]: 2026/11/12 09:24:39 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst worker2 # [ 375.135171] sshd-session[2105]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 377.988858] niks3-server[1454]: 2026/11/12 09:24:39 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv lb # [ 377.991106] niks3-server[1454]: 2026/11/12 09:24:39 INFO Signed narinfos id=40 count=1 lb # [ 377.992505] niks3-server[1454]: 2026/11/12 09:24:39 INFO Received complete push request method=POST path=/api/pushes/40/complete worker2 # [ 375.140146] nix-daemon[976]: reaped child process 2028, status = succeeded lb # [ 377.995090] niks3-server[1454]: 2026/11/12 09:24:39 INFO Completed push id=40 objects=4 duration=7.83842ms lb # [ 377.996771] niks3-server[1454]: 2026/11/12 09:24:39 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker2 # [ 375.145578] systemd-logind[515]: New session '50' of user 'root' with class 'user' and type 'tty'. lb # [ 377.999017] garage[898]: 2026-11-12T09:24:39.710805Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092439Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=041c92160a47993d296ef772a343025e9f17054425e16077975963892bd1ed57 worker2 # [ 375.153380] systemd[1]: Started Session 50 of User root. lb # [ 378.006002] garage[898]: 2026-11-12T09:24:39.722060Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker2 # [ 375.178238] sshd-session[2113]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 375.180995] sshd-session[2113]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 375.182321] sshd-session[2105]: pam_unix(sshd:session): session closed for user root worker2 # [ 375.186802] systemd[1]: sshd-vsock@40-41-6:22-2:40.service: Deactivated successfully. worker2 # [ 375.191516] systemd[1]: session-50.scope: Deactivated successfully. worker2 # [ 375.196849] systemd-logind[515]: Session 50 logged out. Waiting for processes to exit. worker2 # [ 375.200505] systemd-logind[515]: Removed session 50. worker2 # [ 375.205946] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 375.208345] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 376.852659] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 376.856499] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 375.409297] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 375.413253] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 377.057823] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 377.061451] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 377.159594] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 375.615129] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:40Z level=info event=scheduler_connected addr=lb:50051 client # [ 377.167551] systemd[1]: Started SSH per-connection Daemon (vsock:2:54). worker2 # [ 375.618372] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 377.262836] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 377.266637] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 377.267601] sshd-session[1908]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 377.275987] sshd-session[1908]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 377.286403] sshd-session[1908]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 377.316519] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 377.351091] systemd-logind[427]: New session '64' of user 'root' with class 'user' and type 'tty'. client # [ 377.363055] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 375.817210] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 375.821012] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 377.372853] systemd[1]: Starting User Manager for UID 0... client # [ 377.398085] (systemd)[1917]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 377.404195] systemd-logind[427]: New session '65' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 377.467335] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 377.470877] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 377.493097] systemd[1917]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 376.021897] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 376.025240] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 377.591991] systemd[1917]: Queued start job for default target Main User Target. client # [ 377.601011] systemd[1917]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 377.605405] systemd[1917]: Created slice User Application Slice. client # [ 377.606396] systemd[1917]: Started Daily Cleanup of User's Temporary Directories. client # [ 377.607561] systemd[1917]: Reached target Paths. client # [ 377.611338] systemd[1917]: Reached target Timers. client # [ 377.613197] systemd[1917]: Starting D-Bus User Message Bus Socket... client # [ 377.614161] systemd[1917]: Starting Create User Files and Directories... client # [ 377.645523] systemd[1917]: Listening on D-Bus User Message Bus Socket. client # [ 377.647313] systemd[1917]: Reached target Sockets. client # [ 377.659991] systemd[1917]: Finished Create User Files and Directories. client # [ 377.661459] systemd[1917]: Reached target Basic System. client # [ 377.666692] systemd[1]: Started User Manager for UID 0. client # [ 377.667742] systemd[1917]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 377.671636] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:41Z level=info event=scheduler_connected addr=lb:50051 client # [ 377.673250] systemd[1917]: Reached target Main User Target. worker1 # [ 377.675367] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 377.674207] systemd[1917]: Startup finished in 242ms. client # [ 377.674979] systemd[1]: Started Session 64 of User root. client # [ 377.703105] sshd-session[1930]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 377.705812] sshd-session[1930]: Disconnected from user root UNKNOWN port 65535 client # [ 377.707807] sshd-session[1908]: pam_unix(sshd:session): session closed for user root client # [ 377.711542] systemd[1]: sshd-vsock@54-55-3:22-2:54.service: Deactivated successfully. client # [ 377.717033] systemd[1]: session-64.scope: Deactivated successfully. client # [ 377.721235] systemd-logind[427]: Session 64 logged out. Waiting for processes to exit. client # [ 377.723647] systemd-logind[427]: Removed session 64. worker2 # [ 376.226064] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 376.229449] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 377.876087] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 377.879595] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 376.430980] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 376.434118] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 378.081169] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 378.084160] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 376.634444] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 376.637524] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 378.282718] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 378.286136] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 376.838211] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 376.841873] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 378.486890] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 378.490253] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 377.042789] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 377.046356] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 378.691095] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 378.694439] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 377.247252] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 377.251472] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 378.895257] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 378.898832] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 377.452566] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 377.455994] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 379.101019] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 379.103498] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 377.658391] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 377.660953] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 379.301942] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 379.305422] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 377.859168] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 377.862715] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 379.506119] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 379.509593] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 379.604162] systemd[1]: rs.service: Deactivated successfully. client # [ 379.606762] systemd[1]: rs.service: Consumed 197ms CPU time over 21.538s wall clock time, 38.8M memory peak, 10K incoming IP traffic, 10.6K outgoing IP traffic. worker2 # [ 378.063631] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 378.067095] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 379.710392] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 379.713942] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 378.267956] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 378.271273] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 379.914693] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 379.918074] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 378.472243] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 378.475594] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 380.119604] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 380.122949] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 378.677499] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 378.680838] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 380.323719] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 380.327228] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 378.881803] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 378.885307] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 380.528081] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 380.531624] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 379.086197] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 379.089656] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 380.732329] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 380.735794] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 379.290465] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 379.293767] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 380.936530] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 380.940107] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 379.494594] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 379.497983] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 381.141973] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 381.144529] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 379.699923] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 379.702558] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 381.342783] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 381.346203] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 379.900964] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 379.904337] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 381.546953] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 381.550173] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 380.105137] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 380.108351] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 381.751070] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 381.754349] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 380.309264] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 380.312401] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 381.955002] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 381.957185] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 380.513190] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 380.516513] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 382.159398] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 382.161953] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 380.718740] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 380.721437] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 382.360379] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 382.363882] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 380.919643] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 380.923145] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 382.564662] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 382.568093] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 381.123947] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 381.127222] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 382.768546] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 382.771720] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 381.328102] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 381.331436] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 382.972466] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 382.975766] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 381.532541] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 381.535770] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 383.177450] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 383.180734] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 381.737624] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 381.740953] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 383.381434] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 383.384926] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 381.941860] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 381.945614] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 383.585528] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 383.588890] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 382.146397] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 382.149686] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 383.789465] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 383.792968] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 382.350675] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 382.354225] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 383.942476] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:47Z level=info event=scheduler_take_over worker1 # [ 383.993572] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 383.997805] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 382.555146] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 382.558551] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 384.199673] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 384.203158] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 382.761112] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 382.763590] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 384.403973] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 384.407437] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 382.962250] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 382.965473] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 384.608383] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 384.611770] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 383.166502] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 383.169995] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 384.812569] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 384.819190] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:48Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:50824 worker1 # [ 384.823558] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:48Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 383.371008] nix-grpc-daemon[1487]: ts=2026-11-12T09:24:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 384.932871] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:48Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 384.935199] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:48Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:50824 worker1 # [ 384.938168] nix-grpc-daemon[2296]: ts=2026-11-12T09:24:48Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux,riscv64-linux max_jobs=1 running=0 lb # [ 386.328300] envoy[897]: conn peer=[2001:db8:1::1]:41748 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3617 tx=1839 ms=21323 client # [ 385.148604] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 385.157725] systemd[1]: Started SSH per-connection Daemon (vsock:2:55). client # [ 385.254737] sshd-session[1939]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 385.264988] sshd-session[1939]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 385.274372] sshd-session[1939]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 385.285344] systemd-logind[427]: New session '66' of user 'root' with class 'user' and type 'tty'. client # [ 385.299264] systemd[1]: Started Session 66 of User root. client # [ 385.333190] sshd-session[1945]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 385.336173] sshd-session[1945]: Disconnected from user root UNKNOWN port 65535 client # [ 385.337658] sshd-session[1939]: pam_unix(sshd:session): session closed for user root client # [ 385.341958] systemd[1]: sshd-vsock@55-56-3:22-2:55.service: Deactivated successfully. client # [ 385.347325] systemd[1]: session-66.scope: Deactivated successfully. client # [ 385.352983] systemd-logind[427]: Session 66 logged out. Waiting for processes to exit. client # [ 385.355575] systemd-logind[427]: Removed session 66. worker1 # [ 386.040652] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 386.046688] systemd[2073]: Activating special unit Exit the Session... worker1 # [ 386.051519] systemd[2073]: Stopped target Main User Target. worker1 # [ 386.057301] systemd[2073]: Stopped target Basic System. worker1 # [ 386.060645] systemd[2073]: Stopped target Paths. worker1 # [ 386.061765] systemd[2073]: Stopped target Sockets. worker1 # [ 386.062895] systemd[2073]: Stopped target Timers. worker1 # [ 386.064788] systemd[2073]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 386.066438] systemd[2073]: Closed D-Bus User Message Bus Socket. worker1 # [ 386.067906] systemd[2073]: Stopped Create User Files and Directories. worker1 # [ 386.069821] systemd[2073]: Removed slice User Application Slice. worker1 # [ 386.071223] systemd[2073]: Reached target Shutdown. worker1 # [ 386.074995] systemd[2073]: Finished Exit the Session. worker1 # [ 386.076403] systemd[2073]: Reached target Exit the Session. worker1 # [ 386.081126] systemd-logind[539]: Removed session 54. worker1 # [ 386.089798] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 386.095280] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 386.111317] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 386.150046] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 386.154925] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 386.160816] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 385.334230] systemd[1]: Stopping User Manager for UID 0... client # [ 386.885652] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 385.341563] systemd[1915]: Activating special unit Exit the Session... client # [ 386.893461] systemd[1]: Started SSH per-connection Daemon (vsock:2:56). worker2 # [ 385.346743] systemd[1915]: Stopped target Main User Target. worker2 # [ 385.351660] systemd[1915]: Stopped target Basic System. worker2 # [ 385.353907] systemd[1915]: Stopped target Paths. worker2 # [ 385.355154] systemd[1915]: Stopped target Sockets. worker2 # [ 385.357141] systemd[1915]: Stopped target Timers. worker2 # [ 385.358394] systemd[1915]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 385.360318] systemd[1915]: Closed D-Bus User Message Bus Socket. worker2 # [ 385.361935] systemd[1915]: Stopped Create User Files and Directories. worker2 # [ 385.363534] systemd[1915]: Removed slice User Application Slice. worker2 # [ 385.366107] systemd[1915]: Reached target Shutdown. worker2 # [ 385.367437] systemd[1915]: Finished Exit the Session. worker2 # [ 385.369076] systemd[1915]: Reached target Exit the Session. worker2 # [ 385.391629] systemd-logind[515]: Removed session 40. worker2 # [ 385.398018] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 385.401420] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 385.423160] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 386.993240] sshd-session[1951]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 387.003180] sshd-session[1951]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 387.011786] sshd-session[1951]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 385.462832] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 385.466935] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 387.021162] systemd-logind[427]: New session '67' of user 'root' with class 'user' and type 'tty'. worker2 # [ 385.472994] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 387.033071] systemd[1]: Started Session 67 of User root. client # [ 387.064669] sshd-session[1957]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 387.067521] sshd-session[1957]: Disconnected from user root UNKNOWN port 65535 client # [ 387.069117] sshd-session[1951]: pam_unix(sshd:session): session closed for user root client # [ 387.073545] systemd[1]: sshd-vsock@56-57-3:22-2:56.service: Deactivated successfully. client # [ 387.078903] systemd[1]: session-67.scope: Deactivated successfully. client # [ 387.082862] systemd-logind[427]: Session 67 logged out. Waiting for processes to exit. client # [ 387.086772] systemd-logind[427]: Removed session 67. client # [ 387.175196] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 387.184098] systemd[1]: Started SSH per-connection Daemon (vsock:2:57). client # [ 387.280818] sshd-session[1962]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 387.290174] sshd-session[1962]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 387.298133] sshd-session[1962]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 387.308224] systemd-logind[427]: New session '68' of user 'root' with class 'user' and type 'tty'. client # [ 387.316570] systemd[1]: Started Session 68 of User root. client # [ 387.341754] sshd-session[1968]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 387.344690] sshd-session[1968]: Disconnected from user root UNKNOWN port 65535 client # [ 387.346164] sshd-session[1962]: pam_unix(sshd:session): session closed for user root client # [ 387.351169] systemd[1]: sshd-vsock@57-58-3:22-2:57.service: Deactivated successfully. client # [ 387.356149] systemd[1]: session-68.scope: Deactivated successfully. client # [ 387.360867] systemd-logind[427]: Session 68 logged out. Waiting for processes to exit. client # [ 387.363345] systemd-logind[427]: Removed session 68. lb # [ 388.732598] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 388.740808] systemd[1]: Started SSH per-connection Daemon (vsock:2:34). lb # [ 388.840862] sshd-session[1733]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 388.848773] sshd-session[1733]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 388.858922] sshd-session[1733]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 388.884509] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 388.917922] systemd-logind[499]: New session '45' of user 'root' with class 'user' and type 'tty'. lb # [ 388.929367] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 388.934697] systemd[1]: Starting User Manager for UID 0... lb # [ 388.961567] (systemd)[1742]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 388.968151] systemd-logind[499]: New session '46' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 389.058147] systemd[1742]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 389.161616] systemd[1742]: Queued start job for default target Main User Target. lb # [ 389.164971] systemd[1742]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 389.169318] systemd[1742]: Created slice User Application Slice. lb # [ 389.170378] systemd[1742]: Started Daily Cleanup of User's Temporary Directories. lb # [ 389.171436] systemd[1742]: Reached target Paths. lb # [ 389.176199] systemd[1742]: Reached target Timers. lb # [ 389.176950] systemd[1742]: Starting D-Bus User Message Bus Socket... lb # [ 389.177858] systemd[1742]: Starting Create User Files and Directories... lb # [ 389.211945] systemd[1742]: Listening on D-Bus User Message Bus Socket. lb # [ 389.215034] systemd[1742]: Reached target Sockets. lb # [ 389.223709] systemd[1742]: Finished Create User Files and Directories. lb # [ 389.228831] systemd[1742]: Reached target Basic System. lb # [ 389.229720] systemd[1]: Started User Manager for UID 0. lb # [ 389.230609] systemd[1742]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 389.233164] systemd[1742]: Reached target Main User Target. lb # [ 389.234087] systemd[1742]: Startup finished in 243ms. lb # [ 389.240908] systemd[1]: Started Session 45 of User root. lb # [ 389.273424] sshd-session[1755]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 389.276002] sshd-session[1755]: Disconnected from user root UNKNOWN port 65535 lb # [ 389.277406] sshd-session[1733]: pam_unix(sshd:session): session closed for user root lb # [ 389.281861] systemd[1]: sshd-vsock@34-35-4:22-2:34.service: Deactivated successfully. lb # [ 389.286462] systemd[1]: session-45.scope: Deactivated successfully. lb # [ 389.288354] systemd[1]: session-45.scope: Consumed 26ms CPU time over 47ms wall clock time, 4.8M memory peak, 5.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 389.294710] systemd-logind[499]: Session 45 logged out. Waiting for processes to exit. lb # [ 389.297305] systemd-logind[499]: Removed session 45. worker1 # [ 388.611589] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 388.619625] systemd[1]: Started SSH per-connection Daemon (vsock:2:57). worker1 # [ 388.716865] sshd-session[2374]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 388.726455] sshd-session[2374]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 388.735612] sshd-session[2374]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 388.755538] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 388.764988] systemd-logind[539]: New session '67' of user 'root' with class 'user' and type 'tty'. worker1 # [ 388.801237] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 388.808549] systemd[1]: Starting User Manager for UID 0... worker1 # [ 388.838324] (systemd)[2382]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 388.844204] systemd-logind[539]: New session '68' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 388.934897] systemd[2382]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 389.035223] systemd[2382]: Queued start job for default target Main User Target. worker1 # [ 389.045032] systemd[2382]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 389.048047] systemd[2382]: Created slice User Application Slice. worker1 # [ 389.049105] systemd[2382]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 389.050282] systemd[2382]: Reached target Paths. worker1 # [ 389.052141] systemd[2382]: Reached target Timers. worker1 # [ 389.055237] systemd[2382]: Starting D-Bus User Message Bus Socket... worker1 # [ 389.057624] systemd[2382]: Starting Create User Files and Directories... worker1 # [ 389.105929] systemd[2382]: Listening on D-Bus User Message Bus Socket. worker1 # [ 389.107838] systemd[2382]: Finished Create User Files and Directories. worker1 # [ 389.110076] systemd[2382]: Reached target Sockets. worker1 # [ 389.110995] systemd[2382]: Reached target Basic System. worker1 # [ 389.111755] systemd[2382]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 389.119929] systemd[2382]: Reached target Main User Target. worker1 # [ 389.122014] systemd[2382]: Startup finished in 249ms. worker1 # [ 389.122882] systemd[1]: Started User Manager for UID 0. worker1 # [ 389.123660] systemd[1]: Started Session 67 of User root. worker1 # [ 389.153643] sshd-session[2395]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 389.156584] sshd-session[2395]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 389.158420] sshd-session[2374]: pam_unix(sshd:session): session closed for user root worker1 # [ 389.162770] systemd[1]: sshd-vsock@57-58-5:22-2:57.service: Deactivated successfully. worker1 # [ 389.168151] systemd[1]: session-67.scope: Deactivated successfully. worker1 # [ 389.171543] systemd[1]: session-67.scope: Consumed 26ms CPU time over 52ms wall clock time, 3M memory peak, 4.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 389.176531] systemd-logind[539]: Session 67 logged out. Waiting for processes to exit. worker1 # [ 389.177788] systemd-logind[539]: Removed session 67. ok test farm::serial::dag_build_is_scheduled_across_workers_and_lands_in_the_cache ... worker1 # [ 390.509301] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 390.517306] systemd[1]: Started SSH per-connection Daemon (vsock:2:58). worker1 # [ 390.615284] sshd-session[2400]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 390.623654] sshd-session[2400]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 390.634649] sshd-session[2400]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 390.646412] systemd-logind[539]: New session '69' of user 'root' with class 'user' and type 'tty'. worker1 # [ 390.653355] systemd[1]: Started Session 69 of User root. worker1 # [ 390.685493] sshd-session[2406]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 390.688267] sshd-session[2406]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 390.699022] sshd-session[2400]: pam_unix(sshd:session): session closed for user root worker1 # [ 390.703760] systemd[1]: sshd-vsock@58-59-5:22-2:58.service: Deactivated successfully. worker1 # [ 390.709909] systemd[1]: session-69.scope: Deactivated successfully. worker1 # [ 390.714873] systemd-logind[539]: Session 69 logged out. Waiting for processes to exit. worker1 # [ 390.717396] systemd-logind[539]: Removed session 69. worker2 # [ 389.860700] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 389.868700] systemd[1]: Started SSH per-connection Daemon (vsock:2:41). worker2 # [ 389.969041] sshd-session[2122]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 389.978293] sshd-session[2122]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 389.989330] sshd-session[2122]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 390.009460] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 390.017932] systemd-logind[515]: New session '51' of user 'root' with class 'user' and type 'tty'. worker2 # [ 390.049642] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 390.055718] systemd[1]: Starting User Manager for UID 0... worker2 # [ 390.081635] (systemd)[2130]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 390.087852] systemd-logind[515]: New session '52' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 390.180290] systemd[2130]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 390.279901] systemd[2130]: Queued start job for default target Main User Target. worker2 # [ 390.289191] systemd[2130]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 390.293522] systemd[2130]: Created slice User Application Slice. worker2 # [ 390.294569] systemd[2130]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 390.295628] systemd[2130]: Reached target Paths. worker2 # [ 390.299242] systemd[2130]: Reached target Timers. worker2 # [ 390.301413] systemd[2130]: Starting D-Bus User Message Bus Socket... worker2 # [ 390.302395] systemd[2130]: Starting Create User Files and Directories... worker2 # [ 390.343431] systemd[2130]: Finished Create User Files and Directories. worker2 # [ 390.347976] systemd[2130]: Listening on D-Bus User Message Bus Socket. worker2 # [ 390.350991] systemd[2130]: Reached target Sockets. worker2 # [ 390.351826] systemd[2130]: Reached target Basic System. worker2 # [ 390.355019] systemd[2130]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 390.356710] systemd[2130]: Reached target Main User Target. worker2 # [ 390.357561] systemd[2130]: Startup finished in 246ms. worker2 # [ 390.358332] systemd[1]: Started User Manager for UID 0. worker2 # [ 390.361365] systemd[1]: Started Session 51 of User root. worker2 # [ 390.391046] sshd-session[2143]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 390.394064] sshd-session[2143]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 390.395136] sshd-session[2122]: pam_unix(sshd:session): session closed for user root worker2 # [ 390.399003] systemd[1]: sshd-vsock@41-42-6:22-2:41.service: Deactivated successfully. worker2 # [ 390.404586] systemd[1]: session-51.scope: Deactivated successfully. worker2 # [ 390.409100] systemd-logind[515]: Session 51 logged out. Waiting for processes to exit. worker2 # [ 390.411366] systemd-logind[515]: Removed session 51. lb # [ 394.055425] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 394.063127] systemd[1]: Started SSH per-connection Daemon (vsock:2:35). lb # [ 394.160642] sshd-session[1760]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 394.169857] sshd-session[1760]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 394.178418] sshd-session[1760]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 394.188752] systemd-logind[499]: New session '47' of user 'root' with class 'user' and type 'tty'. lb # [ 394.199529] systemd[1]: Started Session 47 of User root. lb # [ 394.234205] sshd-session[1766]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 394.238105] sshd-session[1766]: Disconnected from user root UNKNOWN port 65535 lb # [ 394.239431] sshd-session[1760]: pam_unix(sshd:session): session closed for user root lb # [ 394.243433] systemd[1]: sshd-vsock@35-36-4:22-2:35.service: Deactivated successfully. lb # [ 394.249475] systemd[1]: session-47.scope: Deactivated successfully. lb # [ 394.252684] systemd[1]: session-47.scope: Consumed 29ms CPU time over 54ms wall clock time, 3.1M memory peak, 5.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 394.258446] systemd-logind[499]: Session 47 logged out. Waiting for processes to exit. lb # [ 394.259882] systemd-logind[499]: Removed session 47. worker1 # [ 393.397939] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 393.407195] systemd[1]: Started SSH per-connection Daemon (vsock:2:59). worker1 # [ 393.502518] sshd-session[2412]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 393.512391] sshd-session[2412]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 393.522435] sshd-session[2412]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 393.533074] systemd-logind[539]: New session '70' of user 'root' with class 'user' and type 'tty'. worker1 # [ 393.542912] systemd[1]: Started Session 70 of User root. worker1 # [ 393.575463] sshd-session[2418]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 393.578542] sshd-session[2418]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 393.580091] sshd-session[2412]: pam_unix(sshd:session): session closed for user root worker1 # [ 393.584137] systemd[1]: sshd-vsock@59-60-5:22-2:59.service: Deactivated successfully. worker1 # [ 393.589658] systemd[1]: session-70.scope: Deactivated successfully. worker1 # [ 393.592314] systemd[1]: session-70.scope: Consumed 27ms CPU time over 50ms wall clock time, 5M memory peak, 4.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 393.597544] systemd-logind[539]: Session 70 logged out. Waiting for processes to exit. worker1 # [ 393.598851] systemd-logind[539]: Removed session 70. worker1 # [ 393.655949] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 393.664307] systemd[1]: Started SSH per-connection Daemon (vsock:2:60). worker1 # [ 393.764574] sshd-session[2423]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 393.772281] sshd-session[2423]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 393.784491] sshd-session[2423]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 393.796123] systemd-logind[539]: New session '71' of user 'root' with class 'user' and type 'tty'. worker1 # [ 393.804749] systemd[1]: Started Session 71 of User root. worker1 # [ 393.845109] sshd-session[2429]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 393.847457] sshd-session[2429]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 393.849071] sshd-session[2423]: pam_unix(sshd:session): session closed for user root worker1 # [ 393.853780] systemd[1]: sshd-vsock@60-61-5:22-2:60.service: Deactivated successfully. worker1 # [ 393.860260] systemd[1]: session-71.scope: Deactivated successfully. worker1 # [ 393.863985] systemd[1]: session-71.scope: Consumed 30ms CPU time over 56ms wall clock time, 3.1M memory peak, 4.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 393.867913] systemd-logind[539]: Session 71 logged out. Waiting for processes to exit. worker1 # [ 393.870786] systemd-logind[539]: Removed session 71. worker1 # [ 393.962125] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 393.971901] systemd[1]: Started SSH per-connection Daemon (vsock:2:61). worker1 # [ 394.068499] sshd-session[2434]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 394.078269] sshd-session[2434]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 394.087591] sshd-session[2434]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 394.099571] systemd-logind[539]: New session '72' of user 'root' with class 'user' and type 'tty'. worker1 # [ 394.104644] systemd[1]: Started Session 72 of User root. worker1 # [ 394.142121] sshd-session[2440]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 394.143690] sshd-session[2440]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 394.145420] sshd-session[2434]: pam_unix(sshd:session): session closed for user root worker1 # [ 394.149789] systemd[1]: sshd-vsock@61-62-5:22-2:61.service: Deactivated successfully. worker1 # [ 394.155278] systemd[1]: session-72.scope: Deactivated successfully. worker1 # [ 394.157250] systemd[1]: session-72.scope: Consumed 28ms CPU time over 52ms wall clock time, 3.1M memory peak, 4.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 394.162930] systemd-logind[539]: Session 72 logged out. Waiting for processes to exit. worker1 # [ 394.165234] systemd-logind[539]: Removed session 72. worker1 # [ 394.391441] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 394.401014] systemd[1]: Started SSH per-connection Daemon (vsock:2:62). worker1 # [ 394.496742] sshd-session[2445]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 394.505102] sshd-session[2445]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 394.515983] sshd-session[2445]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 394.525505] systemd-logind[539]: New session '73' of user 'root' with class 'user' and type 'tty'. worker1 # [ 394.536603] systemd[1]: Started Session 73 of User root. worker1 # [ 394.574805] sshd-session[2451]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 394.578055] sshd-session[2451]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 394.579365] sshd-session[2445]: pam_unix(sshd:session): session closed for user root worker1 # [ 394.583894] systemd[1]: sshd-vsock@62-63-5:22-2:62.service: Deactivated successfully. worker1 # [ 394.589941] systemd[1]: session-73.scope: Deactivated successfully. worker1 # [ 394.593441] systemd[1]: session-73.scope: Consumed 30ms CPU time over 54ms wall clock time, 3.1M memory peak, 4.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 394.598367] systemd-logind[539]: Session 73 logged out. Waiting for processes to exit. worker1 # [ 394.599677] systemd-logind[539]: Removed session 73. worker2 # [ 393.262220] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 393.271462] systemd[1]: Started SSH per-connection Daemon (vsock:2:42). worker2 # [ 393.368778] sshd-session[2149]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 393.379122] sshd-session[2149]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 393.388566] sshd-session[2149]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 393.399721] systemd-logind[515]: New session '53' of user 'root' with class 'user' and type 'tty'. worker2 # [ 393.408706] systemd[1]: Started Session 53 of User root. worker2 # [ 393.445760] sshd-session[2155]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 393.449469] sshd-session[2155]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 393.451721] sshd-session[2149]: pam_unix(sshd:session): session closed for user root worker2 # [ 393.456137] systemd[1]: sshd-vsock@42-43-6:22-2:42.service: Deactivated successfully. worker2 # [ 393.461690] systemd[1]: session-53.scope: Deactivated successfully. worker2 # [ 393.464831] systemd[1]: session-53.scope: Consumed 29ms CPU time over 54ms wall clock time, 4.8M memory peak, 13K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 393.469825] systemd-logind[515]: Session 53 logged out. Waiting for processes to exit. worker2 # [ 393.471223] systemd-logind[515]: Removed session 53. worker2 # [ 393.999388] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 394.007964] systemd[1]: Started SSH per-connection Daemon (vsock:2:43). worker2 # [ 394.102954] sshd-session[2160]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 394.111278] sshd-session[2160]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 394.122774] sshd-session[2160]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 394.134947] systemd-logind[515]: New session '54' of user 'root' with class 'user' and type 'tty'. worker2 # [ 394.141531] systemd[1]: Started Session 54 of User root. worker2 # [ 394.176590] sshd-session[2166]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 394.179398] sshd-session[2166]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 394.181576] sshd-session[2160]: pam_unix(sshd:session): session closed for user root worker2 # [ 394.186243] systemd[1]: sshd-vsock@43-44-6:22-2:43.service: Deactivated successfully. worker2 # [ 394.191183] systemd[1]: session-54.scope: Deactivated successfully. worker2 # [ 394.193186] systemd[1]: session-54.scope: Consumed 28ms CPU time over 52ms wall clock time, 4.8M memory peak, 13K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 394.198813] systemd-logind[515]: Session 54 logged out. Waiting for processes to exit. worker2 # [ 394.201683] systemd-logind[515]: Removed session 54. worker2 # [ 395.505455] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 395.514602] systemd[1]: Started SSH per-connection Daemon (vsock:2:44). worker2 # [ 395.619832] sshd-session[2171]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 395.630797] sshd-session[2171]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 395.640138] sshd-session[2171]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 395.649772] systemd-logind[515]: New session '55' of user 'root' with class 'user' and type 'tty'. worker2 # [ 395.657485] systemd[1]: Started Session 55 of User root. worker2 # [ 395.693512] sshd-session[2177]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 395.695073] sshd-session[2177]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 395.696847] sshd-session[2171]: pam_unix(sshd:session): session closed for user root worker2 # [ 395.701772] systemd[1]: sshd-vsock@44-45-6:22-2:44.service: Deactivated successfully. worker2 # [ 395.706927] systemd[1]: session-55.scope: Deactivated successfully. worker2 # [ 395.710234] systemd[1]: session-55.scope: Consumed 29ms CPU time over 51ms wall clock time, 3.1M memory peak, 13K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 395.715484] systemd-logind[515]: Session 55 logged out. Waiting for processes to exit. worker2 # [ 395.717138] systemd-logind[515]: Removed session 55. client # [ 397.393217] systemd[1]: Stopping User Manager for UID 0... client # [ 397.400548] systemd[1917]: Activating special unit Exit the Session... client # [ 397.410056] systemd[1917]: Stopped target Main User Target. client # [ 397.411583] systemd[1917]: Stopped target Basic System. client # [ 397.413596] systemd[1917]: Stopped target Paths. client # [ 397.414918] systemd[1917]: Stopped target Sockets. client # [ 397.416402] systemd[1917]: Stopped target Timers. client # [ 397.417610] systemd[1917]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 397.419311] systemd[1917]: Closed D-Bus User Message Bus Socket. client # [ 397.420906] systemd[1917]: Stopped Create User Files and Directories. client # [ 397.422461] systemd[1917]: Removed slice User Application Slice. client # [ 397.423812] systemd[1917]: Reached target Shutdown. client # [ 397.425370] systemd[1917]: Finished Exit the Session. client # [ 397.426560] systemd[1917]: Reached target Exit the Session. client # [ 397.437734] systemd-logind[427]: Removed session 65. client # [ 397.445396] systemd[1]: user@0.service: Deactivated successfully. client # [ 397.448418] systemd[1]: Stopped User Manager for UID 0. client # [ 397.511430] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 397.552806] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 397.558134] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 397.562271] systemd[1]: Stopped User Runtime Directory /run/user/0. [e2e] heartbeat t=300s client # [ 398.562147] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 398.570081] systemd[1]: Started SSH per-connection Daemon (vsock:2:58). client # [ 398.667289] sshd-session[1978]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 398.675552] sshd-session[1978]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 398.685762] sshd-session[1978]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 398.716346] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 398.751639] systemd-logind[427]: New session '69' of user 'root' with class 'user' and type 'tty'. client # [ 398.763702] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 398.769204] systemd[1]: Starting User Manager for UID 0... client # [ 398.798832] (systemd)[1987]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 398.804783] systemd-logind[427]: New session '70' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 398.899374] systemd[1987]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 399.002308] systemd[1987]: Queued start job for default target Main User Target. client # [ 399.013126] systemd[1987]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 399.017557] systemd[1987]: Created slice User Application Slice. client # [ 399.018717] systemd[1987]: Started Daily Cleanup of User's Temporary Directories. client # [ 399.019841] systemd[1987]: Reached target Paths. client # [ 399.023698] systemd[1987]: Reached target Timers. client # [ 399.026030] systemd[1987]: Starting D-Bus User Message Bus Socket... client # [ 399.027062] systemd[1987]: Starting Create User Files and Directories... client # [ 399.074230] systemd[1987]: Finished Create User Files and Directories. client # [ 399.079071] systemd[1987]: Listening on D-Bus User Message Bus Socket. client # [ 399.084329] systemd[1987]: Reached target Sockets. client # [ 399.085218] systemd[1987]: Reached target Basic System. client # [ 399.086032] systemd[1987]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 399.087586] systemd[1987]: Reached target Main User Target. client # [ 399.091007] systemd[1987]: Startup finished in 257ms. client # [ 399.091888] systemd[1]: Started User Manager for UID 0. client # [ 399.096098] systemd[1]: Started Session 69 of User root. worker2 # [ 397.738242] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48140 worker2 # [ 397.746097] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 400.607433] garage[898]: 2026-11-12T09:25:02.365673Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo lb # [ 400.607759] garage[898]: 2026-11-12T09:25:02.366138Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 400.616549] garage[898]: 2026-11-12T09:25:02.375624Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nblg066ygaz2avzlmix3rnngr62hld8f.narinfo lb # [ 400.622269] garage[898]: 2026-11-12T09:25:02.376047Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 400.626635] garage[898]: 2026-11-12T09:25:02.381288Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo lb # [ 400.632205] garage[898]: 2026-11-12T09:25:02.381647Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 397.779388] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 400.638063] garage[898]: 2026-11-12T09:25:02.397519Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/nblg066ygaz2avzlmix3rnngr62hld8f.narinfo lb # [ 400.643122] garage[898]: 2026-11-12T09:25:02.397954Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 400.648117] garage[898]: 2026-11-12T09:25:02.407233Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/nblg066ygaz2avzlmix3rnngr62hld8f.narinfo lb # [ 400.653093] garage[898]: 2026-11-12T09:25:02.407624Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 397.806204] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 400.664593] garage[898]: 2026-11-12T09:25:02.423924Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo lb # [ 400.669416] garage[898]: 2026-11-12T09:25:02.424383Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 400.673963] garage[898]: 2026-11-12T09:25:02.433500Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo lb # [ 400.678795] garage[898]: 2026-11-12T09:25:02.433893Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 397.831487] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 400.690181] garage[898]: 2026-11-12T09:25:02.449558Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo lb # [ 400.695188] garage[898]: 2026-11-12T09:25:02.449972Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 400.700599] garage[898]: 2026-11-12T09:25:02.459354Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo lb # [ 400.706505] garage[898]: 2026-11-12T09:25:02.459827Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 397.858476] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 400.717797] garage[898]: 2026-11-12T09:25:02.477020Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo lb # [ 400.723973] garage[898]: 2026-11-12T09:25:02.477446Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 400.728666] garage[898]: 2026-11-12T09:25:02.482641Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo lb # [ 400.733425] garage[898]: 2026-11-12T09:25:02.482987Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 400.737738] garage[898]: 2026-11-12T09:25:02.483124Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker2 # [ 397.886509] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 400.741891] garage[898]: 2026-11-12T09:25:02.483301Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 397.895617] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 397.915603] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 398.061451] nix-daemon[976]: accepted connection from pid 2186, user nix-grpc-daemon (trusted) worker2 # [ 398.085271] nix-daemon[976]: reaped child process 2189, status = succeeded lb # [ 400.945630] niks3-server[1454]: 2026/11/12 09:25:02 INFO Received push request method=POST path=/api/pushes worker2 # [ 398.107622] nix-grpc-daemon[1723]: time=2026-11-12T09:25:03.379Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker2 # [ 398.109611] nix-grpc-daemon[1723]: time=2026-11-12T09:25:03.379Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" worker2 # [ 398.111375] nix-grpc-daemon[1723]: time=2026-11-12T09:25:03.379Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" worker2 # [ 398.113218] nix-grpc-daemon[1723]: time=2026-11-12T09:25:03.379Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" worker2 # [ 398.127470] nix-grpc-daemon[1723]: time=2026-11-12T09:25:03.400Z level=INFO msg="Uploading 3 narinfos" lb # [ 400.961713] garage[898]: 2026-11-12T09:25:02.720534Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092502Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=87af825640a37964ca33ef29ae132a7b0c0fee352c0c651fa6ae32aaa6411e96 lb # [ 400.997300] garage[898]: 2026-11-12T09:25:02.721262Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092502Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=72867e07c127e3754c07d235f4ee646699cf6b13ef5c0f3d9691918df5a2aea7 worker2 # [ 398.163044] nix-grpc-daemon[1723]: time=2026-11-12T09:25:03.435Z level=INFO msg="Upload complete. (235ms)" lb # [ 401.006621] garage[898]: 2026-11-12T09:25:02.731159Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092502Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=50670f202120667e0529f99d8be572dc42187abb67c792f08c1b3d3228faf4e8 worker2 # [ 398.172364] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 paths=3 nar_bytes_in=1880 lb # [ 401.021012] garage[898]: 2026-11-12T09:25:02.731660Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092502Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c03790c62f07803d9fe7b220ed1de173d546adaff806b83a164f151d5d388839 worker2 # [ 398.183288] nix-daemon[976]: reaped child process 2182, status = succeeded lb # [ 401.031075] garage[898]: 2026-11-12T09:25:02.731950Z INFO garage_api_common::generic_server: 192.168.1.4:54250 PUT /farm/619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092502Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4c710436c3dd6b6fc53793866cfa7827dfc571cd3cc4cb42157a9fff51147158 lb # [ 401.040896] garage[898]: 2026-11-12T09:25:02.732265Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092502Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b97f7d03daac5287167d164feed9da3c8875634646a09d33e458a4b88141e4f7 lb # [ 401.048994] garage[898]: 2026-11-12T09:25:02.738086Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 401.054743] niks3-server[1454]: 2026/11/12 09:25:02 INFO Received sign narinfos request method=POST path=/api/pushes/41/sign lb # [ 401.057639] niks3-server[1454]: 2026/11/12 09:25:02 INFO Signed narinfos id=41 count=3 worker1 # [ 399.756626] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:03Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 lb # [ 401.060058] niks3-server[1454]: 2026/11/12 09:25:02 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst worker1 # [ 399.756978] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:03Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=1 lb # [ 401.062845] niks3-server[1454]: 2026/11/12 09:25:02 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 401.065438] niks3-server[1454]: 2026/11/12 09:25:02 INFO Received complete push request method=POST path=/api/pushes/41/complete lb # [ 401.068011] niks3-server[1454]: 2026/11/12 09:25:02 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 401.070471] niks3-server[1454]: 2026/11/12 09:25:02 INFO Completed push id=41 objects=9 duration=24.44142ms worker1 # [ 399.770217] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 401.072182] niks3-server[1454]: 2026/11/12 09:25:02 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 401.074706] niks3-server[1454]: 2026/11/12 09:25:02 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst lb # [ 401.077046] niks3-server[1454]: 2026/11/12 09:25:02 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo lb # [ 401.078923] niks3-server[1454]: 2026/11/12 09:25:02 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls worker1 # [ 399.780634] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 401.080765] niks3-server[1454]: 2026/11/12 09:25:02 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo lb # [ 401.082676] garage[898]: 2026-11-12T09:25:02.739251Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 401.085996] garage[898]: 2026-11-12T09:25:02.740643Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls worker1 # [ 399.794147] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 401.089191] garage[898]: 2026-11-12T09:25:02.741123Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092502Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ad218ccec1274e25d9e1ee64a8aac9081bc55484362f7f8da5795ddccad46c22 lb # [ 401.096685] garage[898]: 2026-11-12T09:25:02.741391Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092502Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7ab91265a9aa3a7c014da548cedf5dd0de0f932edc2f850b824027c66ded93f1 lb # [ 401.102235] garage[898]: 2026-11-12T09:25:02.745718Z INFO garage_api_common::generic_server: 192.168.1.4:54250 PUT /farm/619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092502Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=30f27946197e4ee3cb80a2fd9b8ef445d06bb45803cd3bda522a846e400da7bb lb # [ 401.109622] garage[898]: 2026-11-12T09:25:02.753956Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo lb # [ 401.112486] garage[898]: 2026-11-12T09:25:02.754526Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst lb # [ 401.115381] garage[898]: 2026-11-12T09:25:02.754768Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 401.118680] garage[898]: 2026-11-12T09:25:02.755013Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls worker1 # [ 399.818307] nix-grpc-daemon[2296]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 1/5) lb # [ 401.121380] garage[898]: 2026-11-12T09:25:02.755243Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker1 # [ 399.842221] nix-grpc-daemon[2296]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 2/5) worker1 # [ 399.913102] nix-grpc-daemon[2296]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 229 ms (attempt 3/5) worker1 # [ 400.145701] nix-grpc-daemon[2296]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 536 ms (attempt 4/5) worker1 # [ 400.690761] nix-grpc-daemon[2296]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 400.698797] nix-grpc-daemon[2296]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 402.005071] garage[898]: 2026-11-12T09:25:03.763735Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo worker1 # [ 400.713403] nix-grpc-daemon[2296]: copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' from 'http://lb:5751'... lb # [ 402.011476] garage[898]: 2026-11-12T09:25:03.770328Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo lb # [ 402.020833] garage[898]: 2026-11-12T09:25:03.780343Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 402.027050] garage[898]: 2026-11-12T09:25:03.786129Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst worker1 # [ 400.739892] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) worker1 # [ 400.756480] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 402.375746] garage[898]: 2026-11-12T09:25:04.135198Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo lb # [ 402.380980] garage[898]: 2026-11-12T09:25:04.135632Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 401.395074] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:05Z level=info event=niks3_push_started pid=2487 worker1 # [ 401.412824] nix-daemon[1059]: reaped child process 2471, status = succeeded worker1 # [ 401.541930] nix-grpc-daemon[2487]: time=2026-11-12T09:25:05.335Z level=INFO msg="Configuring client TLS" cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker1.pem key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker1.key ca="" worker1 # [ 401.667186] nix-daemon[1059]: accepted connection from pid 2500, user nix-grpc-daemon (trusted) lb # [ 402.988385] niks3-server[1454]: 2026/11/12 09:25:04 INFO Received push request method=POST path=/api/pushes worker1 # [ 401.692524] nix-daemon[1059]: reaped child process 2503, status = succeeded worker1 # [ 401.702557] nix-grpc-daemon[2487]: time=2026-11-12T09:25:05.493Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 401.706963] nix-grpc-daemon[2487]: time=2026-11-12T09:25:05.493Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 403.008710] garage[898]: 2026-11-12T09:25:04.767528Z INFO garage_api_common::generic_server: 192.168.1.3:42658 PUT /farm/dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092504Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=de5ca5b12751f76545935a0d5700540f91902395a8d5b62f2acc43277f80644e worker1 # [ 401.726962] nix-grpc-daemon[2487]: time=2026-11-12T09:25:05.519Z level=INFO msg="Uploading 1 narinfos" lb # [ 403.033078] garage[898]: 2026-11-12T09:25:04.777602Z INFO garage_api_common::generic_server: 192.168.1.3:42638 PUT /farm/nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092504Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b33d83b591b4ff6d7b52e7dbcf3484b9a617d4600a28d6e7e79a0fff2927579c lb # [ 403.047787] garage[898]: 2026-11-12T09:25:04.778034Z INFO garage_api_common::generic_server: 192.168.1.3:42644 PUT /farm/log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092504Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3412724b6f2c1b7fa53727306807f578cb368b6db510943dd35b42fa88fce316 worker1 # [ 401.759001] nix-grpc-daemon[2487]: time=2026-11-12T09:25:05.552Z level=INFO msg="Upload complete. (213ms)" lb # [ 403.058658] garage[898]: 2026-11-12T09:25:04.781699Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 403.064380] garage[898]: 2026-11-12T09:25:04.785764Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker1 # [ 401.772113] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 403.069600] garage[898]: 2026-11-12T09:25:04.786997Z INFO garage_api_common::generic_server: 192.168.1.3:42644 PUT /farm/dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092504Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=33954feb71647c76c6df9acfb8f3b9828e374e4f971750a6d654dbc0045135cc lb # [ 403.079081] garage[898]: 2026-11-12T09:25:04.792369Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst worker1 # [ 401.783897] nix-daemon[1059]: reaped child process 2469, status = succeeded lb # [ 403.083951] niks3-server[1454]: 2026/11/12 09:25:04 INFO Received sign narinfos request method=POST path=/api/pushes/42/sign lb # [ 403.088076] niks3-server[1454]: 2026/11/12 09:25:04 INFO Signed narinfos id=42 count=1 worker1 # [ 401.788737] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:05Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 lb # [ 403.090326] niks3-server[1454]: 2026/11/12 09:25:04 INFO Received complete push request method=POST path=/api/pushes/42/complete worker1 # [ 401.792360] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:05Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=1 lb # [ 403.093290] niks3-server[1454]: 2026/11/12 09:25:04 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 403.096484] niks3-server[1454]: 2026/11/12 09:25:04 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker1 # [ 401.797737] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 403.099506] niks3-server[1454]: 2026/11/12 09:25:04 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 403.104911] niks3-server[1454]: 2026/11/12 09:25:04 INFO Completed push id=42 objects=4 duration=28.26484ms worker1 # [ 401.807446] nix-grpc-daemon[2296]: copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' from 'http://lb:5751'... lb # [ 403.107389] niks3-server[1454]: 2026/11/12 09:25:04 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo lb # [ 403.109841] garage[898]: 2026-11-12T09:25:04.803879Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo lb # [ 403.114096] garage[898]: 2026-11-12T09:25:04.863069Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo lb # [ 403.119541] garage[898]: 2026-11-12T09:25:04.863877Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) GET /farm/79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo lb # [ 403.123020] garage[898]: 2026-11-12T09:25:04.877966Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst worker1 # [ 401.825515] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 403.126702] garage[898]: 2026-11-12T09:25:04.878903Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) GET /farm/nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst worker1 # [ 401.839584] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 403.480138] garage[898]: 2026-11-12T09:25:05.239477Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo lb # [ 403.485276] garage[898]: 2026-11-12T09:25:05.239947Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 402.472761] nix-daemon[1059]: reaped child process 2511, status = succeeded worker1 # [ 402.590711] nix-daemon[1059]: accepted connection from pid 2527, user nix-grpc-daemon (trusted) lb # [ 403.913123] niks3-server[1454]: 2026/11/12 09:25:05 INFO Received push request method=POST path=/api/pushes worker1 # [ 402.618917] nix-daemon[1059]: reaped child process 2530, status = succeeded worker1 # [ 402.621390] nix-grpc-daemon[2487]: time=2026-11-12T09:25:06.414Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 402.624801] nix-grpc-daemon[2487]: time=2026-11-12T09:25:06.417Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 403.924772] garage[898]: 2026-11-12T09:25:05.684123Z INFO garage_api_common::generic_server: 192.168.1.3:42644 PUT /farm/log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092505Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6aa420616428798064373d92eb8149d4a76f96397e3cc5c3a297d209026fb601 worker1 # [ 402.639935] nix-grpc-daemon[2487]: time=2026-11-12T09:25:06.433Z level=INFO msg="Uploading 1 narinfos" lb # [ 403.954532] garage[898]: 2026-11-12T09:25:05.694815Z INFO garage_api_common::generic_server: 192.168.1.3:42658 PUT /farm/8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092505Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=acecb9b1191e425d91fa6c2ba87b4369531509209ff7c340570191db62b19705 worker1 # [ 402.667991] nix-grpc-daemon[2487]: time=2026-11-12T09:25:06.461Z level=INFO msg="Upload complete. (215ms)" lb # [ 403.968184] garage[898]: 2026-11-12T09:25:05.695193Z INFO garage_api_common::generic_server: 192.168.1.3:42638 PUT /farm/nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092505Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6e5337a0b102c67da7603805c3866c474df938d481956cc97ddeeb4af06115b9 worker1 # [ 402.676665] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=0 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 403.979280] garage[898]: 2026-11-12T09:25:05.701093Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 403.984536] garage[898]: 2026-11-12T09:25:05.701613Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst worker1 # [ 402.688973] nix-daemon[1059]: reaped child process 2509, status = succeeded lb # [ 403.989901] garage[898]: 2026-11-12T09:25:05.701874Z INFO garage_api_common::generic_server: 192.168.1.3:42638 PUT /farm/8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092505Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0208dc9ad3bfa8c4ecd1f9aff4d6db697170127164e8d790d0958421287be508 lb # [ 404.000261] garage[898]: 2026-11-12T09:25:05.705794Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 404.007784] niks3-server[1454]: 2026/11/12 09:25:05 INFO Received sign narinfos request method=POST path=/api/pushes/43/sign worker1 # [ 402.707654] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:06Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 lb # [ 404.010796] niks3-server[1454]: 2026/11/12 09:25:05 INFO Signed narinfos id=43 count=1 worker1 # [ 402.711824] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:06Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=1 lb # [ 404.013124] niks3-server[1454]: 2026/11/12 09:25:05 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 404.017241] niks3-server[1454]: 2026/11/12 09:25:05 INFO Received complete push request method=POST path=/api/pushes/43/complete worker1 # [ 402.718297] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 404.020223] niks3-server[1454]: 2026/11/12 09:25:05 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 404.025313] niks3-server[1454]: 2026/11/12 09:25:05 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls worker1 # [ 402.727301] nix-grpc-daemon[2296]: copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' from 'http://lb:5751'... lb # [ 404.027892] niks3-server[1454]: 2026/11/12 09:25:05 INFO Completed push id=43 objects=8 duration=17.08282ms lb # [ 404.029928] niks3-server[1454]: 2026/11/12 09:25:05 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo lb # [ 404.035073] garage[898]: 2026-11-12T09:25:05.723605Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo lb # [ 404.038848] garage[898]: 2026-11-12T09:25:05.783688Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker1 # [ 402.741393] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 404.042611] garage[898]: 2026-11-12T09:25:05.784607Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo lb # [ 404.047303] garage[898]: 2026-11-12T09:25:05.792991Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 404.051415] garage[898]: 2026-11-12T09:25:05.793688Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst worker1 # [ 402.757462] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 404.306895] systemd[1]: Stopping User Manager for UID 0... lb # [ 404.313663] systemd[1742]: Activating special unit Exit the Session... lb # [ 404.318993] systemd[1742]: Stopped target Main User Target. lb # [ 404.323928] systemd[1742]: Stopped target Basic System. lb # [ 404.326950] systemd[1742]: Stopped target Paths. lb # [ 404.330315] systemd[1742]: Stopped target Sockets. lb # [ 404.331444] systemd[1742]: Stopped target Timers. lb # [ 404.332661] systemd[1742]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 404.334429] systemd[1742]: Closed D-Bus User Message Bus Socket. lb # [ 404.335842] systemd[1742]: Stopped Create User Files and Directories. lb # [ 404.338129] systemd[1742]: Removed slice User Application Slice. lb # [ 404.339532] systemd[1742]: Reached target Shutdown. lb # [ 404.341102] systemd[1742]: Finished Exit the Session. lb # [ 404.342389] systemd[1742]: Reached target Exit the Session. lb # [ 404.369063] systemd-logind[499]: Removed session 46. lb # [ 404.379057] systemd[1]: user@0.service: Deactivated successfully. lb # [ 404.384225] systemd[1]: Stopped User Manager for UID 0. lb # [ 404.444334] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 404.485510] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 404.493822] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 404.500549] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 404.724313] garage[898]: 2026-11-12T09:25:06.483480Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nblg066ygaz2avzlmix3rnngr62hld8f.narinfo lb # [ 404.729062] garage[898]: 2026-11-12T09:25:06.483947Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 403.855942] nix-daemon[1059]: reaped child process 2538, status = succeeded worker1 # [ 403.960572] nix-daemon[1059]: accepted connection from pid 2554, user nix-grpc-daemon (trusted) worker1 # [ 403.987058] nix-daemon[1059]: reaped child process 2557, status = succeeded lb # [ 405.289946] niks3-server[1454]: 2026/11/12 09:25:07 INFO Received push request method=POST path=/api/pushes worker1 # [ 403.999567] nix-grpc-daemon[2487]: time=2026-11-12T09:25:07.792Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 404.002862] nix-grpc-daemon[2487]: time=2026-11-12T09:25:07.792Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 405.302936] garage[898]: 2026-11-12T09:25:07.061470Z INFO garage_api_common::generic_server: 192.168.1.3:42638 PUT /farm/log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092507Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e67d25a2484838ec33ceaec0653b12f02f4002a9e180f2c7378fb20276c88a72 worker1 # [ 404.018718] nix-grpc-daemon[2487]: time=2026-11-12T09:25:07.812Z level=INFO msg="Uploading 1 narinfos" lb # [ 405.330593] garage[898]: 2026-11-12T09:25:07.073379Z INFO garage_api_common::generic_server: 192.168.1.3:42644 PUT /farm/nblg066ygaz2avzlmix3rnngr62hld8f.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092507Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bb1f21365dbb14b3aee25afd869540a3ce21e809c6aac4220de66c3d5bceeac5 lb # [ 405.339840] garage[898]: 2026-11-12T09:25:07.074327Z INFO garage_api_common::generic_server: 192.168.1.3:42658 PUT /farm/nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092507Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bc886c61b32acba827634dbfaf1b5459f04153593b061a3c2824c2fa1db78d93 lb # [ 405.352067] garage[898]: 2026-11-12T09:25:07.079220Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 405.357846] garage[898]: 2026-11-12T09:25:07.081742Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 405.363783] garage[898]: 2026-11-12T09:25:07.082048Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst lb # [ 405.370557] garage[898]: 2026-11-12T09:25:07.082338Z INFO garage_api_common::generic_server: 192.168.1.3:42658 PUT /farm/nblg066ygaz2avzlmix3rnngr62hld8f.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092507Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=60452dc953d247c2dd1d80ab33d66cbdb58751aaacd591782efae8da96c97589 lb # [ 405.380391] niks3-server[1454]: 2026/11/12 09:25:07 INFO Received sign narinfos request method=POST path=/api/pushes/44/sign worker1 # [ 404.080738] nix-grpc-daemon[2487]: time=2026-11-12T09:25:07.874Z level=INFO msg="Upload complete. (310ms)" lb # [ 405.382688] niks3-server[1454]: 2026/11/12 09:25:07 INFO Signed narinfos id=44 count=1 lb # [ 405.384262] niks3-server[1454]: 2026/11/12 09:25:07 INFO Received complete push request method=POST path=/api/pushes/44/complete lb # [ 405.387658] niks3-server[1454]: 2026/11/12 09:25:07 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 405.391859] niks3-server[1454]: 2026/11/12 09:25:07 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst worker1 # [ 404.089754] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 405.394695] niks3-server[1454]: 2026/11/12 09:25:07 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 405.397156] niks3-server[1454]: 2026/11/12 09:25:07 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo lb # [ 405.399469] niks3-server[1454]: 2026/11/12 09:25:07 INFO Completed push id=44 objects=12 duration=53.33796ms lb # [ 405.402111] garage[898]: 2026-11-12T09:25:07.087662Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nblg066ygaz2avzlmix3rnngr62hld8f.narinfo worker1 # [ 404.106723] nix-daemon[1059]: reaped child process 2536, status = succeeded client # [ 404.128596] sshd-session[2000]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 404.132452] sshd-session[2000]: Disconnected from user root UNKNOWN port 65535 client # [ 404.136278] sshd-session[1978]: pam_unix(sshd:session): session closed for user root client # [ 404.142365] systemd[1]: sshd-vsock@58-59-3:22-2:58.service: Deactivated successfully. client # [ 404.151056] systemd[1]: session-69.scope: Deactivated successfully. client # [ 404.153943] systemd[1]: session-69.scope: Consumed 211ms CPU time over 5.064s wall clock time, 38.1M memory peak, 12.7K incoming IP traffic, 13.7K outgoing IP traffic. client # [ 404.162236] systemd-logind[427]: Session 69 logged out. Waiting for processes to exit. client # [ 404.166368] systemd-logind[427]: Removed session 69. worker1 # [ 404.788720] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 404.797090] systemd[2382]: Activating special unit Exit the Session... worker1 # [ 404.801954] systemd[2382]: Stopped target Main User Target. worker1 # [ 404.803451] systemd[2382]: Stopped target Basic System. worker1 # [ 404.809532] systemd[2382]: Stopped target Paths. worker1 # [ 404.810724] systemd[2382]: Stopped target Sockets. worker1 # [ 404.811829] systemd[2382]: Stopped target Timers. worker1 # [ 404.814021] systemd[2382]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 404.815858] systemd[2382]: Closed D-Bus User Message Bus Socket. worker1 # [ 404.817598] systemd[2382]: Stopped Create User Files and Directories. worker1 # [ 404.820526] systemd[2382]: Removed slice User Application Slice. worker1 # [ 404.821945] systemd[2382]: Reached target Shutdown. worker1 # [ 404.823227] systemd[2382]: Finished Exit the Session. worker1 # [ 404.825021] systemd[2382]: Reached target Exit the Session. worker1 # [ 404.840888] systemd-logind[539]: Removed session 68. worker1 # [ 404.846916] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 404.850101] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 404.870503] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 404.919300] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 404.923683] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 404.928844] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 406.328372] envoy[897]: conn peer=[2001:db8:1::1]:45560 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=6319 tx=4007 ms=4829 worker2 # [ 405.835383] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 405.841848] systemd[2130]: Activating special unit Exit the Session... worker2 # [ 405.849614] systemd[2130]: Stopped target Main User Target. worker2 # [ 405.851269] systemd[2130]: Stopped target Basic System. worker2 # [ 405.853796] systemd[2130]: Stopped target Paths. worker2 # [ 405.855013] systemd[2130]: Stopped target Sockets. worker2 # [ 405.858098] systemd[2130]: Stopped target Timers. worker2 # [ 405.859322] systemd[2130]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 405.861354] systemd[2130]: Closed D-Bus User Message Bus Socket. worker2 # [ 405.862831] systemd[2130]: Stopped Create User Files and Directories. worker2 # [ 405.864649] systemd[2130]: Removed slice User Application Slice. worker2 # [ 405.866152] systemd[2130]: Reached target Shutdown. worker2 # [ 405.867329] systemd[2130]: Finished Exit the Session. worker2 # [ 405.869850] systemd[2130]: Reached target Exit the Session. worker2 # [ 405.914121] systemd-logind[515]: Removed session 52. worker2 # [ 405.926740] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 405.930089] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 405.950370] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 405.990730] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 405.995063] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 406.001208] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 407.737074] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:11Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:44018 client # [ 408.608602] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 408.616135] systemd[1]: Started SSH per-connection Daemon (vsock:2:59). client # [ 408.726203] sshd-session[2019]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 408.736741] sshd-session[2019]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 408.745934] sshd-session[2019]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 408.755270] systemd-logind[427]: New session '71' of user 'root' with class 'user' and type 'tty'. client # [ 408.760517] systemd[1]: Started Session 71 of User root. client # [ 408.914959] sshd-session[2025]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 408.917503] sshd-session[2025]: Disconnected from user root UNKNOWN port 65535 client # [ 408.919147] sshd-session[2019]: pam_unix(sshd:session): session closed for user root client # [ 408.923189] systemd[1]: sshd-vsock@59-60-3:22-2:59.service: Deactivated successfully. client # [ 408.928839] systemd[1]: session-71.scope: Deactivated successfully. client # [ 408.933011] systemd-logind[427]: Session 71 logged out. Waiting for processes to exit. client # [ 408.935346] systemd-logind[427]: Removed session 71. worker1 # [ 409.094815] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 409.103803] systemd[1]: Started SSH per-connection Daemon (vsock:2:63). worker1 # [ 409.198771] sshd-session[2563]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 409.208597] sshd-session[2563]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 409.217603] sshd-session[2563]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 409.237727] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 409.246318] systemd-logind[539]: New session '74' of user 'root' with class 'user' and type 'tty'. worker1 # [ 409.277067] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 409.283927] systemd[1]: Starting User Manager for UID 0... worker1 # [ 409.310109] (systemd)[2571]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 409.316152] systemd-logind[539]: New session '75' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 409.406077] systemd[2571]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 409.504758] systemd[2571]: Queued start job for default target Main User Target. worker1 # [ 409.513195] systemd[2571]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 409.516219] systemd[2571]: Created slice User Application Slice. worker1 # [ 409.522160] systemd[2571]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 409.523461] systemd[2571]: Reached target Paths. worker1 # [ 409.526793] systemd[2571]: Reached target Timers. worker1 # [ 409.527591] systemd[2571]: Starting D-Bus User Message Bus Socket... worker1 # [ 409.532386] systemd[2571]: Starting Create User Files and Directories... worker1 # [ 409.575066] systemd[2571]: Finished Create User Files and Directories. worker1 # [ 409.579188] systemd[2571]: Listening on D-Bus User Message Bus Socket. worker1 # [ 409.581829] systemd[2571]: Reached target Sockets. worker1 # [ 409.587156] systemd[2571]: Reached target Basic System. worker1 # [ 409.588354] systemd[2571]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 409.589782] systemd[2571]: Reached target Main User Target. worker1 # [ 409.590600] systemd[2571]: Startup finished in 251ms. worker1 # [ 409.591334] systemd[1]: Started User Manager for UID 0. worker1 # [ 409.595342] systemd[1]: Started Session 74 of User root. worker1 # [ 409.611301] sshd-session[2584]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 409.614216] sshd-session[2584]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 409.616471] sshd-session[2563]: pam_unix(sshd:session): session closed for user root worker1 # [ 409.620505] systemd[1]: sshd-vsock@63-64-5:22-2:63.service: Deactivated successfully. worker1 # [ 409.626660] systemd[1]: session-74.scope: Deactivated successfully. worker1 # [ 409.631802] systemd-logind[539]: Session 74 logged out. Waiting for processes to exit. worker1 # [ 409.634258] systemd-logind[539]: Removed session 74. worker2 # [ 408.364453] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 408.373600] systemd[1]: Started SSH per-connection Daemon (vsock:2:45). worker2 # [ 408.477130] sshd-session[2195]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 408.487409] sshd-session[2195]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 408.496411] sshd-session[2195]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 408.518390] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 408.522755] systemd-logind[515]: New session '56' of user 'root' with class 'user' and type 'tty'. worker2 # [ 408.557268] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 408.563751] systemd[1]: Starting User Manager for UID 0... worker2 # [ 408.590275] (systemd)[2203]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 408.596185] systemd-logind[515]: New session '57' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 408.687403] systemd[2203]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 408.788709] systemd[2203]: Queued start job for default target Main User Target. worker2 # [ 408.793102] systemd[2203]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 408.797348] systemd[2203]: Created slice User Application Slice. worker2 # [ 408.798439] systemd[2203]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 408.799559] systemd[2203]: Reached target Paths. worker2 # [ 408.803681] systemd[2203]: Reached target Timers. worker2 # [ 408.805733] systemd[2203]: Starting D-Bus User Message Bus Socket... worker2 # [ 408.806734] systemd[2203]: Starting Create User Files and Directories... worker2 # [ 408.852658] systemd[2203]: Listening on D-Bus User Message Bus Socket. worker2 # [ 408.855425] systemd[2203]: Reached target Sockets. worker2 # [ 408.858346] systemd[2203]: Finished Create User Files and Directories. worker2 # [ 408.859378] systemd[2203]: Reached target Basic System. worker2 # [ 408.862547] systemd[2203]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 408.867189] systemd[2203]: Reached target Main User Target. worker2 # [ 408.872958] systemd[2203]: Startup finished in 245ms. worker2 # [ 408.874173] systemd[1]: Started User Manager for UID 0. worker2 # [ 408.874969] systemd[1]: Started Session 56 of User root. worker2 # [ 408.887900] sshd-session[2216]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 408.890730] sshd-session[2216]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 408.892097] sshd-session[2195]: pam_unix(sshd:session): session closed for user root worker2 # [ 408.895944] systemd[1]: sshd-vsock@45-46-6:22-2:45.service: Deactivated successfully. worker2 # [ 408.901734] systemd[1]: session-56.scope: Deactivated successfully. worker2 # [ 408.905980] systemd-logind[515]: Session 56 logged out. Waiting for processes to exit. worker2 # [ 408.908563] systemd-logind[515]: Removed session 56. client # [ 410.577579] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 410.585338] systemd[1]: Started SSH per-connection Daemon (vsock:2:60). client # [ 410.685051] sshd-session[2032]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 410.695209] sshd-session[2032]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 410.704330] sshd-session[2032]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 410.716760] systemd-logind[427]: New session '72' of user 'root' with class 'user' and type 'tty'. client # [ 410.723243] systemd[1]: Started Session 72 of User root. client # [ 410.740993] sshd-session[2038]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 410.743885] sshd-session[2038]: Disconnected from user root UNKNOWN port 65535 client # [ 410.746005] sshd-session[2032]: pam_unix(sshd:session): session closed for user root client # [ 410.750397] systemd[1]: sshd-vsock@60-61-3:22-2:60.service: Deactivated successfully. client # [ 410.756364] systemd[1]: session-72.scope: Deactivated successfully. client # [ 410.760771] systemd-logind[427]: Session 72 logged out. Waiting for processes to exit. client # [ 410.763563] systemd-logind[427]: Removed session 72. client # [ 411.040965] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 411.048889] systemd[1]: Started SSH per-connection Daemon (vsock:2:61). client # [ 411.151145] sshd-session[2043]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 411.161870] sshd-session[2043]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 411.169889] sshd-session[2043]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 411.180413] systemd-logind[427]: New session '73' of user 'root' with class 'user' and type 'tty'. client # [ 411.186695] systemd[1]: Started Session 73 of User root. lb # [ 412.620862] garage[898]: 2026-11-12T09:25:14.378607Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nix-cache-info lb # [ 412.625782] garage[898]: 2026-11-12T09:25:14.385216Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) GET /farm/nix-cache-info lb # [ 412.632182] garage[898]: 2026-11-12T09:25:14.391649Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nblg066ygaz2avzlmix3rnngr62hld8f.narinfo lb # [ 412.639144] garage[898]: 2026-11-12T09:25:14.398407Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nblg066ygaz2avzlmix3rnngr62hld8f.narinfo lb # [ 412.646129] garage[898]: 2026-11-12T09:25:14.404547Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/nblg066ygaz2avzlmix3rnngr62hld8f.narinfo lb # [ 412.654867] garage[898]: 2026-11-12T09:25:14.405280Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) GET /farm/nblg066ygaz2avzlmix3rnngr62hld8f.narinfo lb # [ 412.659398] garage[898]: 2026-11-12T09:25:14.411388Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker1 # [ 411.369492] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:15Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:44018 lb # [ 412.668060] garage[898]: 2026-11-12T09:25:14.412758Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo lb # [ 412.672519] garage[898]: 2026-11-12T09:25:14.413149Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) GET /farm/8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo lb # [ 412.681190] garage[898]: 2026-11-12T09:25:14.413928Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo lb # [ 412.687655] garage[898]: 2026-11-12T09:25:14.424465Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 412.692630] garage[898]: 2026-11-12T09:25:14.426256Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 412.697113] garage[898]: 2026-11-12T09:25:14.439527Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 412.701503] garage[898]: 2026-11-12T09:25:14.440393Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 412.705677] garage[898]: 2026-11-12T09:25:14.446164Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst lb # [ 412.709561] garage[898]: 2026-11-12T09:25:14.446915Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) GET /farm/nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst client # [ 411.416729] sshd-session[2049]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 411.418995] sshd-session[2049]: Disconnected from user root UNKNOWN port 65535 client # [ 411.422081] sshd-session[2043]: pam_unix(sshd:session): session closed for user root client # [ 411.427168] systemd[1]: sshd-vsock@61-62-3:22-2:61.service: Deactivated successfully. client # [ 411.434758] systemd[1]: session-73.scope: Deactivated successfully. client # [ 411.439427] systemd[1]: session-73.scope: Consumed 139ms CPU time over 252ms wall clock time, 23.8M memory peak, 4.5K incoming IP traffic, 2.8K outgoing IP traffic. client # [ 411.445170] systemd-logind[427]: Session 73 logged out. Waiting for processes to exit. client # [ 411.446706] systemd-logind[427]: Removed session 73. client # [ 411.497245] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 411.504658] systemd[1]: Started SSH per-connection Daemon (vsock:2:62). client # [ 411.599704] sshd-session[2059]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 411.608973] sshd-session[2059]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 411.617660] sshd-session[2059]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 411.626162] systemd-logind[427]: New session '74' of user 'root' with class 'user' and type 'tty'. client # [ 411.636899] systemd[1]: Started Session 74 of User root. client # [ 411.660684] sshd-session[2065]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 411.663489] sshd-session[2065]: Disconnected from user root UNKNOWN port 65535 client # [ 411.665547] sshd-session[2059]: pam_unix(sshd:session): session closed for user root client # [ 411.670122] systemd[1]: sshd-vsock@62-63-3:22-2:62.service: Deactivated successfully. client # [ 411.675386] systemd[1]: session-74.scope: Deactivated successfully. client # [ 411.679828] systemd-logind[427]: Session 74 logged out. Waiting for processes to exit. client # [ 411.682598] systemd-logind[427]: Removed session 74. worker1 # [ 416.436437] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 416.440112] systemd[1]: Started SSH per-connection Daemon (vsock:2:64). worker1 # [ 416.538328] sshd-session[2589]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 416.547715] sshd-session[2589]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 416.556600] sshd-session[2589]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 416.568319] systemd-logind[539]: New session '76' of user 'root' with class 'user' and type 'tty'. worker1 # [ 416.573122] systemd[1]: Started Session 76 of User root. worker1 # [ 416.619070] sshd-session[2595]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 416.621280] sshd-session[2595]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 416.622770] sshd-session[2589]: pam_unix(sshd:session): session closed for user root worker1 # [ 416.628369] systemd[1]: sshd-vsock@64-65-5:22-2:64.service: Deactivated successfully. worker1 # [ 416.634582] systemd[1]: session-76.scope: Deactivated successfully. worker1 # [ 416.636689] systemd[1]: session-76.scope: Consumed 31ms CPU time over 63ms wall clock time, 3.1M memory peak, 13.8K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 416.642138] systemd-logind[539]: Session 76 logged out. Waiting for processes to exit. worker1 # [ 416.644854] systemd-logind[539]: Removed session 76. worker1 # [ 417.984964] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 417.989713] systemd[1]: Started SSH per-connection Daemon (vsock:2:65). worker1 # [ 418.087520] sshd-session[2600]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 418.096272] sshd-session[2600]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 418.107082] sshd-session[2600]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 418.116729] systemd-logind[539]: New session '77' of user 'root' with class 'user' and type 'tty'. worker1 # [ 418.131099] systemd[1]: Started Session 77 of User root. worker1 # [ 418.165231] sshd-session[2606]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 418.167987] sshd-session[2606]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 418.169954] sshd-session[2600]: pam_unix(sshd:session): session closed for user root worker1 # [ 418.173676] systemd[1]: sshd-vsock@65-66-5:22-2:65.service: Deactivated successfully. worker1 # [ 418.178951] systemd[1]: session-77.scope: Deactivated successfully. worker1 # [ 418.180597] systemd[1]: session-77.scope: Consumed 28ms CPU time over 51ms wall clock time, 3.1M memory peak, 13.8K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 418.185917] systemd-logind[539]: Session 77 logged out. Waiting for processes to exit. worker1 # [ 418.188322] systemd-logind[539]: Removed session 77. worker1 # [ 418.280248] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 418.287212] systemd[1]: Started SSH per-connection Daemon (vsock:2:66). worker1 # [ 418.386710] sshd-session[2611]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 418.396287] sshd-session[2611]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 418.405032] sshd-session[2611]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 418.415537] systemd-logind[539]: New session '78' of user 'root' with class 'user' and type 'tty'. worker1 # [ 418.420542] systemd[1]: Started Session 78 of User root. worker1 # [ 418.456461] sshd-session[2617]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 418.457944] sshd-session[2617]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 418.459539] sshd-session[2611]: pam_unix(sshd:session): session closed for user root worker1 # [ 418.463789] systemd[1]: sshd-vsock@66-67-5:22-2:66.service: Deactivated successfully. worker1 # [ 418.469468] systemd[1]: session-78.scope: Deactivated successfully. worker1 # [ 418.472935] systemd[1]: session-78.scope: Consumed 27ms CPU time over 50ms wall clock time, 4.8M memory peak, 13.8K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 418.477516] systemd-logind[539]: Session 78 logged out. Waiting for processes to exit. worker1 # [ 418.478758] systemd-logind[539]: Removed session 78. worker2 # [ 417.425598] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 417.433982] systemd[1]: Started SSH per-connection Daemon (vsock:2:46). worker2 # [ 417.538603] sshd-session[2221]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 417.547600] sshd-session[2221]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 417.558087] sshd-session[2221]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 417.568579] systemd-logind[515]: New session '58' of user 'root' with class 'user' and type 'tty'. worker2 # [ 417.577136] systemd[1]: Started Session 58 of User root. worker2 # [ 417.613503] sshd-session[2227]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 417.616291] sshd-session[2227]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 417.617838] sshd-session[2221]: pam_unix(sshd:session): session closed for user root worker2 # [ 417.622517] systemd[1]: sshd-vsock@46-47-6:22-2:46.service: Deactivated successfully. worker2 # [ 417.627751] systemd[1]: session-58.scope: Deactivated successfully. worker2 # [ 417.631203] systemd[1]: session-58.scope: Consumed 29ms CPU time over 52ms wall clock time, 3.1M memory peak, 13K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 417.635884] systemd-logind[515]: Session 58 logged out. Waiting for processes to exit. worker2 # [ 417.637421] systemd-logind[515]: Removed session 58. worker2 # [ 417.716205] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 417.720834] systemd[1]: Started SSH per-connection Daemon (vsock:2:47). worker2 # [ 417.818362] sshd-session[2232]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 417.827635] sshd-session[2232]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 417.835849] sshd-session[2232]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 417.844315] systemd-logind[515]: New session '59' of user 'root' with class 'user' and type 'tty'. worker2 # [ 417.852530] systemd[1]: Started Session 59 of User root. worker2 # [ 417.886889] sshd-session[2238]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 417.889842] sshd-session[2238]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 417.890959] sshd-session[2232]: pam_unix(sshd:session): session closed for user root worker2 # [ 417.895448] systemd[1]: sshd-vsock@47-48-6:22-2:47.service: Deactivated successfully. worker2 # [ 417.900929] systemd[1]: session-59.scope: Deactivated successfully. worker2 # [ 417.902635] systemd[1]: session-59.scope: Consumed 26ms CPU time over 49ms wall clock time, 3.1M memory peak, 13K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 417.908746] systemd-logind[515]: Session 59 logged out. Waiting for processes to exit. worker2 # [ 417.909953] systemd-logind[515]: Removed session 59. worker2 # [ 418.025976] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 418.035469] systemd[1]: Started SSH per-connection Daemon (vsock:2:48). worker2 # [ 418.130595] sshd-session[2243]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 418.138815] sshd-session[2243]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 418.151301] sshd-session[2243]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 418.162848] systemd-logind[515]: New session '60' of user 'root' with class 'user' and type 'tty'. worker2 # [ 418.168748] systemd[1]: Started Session 60 of User root. worker2 # [ 418.205204] sshd-session[2249]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 418.206817] sshd-session[2249]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 418.208654] sshd-session[2243]: pam_unix(sshd:session): session closed for user root worker2 # [ 418.212950] systemd[1]: sshd-vsock@48-49-6:22-2:48.service: Deactivated successfully. worker2 # [ 418.218715] systemd[1]: session-60.scope: Deactivated successfully. worker2 # [ 418.222475] systemd[1]: session-60.scope: Consumed 28ms CPU time over 51ms wall clock time, 4.8M memory peak, 13K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 418.227278] systemd-logind[515]: Session 60 logged out. Waiting for processes to exit. worker2 # [ 418.228894] systemd-logind[515]: Removed session 60. ok test farm::serial::inputs_already_in_the_cache_are_not_sent_to_the_scheduler ... worker1 # [ 420.087772] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 420.096127] systemd[1]: Started SSH per-connection Daemon (vsock:2:67). worker1 # [ 420.195765] sshd-session[2622]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 420.204245] sshd-session[2622]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 420.214691] sshd-session[2622]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 420.226331] systemd-logind[539]: New session '79' of user 'root' with class 'user' and type 'tty'. worker1 # [ 420.233507] systemd[1]: Started Session 79 of User root. worker1 # [ 420.267094] sshd-session[2628]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 420.270019] sshd-session[2628]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 420.271357] sshd-session[2622]: pam_unix(sshd:session): session closed for user root worker1 # [ 420.275539] systemd[1]: sshd-vsock@67-68-5:22-2:67.service: Deactivated successfully. worker1 # [ 420.281428] systemd[1]: session-79.scope: Deactivated successfully. worker1 # [ 420.285675] systemd-logind[539]: Session 79 logged out. Waiting for processes to exit. worker1 # [ 420.288315] systemd-logind[539]: Removed session 79. client # [ 421.893469] systemd[1]: Stopping User Manager for UID 0... client # [ 421.902316] systemd[1987]: Activating special unit Exit the Session... client # [ 421.909294] systemd[1987]: Stopped target Main User Target. client # [ 421.910834] systemd[1987]: Stopped target Basic System. client # [ 421.914537] systemd[1987]: Stopped target Paths. client # [ 421.915860] systemd[1987]: Stopped target Sockets. client # [ 421.917732] systemd[1987]: Stopped target Timers. client # [ 421.918916] systemd[1987]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 421.921708] systemd[1987]: Closed D-Bus User Message Bus Socket. client # [ 421.923188] systemd[1987]: Stopped Create User Files and Directories. client # [ 421.924880] systemd[1987]: Removed slice User Application Slice. client # [ 421.926404] systemd[1987]: Reached target Shutdown. client # [ 421.927557] systemd[1987]: Finished Exit the Session. client # [ 421.928835] systemd[1987]: Reached target Exit the Session. client # [ 421.946997] systemd-logind[427]: Removed session 70. client # [ 421.955269] systemd[1]: user@0.service: Deactivated successfully. client # [ 421.960899] systemd[1]: Stopped User Manager for UID 0. client # [ 422.023227] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 422.059453] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 422.065007] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 422.069038] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 420.581918] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 420.589418] systemd[1]: Started SSH per-connection Daemon (vsock:2:49). worker2 # [ 420.685914] sshd-session[2254]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 420.694975] sshd-session[2254]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 420.703567] sshd-session[2254]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 420.715135] systemd-logind[515]: New session '61' of user 'root' with class 'user' and type 'tty'. worker2 # [ 420.720599] systemd[1]: Started Session 61 of User root. worker2 # [ 420.754320] sshd-session[2260]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 420.757223] sshd-session[2260]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 420.758710] sshd-session[2254]: pam_unix(sshd:session): session closed for user root worker2 # [ 420.762951] systemd[1]: sshd-vsock@49-50-6:22-2:49.service: Deactivated successfully. worker2 # [ 420.769169] systemd[1]: session-61.scope: Deactivated successfully. worker2 # [ 420.774112] systemd-logind[515]: Session 61 logged out. Waiting for processes to exit. worker2 # [ 420.776759] systemd-logind[515]: Removed session 61. lb # [ 423.649129] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 423.657371] systemd[1]: Started SSH per-connection Daemon (vsock:2:36). lb # [ 423.763701] sshd-session[1783]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 423.772631] sshd-session[1783]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 423.781489] sshd-session[1783]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 423.812533] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 423.846971] systemd-logind[499]: New session '48' of user 'root' with class 'user' and type 'tty'. lb # [ 423.857560] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 423.864210] systemd[1]: Starting User Manager for UID 0... lb # [ 423.885606] (systemd)[1793]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 423.891968] systemd-logind[499]: New session '49' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 423.981824] systemd[1793]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 424.081801] systemd[1793]: Queued start job for default target Main User Target. lb # [ 424.085024] systemd[1793]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 424.089231] systemd[1793]: Created slice User Application Slice. lb # [ 424.090359] systemd[1793]: Started Daily Cleanup of User's Temporary Directories. lb # [ 424.091431] systemd[1793]: Reached target Paths. lb # [ 424.095065] systemd[1793]: Reached target Timers. lb # [ 424.095844] systemd[1793]: Starting D-Bus User Message Bus Socket... lb # [ 424.100407] systemd[1793]: Starting Create User Files and Directories... lb # [ 424.146375] systemd[1793]: Finished Create User Files and Directories. lb # [ 424.150691] systemd[1793]: Listening on D-Bus User Message Bus Socket. lb # [ 424.153143] systemd[1793]: Reached target Sockets. lb # [ 424.154118] systemd[1793]: Reached target Basic System. lb # [ 424.154936] systemd[1793]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 424.159188] systemd[1793]: Reached target Main User Target. lb # [ 424.160319] systemd[1793]: Startup finished in 245ms. lb # [ 424.161083] systemd[1]: Started User Manager for UID 0. lb # [ 424.164536] systemd[1]: Started Session 48 of User root. lb # [ 424.197909] sshd-session[1807]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 424.200588] sshd-session[1807]: Disconnected from user root UNKNOWN port 65535 lb # [ 424.202108] sshd-session[1783]: pam_unix(sshd:session): session closed for user root lb # [ 424.206167] systemd[1]: sshd-vsock@36-37-4:22-2:36.service: Deactivated successfully. lb # [ 424.211433] systemd[1]: session-48.scope: Deactivated successfully. lb # [ 424.213543] systemd[1]: session-48.scope: Consumed 26ms CPU time over 48ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 424.219320] systemd-logind[499]: Session 48 logged out. Waiting for processes to exit. lb # [ 424.220849] systemd-logind[499]: Removed session 48. worker1 # [ 423.244377] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 423.248168] systemd[1]: Started SSH per-connection Daemon (vsock:2:68). worker1 # [ 423.347692] sshd-session[2634]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 423.356761] sshd-session[2634]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 423.365220] sshd-session[2634]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 423.376811] systemd-logind[539]: New session '80' of user 'root' with class 'user' and type 'tty'. worker1 # [ 423.387235] systemd[1]: Started Session 80 of User root. worker1 # [ 423.422493] sshd-session[2640]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 423.423893] sshd-session[2640]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 423.426044] sshd-session[2634]: pam_unix(sshd:session): session closed for user root worker1 # [ 423.430110] systemd[1]: sshd-vsock@68-69-5:22-2:68.service: Deactivated successfully. worker1 # [ 423.435632] systemd[1]: session-80.scope: Deactivated successfully. worker1 # [ 423.437604] systemd[1]: session-80.scope: Consumed 29ms CPU time over 52ms wall clock time, 4.8M memory peak, 13.8K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 423.443240] systemd-logind[539]: Session 80 logged out. Waiting for processes to exit. worker1 # [ 423.445998] systemd-logind[539]: Removed session 80. client # [ 424.356809] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 424.362340] systemd[1]: Started SSH per-connection Daemon (vsock:2:63). client # [ 424.463151] sshd-session[2075]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 424.472967] sshd-session[2075]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 424.482051] sshd-session[2075]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 424.501343] systemd-logind[427]: New session '75' of user 'root' with class 'user' and type 'tty'. client # [ 424.516458] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 424.555793] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 424.563158] systemd[1]: Starting User Manager for UID 0... client # [ 424.589625] (systemd)[2084]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 424.595767] systemd-logind[427]: New session '76' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 424.683934] systemd[2084]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 424.783501] systemd[2084]: Queued start job for default target Main User Target. client # [ 424.793042] systemd[2084]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 424.797434] systemd[2084]: Created slice User Application Slice. client # [ 424.798474] systemd[2084]: Started Daily Cleanup of User's Temporary Directories. client # [ 424.799565] systemd[2084]: Reached target Paths. client # [ 424.802922] systemd[2084]: Reached target Timers. client # [ 424.803701] systemd[2084]: Starting D-Bus User Message Bus Socket... client # [ 424.808234] systemd[2084]: Starting Create User Files and Directories... client # [ 424.852204] systemd[2084]: Finished Create User Files and Directories. client # [ 424.857004] systemd[2084]: Listening on D-Bus User Message Bus Socket. client # [ 424.858185] systemd[2084]: Reached target Sockets. client # [ 424.858909] systemd[2084]: Reached target Basic System. client # [ 424.859626] systemd[2084]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 424.864799] systemd[2084]: Reached target Main User Target. client # [ 424.865719] systemd[2084]: Startup finished in 246ms. client # [ 424.866584] systemd[1]: Started User Manager for UID 0. client # [ 424.871063] systemd[1]: Started Session 75 of User root. worker2 # [ 423.503321] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48140 worker1 # [ 425.066603] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 426.374019] garage[898]: 2026-11-12T09:25:28.132463Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/7kpqdp1q74fzf67n892jpmz2kn4gzkn2.narinfo lb # [ 426.374333] garage[898]: 2026-11-12T09:25:28.133002Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 423.535419] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 426.384266] garage[898]: 2026-11-12T09:25:28.142433Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/kmq5blan6804mpy8yrwkp67adxc4vwkl.narinfo lb # [ 426.384510] garage[898]: 2026-11-12T09:25:28.142910Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 426.384566] garage[898]: 2026-11-12T09:25:28.143043Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/v10rv28cb60v8s95fzdjhxzpzagzv810.narinfo lb # [ 426.384616] garage[898]: 2026-11-12T09:25:28.143229Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 426.394209] garage[898]: 2026-11-12T09:25:28.153385Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/7kpqdp1q74fzf67n892jpmz2kn4gzkn2.narinfo lb # [ 426.414452] garage[898]: 2026-11-12T09:25:28.154040Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 426.420196] garage[898]: 2026-11-12T09:25:28.178934Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/7kpqdp1q74fzf67n892jpmz2kn4gzkn2.narinfo lb # [ 426.425432] garage[898]: 2026-11-12T09:25:28.179360Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 423.577702] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 426.436698] garage[898]: 2026-11-12T09:25:28.196139Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/kmq5blan6804mpy8yrwkp67adxc4vwkl.narinfo lb # [ 426.441603] garage[898]: 2026-11-12T09:25:28.196578Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 426.448392] garage[898]: 2026-11-12T09:25:28.207834Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/kmq5blan6804mpy8yrwkp67adxc4vwkl.narinfo lb # [ 426.452905] garage[898]: 2026-11-12T09:25:28.208282Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 423.607695] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 426.466993] garage[898]: 2026-11-12T09:25:28.226389Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/v10rv28cb60v8s95fzdjhxzpzagzv810.narinfo lb # [ 426.471765] garage[898]: 2026-11-12T09:25:28.226840Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 426.478229] garage[898]: 2026-11-12T09:25:28.237680Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/v10rv28cb60v8s95fzdjhxzpzagzv810.narinfo lb # [ 426.482949] garage[898]: 2026-11-12T09:25:28.238114Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 423.637663] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 426.498166] garage[898]: 2026-11-12T09:25:28.256456Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/875fmazsar5vzkbmwshpic3src4kwgvd.narinfo lb # [ 426.504386] garage[898]: 2026-11-12T09:25:28.256886Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 426.507756] garage[898]: 2026-11-12T09:25:28.257538Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/56381zlwbz104s7lvcz6nzpf6mdsbnid.narinfo lb # [ 426.512375] garage[898]: 2026-11-12T09:25:28.257950Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 426.516341] garage[898]: 2026-11-12T09:25:28.263463Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/cgdw3rad394427n0kwzk0axsrs36yiyv.narinfo lb # [ 426.521105] garage[898]: 2026-11-12T09:25:28.263807Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 423.668877] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 worker2 # [ 423.680987] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 423.699857] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 423.843767] nix-daemon[976]: accepted connection from pid 2272, user nix-grpc-daemon (trusted) lb # [ 426.721727] niks3-server[1454]: 2026/11/12 09:25:28 INFO Received push request method=POST path=/api/pushes worker2 # [ 423.872399] nix-daemon[976]: reaped child process 2275, status = succeeded worker2 # [ 423.878076] nix-grpc-daemon[1723]: time=2026-11-12T09:25:29.150Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker2 # [ 423.881834] nix-grpc-daemon[1723]: time=2026-11-12T09:25:29.152Z level=INFO msg="Uploading 875fmazsar5vzkbmwshpic3src4kwgvd-farm-a.drv (512B)" worker2 # [ 423.883746] nix-grpc-daemon[1723]: time=2026-11-12T09:25:29.153Z level=INFO msg="Uploading 56381zlwbz104s7lvcz6nzpf6mdsbnid-farm-top.drv (760B)" worker2 # [ 423.885770] nix-grpc-daemon[1723]: time=2026-11-12T09:25:29.153Z level=INFO msg="Uploading cgdw3rad394427n0kwzk0axsrs36yiyv-farm-b.drv (632B)" worker2 # [ 423.901731] nix-grpc-daemon[1723]: time=2026-11-12T09:25:29.174Z level=INFO msg="Uploading 3 narinfos" lb # [ 426.735640] garage[898]: 2026-11-12T09:25:28.494680Z INFO garage_api_common::generic_server: 192.168.1.4:54250 PUT /farm/nar/1c9glfxs0hmn97vqbaw3gkz0w6vx6hk3awvqr3bgzwkl0jdwlrqy.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092528Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=80287009cf929b168a4df06005913194892533c9ab7c38815c198ad75fb63f37 lb # [ 426.769788] garage[898]: 2026-11-12T09:25:28.505345Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/cgdw3rad394427n0kwzk0axsrs36yiyv.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092528Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4fd80de3f293d30c92bade47ee462cfcc0836410c77ae2e8771eb725e0e9935b worker2 # [ 423.932529] nix-grpc-daemon[1723]: time=2026-11-12T09:25:29.205Z level=INFO msg="Upload complete. (219ms)" lb # [ 426.788751] garage[898]: 2026-11-12T09:25:28.505861Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/nar/14wkni15y8y4wjgdy22c2gpwqnqdw3wj4a3y0d3l9lsvpx57wrbm.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092528Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fe4d3b5f756225ce045dcb76d52677d11e48f13c048a20cfc45fa52c40356654 worker2 # [ 423.940481] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 paths=3 nar_bytes_in=1904 lb # [ 426.797554] garage[898]: 2026-11-12T09:25:28.506323Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/nar/0qxg3vjyvxkrpx02q7kyzfk563d8a5s0h1kqmm3lr5gb3hl7pff1.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092528Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ad9cfcc9112f49d1755617ae82853c1f2c4a63e6f0862dbab9d3006c4abfc880 worker2 # [ 423.951965] nix-daemon[976]: reaped child process 2268, status = succeeded lb # [ 426.806922] garage[898]: 2026-11-12T09:25:28.506630Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/875fmazsar5vzkbmwshpic3src4kwgvd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092528Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=42ddf1fd091b8014ea7a93ab6177a08e3638aaac07b4c9309e848de4f0b5399d lb # [ 426.815377] niks3-server[1454]: 2026/11/12 09:25:28 INFO Received sign narinfos request method=POST path=/api/pushes/45/sign lb # [ 426.820950] niks3-server[1454]: 2026/11/12 09:25:28 INFO Signed narinfos id=45 count=3 worker1 # [ 425.522195] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:29Z level=debug event=want client=2 drv=875fmazsar5vzkbmwshpic3src4kwgvd-farm-a.drv cached=0 lb # [ 426.823331] niks3-server[1454]: 2026/11/12 09:25:28 INFO Registered completed upload object_key=nar/0qxg3vjyvxkrpx02q7kyzfk563d8a5s0h1kqmm3lr5gb3hl7pff1.nar.zst lb # [ 426.826919] niks3-server[1454]: 2026/11/12 09:25:28 INFO Registered completed upload object_key=cgdw3rad394427n0kwzk0axsrs36yiyv.ls worker1 # [ 425.525963] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:29Z level=debug event=assigned drv=875fmazsar5vzkbmwshpic3src4kwgvd-farm-a.drv worker=192.168.1.4:50051 clients=1 lb # [ 426.830329] niks3-server[1454]: 2026/11/12 09:25:28 INFO Received complete push request method=POST path=/api/pushes/45/complete worker2 # [ 423.977493] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 426.832532] niks3-server[1454]: 2026/11/12 09:25:28 INFO Registered completed upload object_key=875fmazsar5vzkbmwshpic3src4kwgvd.ls lb # [ 426.834854] niks3-server[1454]: 2026/11/12 09:25:28 INFO Registered completed upload object_key=56381zlwbz104s7lvcz6nzpf6mdsbnid.ls lb # [ 426.836973] niks3-server[1454]: 2026/11/12 09:25:28 INFO Completed push id=45 objects=9 duration=18.76748ms lb # [ 426.839505] niks3-server[1454]: 2026/11/12 09:25:28 INFO Registered completed upload object_key=56381zlwbz104s7lvcz6nzpf6mdsbnid.narinfo lb # [ 426.841517] niks3-server[1454]: 2026/11/12 09:25:28 INFO Registered completed upload object_key=cgdw3rad394427n0kwzk0axsrs36yiyv.narinfo worker2 # [ 423.987943] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 426.843504] niks3-server[1454]: 2026/11/12 09:25:28 INFO Registered completed upload object_key=875fmazsar5vzkbmwshpic3src4kwgvd.narinfo lb # [ 426.845630] niks3-server[1454]: 2026/11/12 09:25:28 INFO Registered completed upload object_key=nar/14wkni15y8y4wjgdy22c2gpwqnqdw3wj4a3y0d3l9lsvpx57wrbm.nar.zst lb # [ 426.847840] niks3-server[1454]: 2026/11/12 09:25:28 INFO Registered completed upload object_key=nar/1c9glfxs0hmn97vqbaw3gkz0w6vx6hk3awvqr3bgzwkl0jdwlrqy.nar.zst worker2 # [ 424.000917] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 426.850413] garage[898]: 2026-11-12T09:25:28.506918Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/56381zlwbz104s7lvcz6nzpf6mdsbnid.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092528Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4b014460ad71295cf724c1528dbe7d1195b1596c41f327b6c4074acad4d427d6 lb # [ 426.857358] garage[898]: 2026-11-12T09:25:28.516133Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/cgdw3rad394427n0kwzk0axsrs36yiyv.ls lb # [ 426.860293] garage[898]: 2026-11-12T09:25:28.516683Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/56381zlwbz104s7lvcz6nzpf6mdsbnid.ls lb # [ 426.863033] garage[898]: 2026-11-12T09:25:28.516969Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/0qxg3vjyvxkrpx02q7kyzfk563d8a5s0h1kqmm3lr5gb3hl7pff1.nar.zst lb # [ 426.866236] garage[898]: 2026-11-12T09:25:28.517215Z INFO garage_api_common::generic_server: 127.0.0.1:48826 (key GK0123456789abcdef01234567) HEAD /farm/875fmazsar5vzkbmwshpic3src4kwgvd.ls lb # [ 426.868996] garage[898]: 2026-11-12T09:25:28.517479Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/cgdw3rad394427n0kwzk0axsrs36yiyv.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092528Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=562453a4be62f54399286acbd70ecd6eb4493eef77e5c2f4753ce6db394016e6 lb # [ 426.874977] garage[898]: 2026-11-12T09:25:28.521245Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/56381zlwbz104s7lvcz6nzpf6mdsbnid.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092528Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54dc9309bc4f524ff52fb2aa6da04387bdb7d3a13eb490b1ac707fca5e676e92 lb # [ 426.880735] garage[898]: 2026-11-12T09:25:28.523265Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/875fmazsar5vzkbmwshpic3src4kwgvd.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092528Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=122863eeedb4cc7d1878eb5405927ab2463b5f866b0e6796b0a4be149cccb190 lb # [ 426.886249] garage[898]: 2026-11-12T09:25:28.523647Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/nar/1c9glfxs0hmn97vqbaw3gkz0w6vx6hk3awvqr3bgzwkl0jdwlrqy.nar.zst lb # [ 426.889194] garage[898]: 2026-11-12T09:25:28.543179Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/875fmazsar5vzkbmwshpic3src4kwgvd.narinfo lb # [ 426.891859] garage[898]: 2026-11-12T09:25:28.543689Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/14wkni15y8y4wjgdy22c2gpwqnqdw3wj4a3y0d3l9lsvpx57wrbm.nar.zst lb # [ 426.894916] garage[898]: 2026-11-12T09:25:28.543931Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/cgdw3rad394427n0kwzk0axsrs36yiyv.narinfo lb # [ 426.897648] garage[898]: 2026-11-12T09:25:28.544344Z INFO garage_api_common::generic_server: 127.0.0.1:52606 (key GK0123456789abcdef01234567) HEAD /farm/56381zlwbz104s7lvcz6nzpf6mdsbnid.narinfo lb # [ 427.995274] garage[898]: 2026-11-12T09:25:29.754064Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/v10rv28cb60v8s95fzdjhxzpzagzv810.narinfo lb # [ 427.995452] garage[898]: 2026-11-12T09:25:29.754538Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 425.449471] nix-daemon[976]: reaped child process 2280, status = succeeded worker2 # [ 425.583118] nix-daemon[976]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) worker2 # [ 425.608390] nix-daemon[976]: reaped child process 2299, status = succeeded lb # [ 428.467759] niks3-server[1454]: 2026/11/12 09:25:30 INFO Received push request method=POST path=/api/pushes worker2 # [ 425.624657] nix-grpc-daemon[1723]: time=2026-11-12T09:25:30.894Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 425.626324] nix-grpc-daemon[1723]: time=2026-11-12T09:25:30.894Z level=INFO msg="Uploading v10rv28cb60v8s95fzdjhxzpzagzv810-farm-a (128B)" lb # [ 428.478122] garage[898]: 2026-11-12T09:25:30.237535Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/log/875fmazsar5vzkbmwshpic3src4kwgvd-farm-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092530Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0baf6158c05b4f9bb1708035caa6c0d74a49e86dd94041b92b50927efd1e6096 worker2 # [ 425.640154] nix-grpc-daemon[1723]: time=2026-11-12T09:25:30.912Z level=INFO msg="Uploading 1 narinfos" lb # [ 428.504261] garage[898]: 2026-11-12T09:25:30.248710Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/v10rv28cb60v8s95fzdjhxzpzagzv810.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092530Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e167dff64ca5b2fc9ed0ffe5cf09f111009cb5f1c0264ed279aa2a9e8cb55b8b lb # [ 428.516124] garage[898]: 2026-11-12T09:25:30.249187Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/nar/0h88dxwywwa90fk8xc2zavbc2gy3gfq11rks8qd3zx1i1n55k3mn.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092530Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e40bf02f9cd3172a1a8c6f659b18fa5f5acfe10608580ded0c36463b6821fb34 lb # [ 428.528167] garage[898]: 2026-11-12T09:25:30.254353Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/nar/0h88dxwywwa90fk8xc2zavbc2gy3gfq11rks8qd3zx1i1n55k3mn.nar.zst worker2 # [ 425.680418] nix-grpc-daemon[1723]: time=2026-11-12T09:25:30.953Z level=INFO msg="Upload complete. (263ms)" lb # [ 428.533727] garage[898]: 2026-11-12T09:25:30.254838Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/v10rv28cb60v8s95fzdjhxzpzagzv810.ls lb # [ 428.538891] garage[898]: 2026-11-12T09:25:30.255117Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/log/875fmazsar5vzkbmwshpic3src4kwgvd-farm-a.drv worker2 # [ 425.688974] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=1 drv=875fmazsar5vzkbmwshpic3src4kwgvd-farm-a.drv assign_id=4 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 428.544167] garage[898]: 2026-11-12T09:25:30.255369Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/v10rv28cb60v8s95fzdjhxzpzagzv810.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092530Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3b08acb089f61dc75c54aacde175798b153ea351a231a0c5b920d4304f16598c lb # [ 428.553742] niks3-server[1454]: 2026/11/12 09:25:30 INFO Received sign narinfos request method=POST path=/api/pushes/46/sign lb # [ 428.556458] niks3-server[1454]: 2026/11/12 09:25:30 INFO Signed narinfos id=46 count=1 worker2 # [ 425.703315] nix-daemon[976]: reaped child process 2278, status = succeeded lb # [ 428.559670] niks3-server[1454]: 2026/11/12 09:25:30 INFO Received complete push request method=POST path=/api/pushes/46/complete worker1 # [ 427.261813] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:31Z level=debug event=want client=2 drv=cgdw3rad394427n0kwzk0axsrs36yiyv-farm-b.drv cached=0 lb # [ 428.563027] niks3-server[1454]: 2026/11/12 09:25:30 INFO Registered completed upload object_key=log/875fmazsar5vzkbmwshpic3src4kwgvd-farm-a.drv worker1 # [ 427.265462] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:31Z level=debug event=assigned drv=cgdw3rad394427n0kwzk0axsrs36yiyv-farm-b.drv worker=192.168.1.4:50051 clients=1 lb # [ 428.566354] niks3-server[1454]: 2026/11/12 09:25:30 INFO Registered completed upload object_key=v10rv28cb60v8s95fzdjhxzpzagzv810.ls lb # [ 428.569595] niks3-server[1454]: 2026/11/12 09:25:30 INFO Registered completed upload object_key=v10rv28cb60v8s95fzdjhxzpzagzv810.narinfo worker2 # [ 425.716832] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 428.572268] niks3-server[1454]: 2026/11/12 09:25:30 INFO Registered completed upload object_key=nar/0h88dxwywwa90fk8xc2zavbc2gy3gfq11rks8qd3zx1i1n55k3mn.nar.zst lb # [ 428.575194] niks3-server[1454]: 2026/11/12 09:25:30 INFO Completed push id=46 objects=4 duration=31.04094ms lb # [ 428.577178] garage[898]: 2026-11-12T09:25:30.273069Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/v10rv28cb60v8s95fzdjhxzpzagzv810.narinfo worker2 # [ 425.726582] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 425.740983] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) [e2e] heartbeat t=330s lb # [ 429.881909] garage[898]: 2026-11-12T09:25:31.640152Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/kmq5blan6804mpy8yrwkp67adxc4vwkl.narinfo lb # [ 429.882142] garage[898]: 2026-11-12T09:25:31.640653Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 430.156160] postgres[809]: [809] LOG: checkpoint complete: wrote 1057 buffers (6.5%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=106.392 s, sync=0.035 s, total=106.492 s; sync files=364, longest=0.005 s, average=0.001 s; distance=5275 kB, estimate=5275 kB; lsn=0/1CB9C98, redo lsn=0/1C8CF58 worker2 # [ 427.388773] nix-daemon[976]: reaped child process 2304, status = succeeded worker2 # [ 427.505981] nix-daemon[976]: accepted connection from pid 2320, user nix-grpc-daemon (trusted) worker2 # [ 427.531273] nix-daemon[976]: reaped child process 2323, status = succeeded lb # [ 430.389705] niks3-server[1454]: 2026/11/12 09:25:32 INFO Received push request method=POST path=/api/pushes worker2 # [ 427.544444] nix-grpc-daemon[1723]: time=2026-11-12T09:25:32.815Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 427.546175] nix-grpc-daemon[1723]: time=2026-11-12T09:25:32.815Z level=INFO msg="Uploading kmq5blan6804mpy8yrwkp67adxc4vwkl-farm-b (184B)" lb # [ 430.397926] garage[898]: 2026-11-12T09:25:32.157339Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/log/cgdw3rad394427n0kwzk0axsrs36yiyv-farm-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092532Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c6cfe5efd4cd978ff971889db7646b0b580dfe156ae9b4816f4dff53760a1ed8 worker2 # [ 427.561441] nix-grpc-daemon[1723]: time=2026-11-12T09:25:32.834Z level=INFO msg="Uploading 1 narinfos" lb # [ 430.416705] garage[898]: 2026-11-12T09:25:32.167907Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/kmq5blan6804mpy8yrwkp67adxc4vwkl.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092532Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3515687e9f6b62e97a655c55b65b3808f86df36dec5f69f01f05228d4e868ef4 worker2 # [ 427.584653] nix-grpc-daemon[1723]: time=2026-11-12T09:25:32.857Z level=INFO msg="Upload complete. (228ms)" lb # [ 430.436341] garage[898]: 2026-11-12T09:25:32.168823Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/nar/182mwr76z7q6dy0km7lhzlz3nklpbmf9prz19i7ljhpjkd8nankx.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092532Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=372160d42f8ec5b17c4ca8b03824bc27b5d83002988762ad3b2db0f5e6b4347a worker2 # [ 427.592862] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=1 drv=cgdw3rad394427n0kwzk0axsrs36yiyv-farm-b.drv assign_id=5 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 430.449582] garage[898]: 2026-11-12T09:25:32.171375Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/log/cgdw3rad394427n0kwzk0axsrs36yiyv-farm-b.drv lb # [ 430.454933] garage[898]: 2026-11-12T09:25:32.174869Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/nar/182mwr76z7q6dy0km7lhzlz3nklpbmf9prz19i7ljhpjkd8nankx.nar.zst worker2 # [ 427.607415] nix-daemon[976]: reaped child process 2302, status = succeeded lb # [ 430.460158] garage[898]: 2026-11-12T09:25:32.175320Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/kmq5blan6804mpy8yrwkp67adxc4vwkl.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092532Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e62282d8d64c50ca84109db5e9c2ebcbfb925d3a056f244c0388c38c95bcabd8 lb # [ 430.469469] niks3-server[1454]: 2026/11/12 09:25:32 INFO Received sign narinfos request method=POST path=/api/pushes/47/sign lb # [ 430.473058] niks3-server[1454]: 2026/11/12 09:25:32 INFO Registered completed upload object_key=log/cgdw3rad394427n0kwzk0axsrs36yiyv-farm-b.drv worker1 # [ 429.179997] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:32Z level=debug event=want client=2 drv=56381zlwbz104s7lvcz6nzpf6mdsbnid-farm-top.drv cached=0 worker2 # [ 427.634303] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 430.476254] niks3-server[1454]: 2026/11/12 09:25:32 INFO Signed narinfos id=47 count=1 worker1 # [ 429.180370] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:32Z level=debug event=assigned drv=56381zlwbz104s7lvcz6nzpf6mdsbnid-farm-top.drv worker=192.168.1.4:50051 clients=1 lb # [ 430.477885] niks3-server[1454]: 2026/11/12 09:25:32 INFO Received complete push request method=POST path=/api/pushes/47/complete lb # [ 430.480898] niks3-server[1454]: 2026/11/12 09:25:32 INFO Registered completed upload object_key=nar/182mwr76z7q6dy0km7lhzlz3nklpbmf9prz19i7ljhpjkd8nankx.nar.zst lb # [ 430.484277] niks3-server[1454]: 2026/11/12 09:25:32 INFO Completed push id=47 objects=8 duration=9.59246ms lb # [ 430.487035] niks3-server[1454]: 2026/11/12 09:25:32 INFO Registered completed upload object_key=kmq5blan6804mpy8yrwkp67adxc4vwkl.narinfo lb # [ 430.490030] niks3-server[1454]: 2026/11/12 09:25:32 INFO Registered completed upload object_key=kmq5blan6804mpy8yrwkp67adxc4vwkl.ls lb # [ 430.492339] garage[898]: 2026-11-12T09:25:32.187066Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/kmq5blan6804mpy8yrwkp67adxc4vwkl.ls worker2 # [ 427.642329] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 430.496039] garage[898]: 2026-11-12T09:25:32.192547Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/kmq5blan6804mpy8yrwkp67adxc4vwkl.narinfo worker2 # [ 427.655655] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 430.920743] garage[898]: 2026-11-12T09:25:32.679447Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/7kpqdp1q74fzf67n892jpmz2kn4gzkn2.narinfo lb # [ 430.925583] garage[898]: 2026-11-12T09:25:32.679886Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 428.508584] nix-daemon[976]: reaped child process 2328, status = succeeded worker2 # [ 428.624191] nix-daemon[976]: accepted connection from pid 2344, user nix-grpc-daemon (trusted) lb # [ 431.501582] niks3-server[1454]: 2026/11/12 09:25:33 INFO Received push request method=POST path=/api/pushes worker2 # [ 428.652599] nix-daemon[976]: reaped child process 2347, status = succeeded worker2 # [ 428.656656] nix-grpc-daemon[1723]: time=2026-11-12T09:25:33.928Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 428.658197] nix-grpc-daemon[1723]: time=2026-11-12T09:25:33.928Z level=INFO msg="Uploading 7kpqdp1q74fzf67n892jpmz2kn4gzkn2-farm-top (232B)" lb # [ 431.515826] garage[898]: 2026-11-12T09:25:33.275225Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/7kpqdp1q74fzf67n892jpmz2kn4gzkn2.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092533Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6ab401dd4c84ab249d556ceea885aca9ce72fb544200fa24eea1730050f8e6a7 worker2 # [ 428.679343] nix-grpc-daemon[1723]: time=2026-11-12T09:25:33.952Z level=INFO msg="Uploading 1 narinfos" lb # [ 431.544294] garage[898]: 2026-11-12T09:25:33.284865Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/log/56381zlwbz104s7lvcz6nzpf6mdsbnid-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092533Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ca221dce73621dc43be904249d46a6fcdf7e1d50c94bf5845f83d1156cbe39a9 worker2 # [ 428.701719] nix-grpc-daemon[1723]: time=2026-11-12T09:25:33.974Z level=INFO msg="Upload complete. (235ms)" lb # [ 431.555564] garage[898]: 2026-11-12T09:25:33.285361Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/nar/0dh9z9ia5b79r2yjz807c1rgqv1fsmgns5jm8i0hs7wk1p94p8sk.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092533Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6ff9dd418576167fbf2e2cfdfd7b5366abee23db3ba7dca4972a1406dbb01742 worker2 # [ 428.708810] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=1 drv=56381zlwbz104s7lvcz6nzpf6mdsbnid-farm-top.drv assign_id=6 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 431.566570] garage[898]: 2026-11-12T09:25:33.292660Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/0dh9z9ia5b79r2yjz807c1rgqv1fsmgns5jm8i0hs7wk1p94p8sk.nar.zst lb # [ 431.572353] garage[898]: 2026-11-12T09:25:33.293233Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/log/56381zlwbz104s7lvcz6nzpf6mdsbnid-farm-top.drv worker2 # [ 428.723136] nix-daemon[976]: reaped child process 2326, status = succeeded lb # [ 431.577503] garage[898]: 2026-11-12T09:25:33.293521Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/7kpqdp1q74fzf67n892jpmz2kn4gzkn2.ls lb # [ 431.582612] garage[898]: 2026-11-12T09:25:33.293822Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/7kpqdp1q74fzf67n892jpmz2kn4gzkn2.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092533Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=076b8800e2629512a36d0fb432655d1ecad03d0b61943da1f17a3e58577da1a7 lb # [ 431.591651] niks3-server[1454]: 2026/11/12 09:25:33 INFO Received sign narinfos request method=POST path=/api/pushes/48/sign lb # [ 431.594188] niks3-server[1454]: 2026/11/12 09:25:33 INFO Signed narinfos id=48 count=1 lb # [ 431.595780] niks3-server[1454]: 2026/11/12 09:25:33 INFO Received complete push request method=POST path=/api/pushes/48/complete lb # [ 431.598240] niks3-server[1454]: 2026/11/12 09:25:33 INFO Registered completed upload object_key=7kpqdp1q74fzf67n892jpmz2kn4gzkn2.ls lb # [ 431.600414] niks3-server[1454]: 2026/11/12 09:25:33 INFO Registered completed upload object_key=log/56381zlwbz104s7lvcz6nzpf6mdsbnid-farm-top.drv lb # [ 431.602823] niks3-server[1454]: 2026/11/12 09:25:33 INFO Registered completed upload object_key=nar/0dh9z9ia5b79r2yjz807c1rgqv1fsmgns5jm8i0hs7wk1p94p8sk.nar.zst client # [ 430.300523] sshd-session[2097]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 431.605485] niks3-server[1454]: 2026/11/12 09:25:33 INFO Completed push id=48 objects=12 duration=18.12932ms client # [ 430.301130] sshd-session[2097]: Disconnected from user root UNKNOWN port 65535 lb # [ 431.607473] niks3-server[1454]: 2026/11/12 09:25:33 INFO Registered completed upload object_key=7kpqdp1q74fzf67n892jpmz2kn4gzkn2.narinfo client # [ 430.306751] sshd-session[2075]: pam_unix(sshd:session): session closed for user root lb # [ 431.610091] garage[898]: 2026-11-12T09:25:33.302504Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/7kpqdp1q74fzf67n892jpmz2kn4gzkn2.narinfo client # [ 430.313145] systemd[1]: sshd-vsock@63-64-3:22-2:63.service: Deactivated successfully. client # [ 430.321869] systemd[1]: session-75.scope: Deactivated successfully. client # [ 430.326155] systemd[1]: session-75.scope: Consumed 212ms CPU time over 5.455s wall clock time, 44.2M memory peak, 12.5K incoming IP traffic, 13.8K outgoing IP traffic. client # [ 430.335233] systemd-logind[427]: Session 75 logged out. Waiting for processes to exit. client # [ 430.337170] systemd-logind[427]: Removed session 75. client # [ 431.853335] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 431.861248] systemd[1]: Started SSH per-connection Daemon (vsock:2:64). client # [ 431.959394] sshd-session[2116]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 431.969376] sshd-session[2116]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 431.977805] sshd-session[2116]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 431.988443] systemd-logind[427]: New session '77' of user 'root' with class 'user' and type 'tty'. client # [ 431.996938] systemd[1]: Started Session 77 of User root. client # [ 432.141844] sshd-session[2122]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 432.144311] sshd-session[2122]: Disconnected from user root UNKNOWN port 65535 client # [ 432.146491] sshd-session[2116]: pam_unix(sshd:session): session closed for user root client # [ 432.150326] systemd[1]: sshd-vsock@64-65-3:22-2:64.service: Deactivated successfully. client # [ 432.155824] systemd[1]: session-77.scope: Deactivated successfully. client # [ 432.160814] systemd-logind[427]: Session 77 logged out. Waiting for processes to exit. client # [ 432.163109] systemd-logind[427]: Removed session 77. worker2 # [ 430.833326] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 430.841494] systemd[2203]: Activating special unit Exit the Session... worker2 # [ 430.848812] systemd[2203]: Stopped target Main User Target. worker2 # [ 430.850387] systemd[2203]: Stopped target Basic System. worker2 # [ 430.851669] systemd[2203]: Stopped target Paths. worker2 # [ 430.855816] systemd[2203]: Stopped target Sockets. worker2 # [ 430.858108] systemd[2203]: Stopped target Timers. worker2 # [ 430.859337] systemd[2203]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 430.861320] systemd[2203]: Closed D-Bus User Message Bus Socket. worker2 # [ 430.862775] systemd[2203]: Stopped Create User Files and Directories. worker2 # [ 430.864776] systemd[2203]: Removed slice User Application Slice. worker2 # [ 430.866259] systemd[2203]: Reached target Shutdown. worker2 # [ 430.867457] systemd[2203]: Finished Exit the Session. worker2 # [ 430.868858] systemd[2203]: Reached target Exit the Session. worker2 # [ 430.877811] systemd-logind[515]: Removed session 57. worker2 # [ 430.885313] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 430.890640] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 430.906866] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 430.949471] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 430.954682] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 430.960154] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 434.306406] systemd[1]: Stopping User Manager for UID 0... lb # [ 434.314302] systemd[1793]: Activating special unit Exit the Session... lb # [ 434.321583] systemd[1793]: Stopped target Main User Target. lb # [ 434.323087] systemd[1793]: Stopped target Basic System. lb # [ 434.325560] systemd[1793]: Stopped target Paths. lb # [ 434.326687] systemd[1793]: Stopped target Sockets. lb # [ 434.327827] systemd[1793]: Stopped target Timers. lb # [ 434.330024] systemd[1793]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 434.332185] systemd[1793]: Closed D-Bus User Message Bus Socket. lb # [ 434.333588] systemd[1793]: Stopped Create User Files and Directories. lb # [ 434.335052] systemd[1793]: Removed slice User Application Slice. lb # [ 434.337103] systemd[1793]: Reached target Shutdown. lb # [ 434.338293] systemd[1793]: Finished Exit the Session. lb # [ 434.339457] systemd[1793]: Reached target Exit the Session. lb # [ 434.365902] systemd-logind[499]: Removed session 49. lb # [ 434.373434] systemd[1]: user@0.service: Deactivated successfully. lb # [ 434.378977] systemd[1]: Stopped User Manager for UID 0. lb # [ 434.439408] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 434.478202] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 434.483652] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 434.487714] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 433.540179] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 433.547072] systemd[2571]: Activating special unit Exit the Session... worker1 # [ 433.553596] systemd[2571]: Stopped target Main User Target. worker1 # [ 433.555141] systemd[2571]: Stopped target Basic System. worker1 # [ 433.560343] systemd[2571]: Stopped target Paths. worker1 # [ 433.561512] systemd[2571]: Stopped target Sockets. worker1 # [ 433.562746] systemd[2571]: Stopped target Timers. worker1 # [ 433.563848] systemd[2571]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 433.565728] systemd[2571]: Closed D-Bus User Message Bus Socket. worker1 # [ 433.567126] systemd[2571]: Stopped Create User Files and Directories. worker1 # [ 433.568763] systemd[2571]: Removed slice User Application Slice. worker1 # [ 433.570197] systemd[2571]: Reached target Shutdown. worker1 # [ 433.571332] systemd[2571]: Finished Exit the Session. worker1 # [ 433.572748] systemd[2571]: Reached target Exit the Session. worker1 # [ 433.581953] systemd-logind[539]: Removed session 75. worker1 # [ 433.589618] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 433.593037] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 433.614211] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 433.657437] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 433.661093] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 433.667533] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 436.326132] envoy[897]: conn peer=[2001:db8:1::1]:60028 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=6353 tx=4011 ms=5239 lb # [ 437.210597] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 437.218377] systemd[1]: Started SSH per-connection Daemon (vsock:2:37). lb # [ 437.327622] sshd-session[1823]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 437.336322] sshd-session[1823]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 437.347925] sshd-session[1823]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 437.380539] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 437.413041] systemd-logind[499]: New session '50' of user 'root' with class 'user' and type 'tty'. lb # [ 437.432073] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 437.438901] systemd[1]: Starting User Manager for UID 0... lb # [ 437.466758] (systemd)[1832]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 437.473190] systemd-logind[499]: New session '51' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 437.562372] systemd[1832]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 437.661151] systemd[1832]: Queued start job for default target Main User Target. lb # [ 437.665016] systemd[1832]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 437.668084] systemd[1832]: Created slice User Application Slice. lb # [ 437.669176] systemd[1832]: Started Daily Cleanup of User's Temporary Directories. lb # [ 437.670423] systemd[1832]: Reached target Paths. lb # [ 437.671266] systemd[1832]: Reached target Timers. lb # [ 437.674151] systemd[1832]: Starting D-Bus User Message Bus Socket... lb # [ 437.677079] systemd[1832]: Starting Create User Files and Directories... lb # [ 437.728730] systemd[1832]: Finished Create User Files and Directories. lb # [ 437.731646] systemd[1832]: Listening on D-Bus User Message Bus Socket. lb # [ 437.734209] systemd[1832]: Reached target Sockets. lb # [ 437.734971] systemd[1832]: Reached target Basic System. lb # [ 437.735753] systemd[1832]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 437.739567] systemd[1832]: Reached target Main User Target. lb # [ 437.743511] systemd[1832]: Startup finished in 243ms. lb # [ 437.744888] systemd[1]: Started User Manager for UID 0. lb # [ 437.745669] systemd[1]: Started Session 50 of User root. lb # [ 437.775869] sshd-session[1845]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 437.778599] sshd-session[1845]: Disconnected from user root UNKNOWN port 65535 lb # [ 437.780456] sshd-session[1823]: pam_unix(sshd:session): session closed for user root lb # [ 437.784193] systemd[1]: sshd-vsock@37-38-4:22-2:37.service: Deactivated successfully. lb # [ 437.789462] systemd[1]: session-50.scope: Deactivated successfully. lb # [ 437.792591] systemd[1]: session-50.scope: Consumed 26ms CPU time over 49ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 437.797432] systemd-logind[499]: Session 50 logged out. Waiting for processes to exit. lb # [ 437.798707] systemd-logind[499]: Removed session 50. worker1 # [ 436.585760] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 436.594737] systemd[1]: Started SSH per-connection Daemon (vsock:2:69). worker1 # [ 436.696721] sshd-session[2655]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 436.704927] sshd-session[2655]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 436.715514] sshd-session[2655]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 436.736109] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 436.745915] systemd-logind[539]: New session '81' of user 'root' with class 'user' and type 'tty'. worker1 # [ 436.773518] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 436.778712] systemd[1]: Starting User Manager for UID 0... worker1 # [ 436.806144] (systemd)[2663]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 436.811925] systemd-logind[539]: New session '82' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 436.904055] systemd[2663]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 437.007461] systemd[2663]: Queued start job for default target Main User Target. worker1 # [ 437.017174] systemd[2663]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 437.021685] systemd[2663]: Created slice User Application Slice. worker1 # [ 437.022780] systemd[2663]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 437.023833] systemd[2663]: Reached target Paths. worker1 # [ 437.027097] systemd[2663]: Reached target Timers. worker1 # [ 437.027869] systemd[2663]: Starting D-Bus User Message Bus Socket... worker1 # [ 437.032204] systemd[2663]: Starting Create User Files and Directories... worker1 # [ 437.078433] systemd[2663]: Finished Create User Files and Directories. worker1 # [ 437.081664] systemd[2663]: Listening on D-Bus User Message Bus Socket. worker1 # [ 437.085614] systemd[2663]: Reached target Sockets. worker1 # [ 437.086490] systemd[2663]: Reached target Basic System. worker1 # [ 437.087359] systemd[2663]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 437.089073] systemd[2663]: Reached target Main User Target. worker1 # [ 437.089891] systemd[2663]: Startup finished in 252ms. worker1 # [ 437.090679] systemd[1]: Started User Manager for UID 0. worker1 # [ 437.093526] systemd[1]: Started Session 81 of User root. worker1 # [ 437.120475] sshd-session[2676]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 437.123078] sshd-session[2676]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 437.124476] sshd-session[2655]: pam_unix(sshd:session): session closed for user root worker1 # [ 437.129147] systemd[1]: sshd-vsock@69-70-5:22-2:69.service: Deactivated successfully. worker1 # [ 437.133977] systemd[1]: session-81.scope: Deactivated successfully. worker1 # [ 437.138814] systemd-logind[539]: Session 81 logged out. Waiting for processes to exit. worker1 # [ 437.141590] systemd-logind[539]: Removed session 81. client # [ 438.682537] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 438.690450] systemd[1]: Started SSH per-connection Daemon (vsock:2:65). client # [ 438.818161] sshd-session[2129]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 438.829104] sshd-session[2129]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 438.839321] sshd-session[2129]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 438.850023] systemd-logind[427]: New session '78' of user 'root' with class 'user' and type 'tty'. client # [ 438.856610] systemd[1]: Started Session 78 of User root. worker1 # [ 439.039731] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44014 worker2 # [ 437.490285] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 440.352858] garage[898]: 2026-11-12T09:25:42.111586Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/m9flngcmxr7zyiyv9aivp96q49z56342.narinfo lb # [ 440.353050] garage[898]: 2026-11-12T09:25:42.112042Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 437.529926] nix-grpc-daemon[1723]: time=2026-11-12T09:25:42.802Z level=INFO msg="All 2 paths already cached" worker2 # [ 437.537773] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 440.392682] garage[898]: 2026-11-12T09:25:42.152001Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/m9flngcmxr7zyiyv9aivp96q49z56342.narinfo lb # [ 440.397566] garage[898]: 2026-11-12T09:25:42.152511Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 440.402845] garage[898]: 2026-11-12T09:25:42.161807Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/m9flngcmxr7zyiyv9aivp96q49z56342.narinfo lb # [ 440.407652] garage[898]: 2026-11-12T09:25:42.162218Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 437.561346] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 worker2 # [ 437.571476] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 440.436646] garage[898]: 2026-11-12T09:25:42.196029Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/avn1cxqm48jzvpa09r5kwch9qmdvdbi3.narinfo lb # [ 440.441666] garage[898]: 2026-11-12T09:25:42.196511Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 437.601140] nix-grpc-daemon[1723]: time=2026-11-12T09:25:42.873Z level=INFO msg="All 2 paths already cached" worker2 # [ 437.609172] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 worker2 # [ 437.620803] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 437.766828] nix-daemon[976]: accepted connection from pid 2357, user nix-grpc-daemon (trusted) lb # [ 440.642697] niks3-server[1454]: 2026/11/12 09:25:42 INFO Received push request method=POST path=/api/pushes worker2 # [ 437.792259] nix-daemon[976]: reaped child process 2360, status = succeeded worker2 # [ 437.796135] nix-grpc-daemon[1723]: time=2026-11-12T09:25:43.068Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 437.797893] nix-grpc-daemon[1723]: time=2026-11-12T09:25:43.068Z level=INFO msg="Uploading avn1cxqm48jzvpa09r5kwch9qmdvdbi3-farm-top.drv (760B)" worker2 # [ 437.817318] nix-grpc-daemon[1723]: time=2026-11-12T09:25:43.090Z level=INFO msg="Uploading 1 narinfos" lb # [ 440.654485] garage[898]: 2026-11-12T09:25:42.413845Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/nar/0s4bgl8hgi8vzysaz9z0wnrhs3s14f47mrwhw2kc458176bm91vw.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092542Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f08a1026a52960a1a40f9096c6144f845444391a9adbf87747a311525175af52 lb # [ 440.678913] garage[898]: 2026-11-12T09:25:42.424869Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/avn1cxqm48jzvpa09r5kwch9qmdvdbi3.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092542Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2a9ffbdcdf22cc17263a6fc9152ff4f583632a5b902e3ee53165f96496d03e4e worker2 # [ 437.836590] nix-grpc-daemon[1723]: time=2026-11-12T09:25:43.109Z level=INFO msg="Upload complete. (201ms)" lb # [ 440.690186] garage[898]: 2026-11-12T09:25:42.427706Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/avn1cxqm48jzvpa09r5kwch9qmdvdbi3.ls lb # [ 440.695483] garage[898]: 2026-11-12T09:25:42.430762Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/0s4bgl8hgi8vzysaz9z0wnrhs3s14f47mrwhw2kc458176bm91vw.nar.zst worker2 # [ 437.844150] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 437.854264] nix-daemon[976]: reaped child process 2355, status = succeeded lb # [ 440.701469] garage[898]: 2026-11-12T09:25:42.431262Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/avn1cxqm48jzvpa09r5kwch9qmdvdbi3.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092542Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bac522ef93b56b31c474f93e50f32e49e6c7b5251eacc6421d5d438355cecd76 lb # [ 440.711192] garage[898]: 2026-11-12T09:25:42.436108Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/avn1cxqm48jzvpa09r5kwch9qmdvdbi3.narinfo lb # [ 440.718253] niks3-server[1454]: 2026/11/12 09:25:42 INFO Received sign narinfos request method=POST path=/api/pushes/49/sign worker1 # [ 439.419376] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:43Z level=debug event=want client=3 drv=avn1cxqm48jzvpa09r5kwch9qmdvdbi3-farm-top.drv cached=0 lb # [ 440.721510] niks3-server[1454]: 2026/11/12 09:25:42 INFO Signed narinfos id=49 count=1 worker1 # [ 439.423332] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:43Z level=debug event=assigned drv=avn1cxqm48jzvpa09r5kwch9qmdvdbi3-farm-top.drv worker=192.168.1.4:50051 clients=1 lb # [ 440.724244] niks3-server[1454]: 2026/11/12 09:25:42 INFO Registered completed upload object_key=avn1cxqm48jzvpa09r5kwch9qmdvdbi3.ls lb # [ 440.726877] niks3-server[1454]: 2026/11/12 09:25:42 INFO Received complete push request method=POST path=/api/pushes/49/complete lb # [ 440.729715] niks3-server[1454]: 2026/11/12 09:25:42 INFO Registered completed upload object_key=nar/0s4bgl8hgi8vzysaz9z0wnrhs3s14f47mrwhw2kc458176bm91vw.nar.zst lb # [ 440.733557] niks3-server[1454]: 2026/11/12 09:25:42 INFO Registered completed upload object_key=avn1cxqm48jzvpa09r5kwch9qmdvdbi3.narinfo worker2 # [ 437.880715] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 440.736171] niks3-server[1454]: 2026/11/12 09:25:42 INFO Completed push id=49 objects=9 duration=15.2549ms worker2 # [ 437.890500] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 437.906480] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 441.127324] garage[898]: 2026-11-12T09:25:42.886480Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/m9flngcmxr7zyiyv9aivp96q49z56342.narinfo lb # [ 441.132376] garage[898]: 2026-11-12T09:25:42.886920Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 438.535879] nix-daemon[976]: reaped child process 2365, status = succeeded worker2 # [ 438.670743] nix-daemon[976]: accepted connection from pid 2381, user nix-grpc-daemon (trusted) lb # [ 441.544736] niks3-server[1454]: 2026/11/12 09:25:43 INFO Received push request method=POST path=/api/pushes worker2 # [ 438.695949] nix-daemon[976]: reaped child process 2384, status = succeeded worker2 # [ 438.700571] nix-grpc-daemon[1723]: time=2026-11-12T09:25:43.972Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 438.702229] nix-grpc-daemon[1723]: time=2026-11-12T09:25:43.972Z level=INFO msg="Uploading m9flngcmxr7zyiyv9aivp96q49z56342-farm-top (232B)" worker2 # [ 438.721926] nix-grpc-daemon[1723]: time=2026-11-12T09:25:43.994Z level=INFO msg="Uploading 1 narinfos" lb # [ 441.560908] garage[898]: 2026-11-12T09:25:43.319620Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/m9flngcmxr7zyiyv9aivp96q49z56342.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092543Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=145ad5bae1c4e54c2aa019eeea4aef806bf147e8b35a8caeb12b5f653804efa4 worker2 # [ 438.734539] nix-grpc-daemon[1723]: time=2026-11-12T09:25:44.007Z level=INFO msg="Upload complete. (217ms)" lb # [ 441.589180] garage[898]: 2026-11-12T09:25:43.330060Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/log/avn1cxqm48jzvpa09r5kwch9qmdvdbi3-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092543Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2ffbdb71297b856d6e98f496f4f24c6802b64f47d6254b3a6f8eb780f28f29c8 worker2 # [ 438.744861] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 drv=avn1cxqm48jzvpa09r5kwch9qmdvdbi3-farm-top.drv assign_id=7 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 438.754559] nix-daemon[976]: reaped child process 2363, status = succeeded lb # [ 441.600425] garage[898]: 2026-11-12T09:25:43.330559Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/nar/1l2lw4108yv7qr49id86lfjsnib77m9g1zddrqsjvxzxjqcz8w4m.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092543Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d2485a28ee150930bdc68d6e96e515492be3252a743d362b71248b4622346218 lb # [ 441.610457] garage[898]: 2026-11-12T09:25:43.335394Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/nar/1l2lw4108yv7qr49id86lfjsnib77m9g1zddrqsjvxzxjqcz8w4m.nar.zst lb # [ 441.616067] garage[898]: 2026-11-12T09:25:43.335940Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/log/avn1cxqm48jzvpa09r5kwch9qmdvdbi3-farm-top.drv lb # [ 441.621221] garage[898]: 2026-11-12T09:25:43.336606Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/m9flngcmxr7zyiyv9aivp96q49z56342.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092543Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0b0fcc9a0e71852c7c55a35f8e38a42a461d986d739c22916fc5df39616e0dfb lb # [ 441.637459] garage[898]: 2026-11-12T09:25:43.343419Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/m9flngcmxr7zyiyv9aivp96q49z56342.ls lb # [ 441.641288] niks3-server[1454]: 2026/11/12 09:25:43 INFO Received sign narinfos request method=POST path=/api/pushes/50/sign lb # [ 441.643956] niks3-server[1454]: 2026/11/12 09:25:43 INFO Signed narinfos id=50 count=1 client # [ 440.340957] sshd-session[2135]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 441.645593] niks3-server[1454]: 2026/11/12 09:25:43 INFO Received complete push request method=POST path=/api/pushes/50/complete client # [ 440.344892] sshd-session[2135]: Disconnected from user root UNKNOWN port 65535 lb # [ 441.647954] niks3-server[1454]: 2026/11/12 09:25:43 INFO Registered completed upload object_key=nar/1l2lw4108yv7qr49id86lfjsnib77m9g1zddrqsjvxzxjqcz8w4m.nar.zst lb # [ 441.650783] niks3-server[1454]: 2026/11/12 09:25:43 INFO Registered completed upload object_key=log/avn1cxqm48jzvpa09r5kwch9qmdvdbi3-farm-top.drv client # [ 440.349107] sshd-session[2129]: pam_unix(sshd:session): session closed for user root lb # [ 441.653056] niks3-server[1454]: 2026/11/12 09:25:43 INFO Completed push id=50 objects=12 duration=7.09122ms lb # [ 441.654718] niks3-server[1454]: 2026/11/12 09:25:43 INFO Registered completed upload object_key=m9flngcmxr7zyiyv9aivp96q49z56342.narinfo lb # [ 441.656746] niks3-server[1454]: 2026/11/12 09:25:43 INFO Registered completed upload object_key=m9flngcmxr7zyiyv9aivp96q49z56342.ls client # [ 440.355564] systemd[1]: sshd-vsock@65-66-3:22-2:65.service: Deactivated successfully. lb # [ 441.658731] garage[898]: 2026-11-12T09:25:43.345318Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/m9flngcmxr7zyiyv9aivp96q49z56342.narinfo client # [ 440.363528] systemd[1]: session-78.scope: Deactivated successfully. client # [ 440.366518] systemd[1]: session-78.scope: Consumed 191ms CPU time over 1.509s wall clock time, 38.1M memory peak, 8.9K incoming IP traffic, 9K outgoing IP traffic. client # [ 440.375948] systemd-logind[427]: Session 78 logged out. Waiting for processes to exit. client # [ 440.378837] systemd-logind[427]: Removed session 78. client # [ 440.594751] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 440.602574] systemd[1]: Started SSH per-connection Daemon (vsock:2:66). client # [ 440.702794] sshd-session[2152]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 440.713352] sshd-session[2152]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 440.722541] sshd-session[2152]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 440.732850] systemd-logind[427]: New session '79' of user 'root' with class 'user' and type 'tty'. client # [ 440.743079] systemd[1]: Started Session 79 of User root. client # [ 440.885412] sshd-session[2158]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 440.888772] sshd-session[2158]: Disconnected from user root UNKNOWN port 65535 client # [ 440.890050] sshd-session[2152]: pam_unix(sshd:session): session closed for user root client # [ 440.893766] systemd[1]: sshd-vsock@66-67-3:22-2:66.service: Deactivated successfully. client # [ 440.898738] systemd[1]: session-79.scope: Deactivated successfully. client # [ 440.903400] systemd-logind[427]: Session 79 logged out. Waiting for processes to exit. client # [ 440.906617] systemd-logind[427]: Removed session 79. lb # [ 442.744205] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 442.748100] systemd[1]: Started SSH per-connection Daemon (vsock:2:38). lb # [ 442.849936] sshd-session[1850]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 442.859590] sshd-session[1850]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 442.868549] sshd-session[1850]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 442.877465] systemd-logind[499]: New session '52' of user 'root' with class 'user' and type 'tty'. lb # [ 442.887021] systemd[1]: Started Session 52 of User root. lb # [ 442.922000] sshd-session[1856]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 442.924787] sshd-session[1856]: Disconnected from user root UNKNOWN port 65535 lb # [ 442.926328] sshd-session[1850]: pam_unix(sshd:session): session closed for user root lb # [ 442.930957] systemd[1]: sshd-vsock@38-39-4:22-2:38.service: Deactivated successfully. lb # [ 442.936102] systemd[1]: session-52.scope: Deactivated successfully. lb # [ 442.937795] systemd[1]: session-52.scope: Consumed 29ms CPU time over 52ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 442.944531] systemd-logind[499]: Session 52 logged out. Waiting for processes to exit. lb # [ 442.945756] systemd-logind[499]: Removed session 52. worker1 # [ 442.921751] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 442.930825] systemd[1]: Started SSH per-connection Daemon (vsock:2:70). worker1 # [ 443.035301] sshd-session[2683]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 443.044278] sshd-session[2683]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 443.055147] sshd-session[2683]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 443.064485] systemd-logind[539]: New session '83' of user 'root' with class 'user' and type 'tty'. worker1 # [ 443.077564] systemd[1]: Started Session 83 of User root. worker1 # [ 443.108678] sshd-session[2689]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 443.111706] sshd-session[2689]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 443.113834] sshd-session[2683]: pam_unix(sshd:session): session closed for user root worker1 # [ 443.118484] systemd[1]: sshd-vsock@70-71-5:22-2:70.service: Deactivated successfully. worker1 # [ 443.123845] systemd[1]: session-83.scope: Deactivated successfully. worker1 # [ 443.128638] systemd-logind[539]: Session 83 logged out. Waiting for processes to exit. worker1 # [ 443.131023] systemd-logind[539]: Removed session 83. ok test farm::serial::interrupting_the_client_stops_the_build_on_the_worker ... worker1 # [ 444.218814] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 444.224635] systemd[1]: Started SSH per-connection Daemon (vsock:2:71). worker1 # [ 444.327244] sshd-session[2694]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 444.336321] sshd-session[2694]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 444.347653] sshd-session[2694]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 444.359556] systemd-logind[539]: New session '84' of user 'root' with class 'user' and type 'tty'. worker1 # [ 444.365682] systemd[1]: Started Session 84 of User root. worker1 # [ 444.403644] sshd-session[2700]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 444.406559] sshd-session[2700]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 444.408599] sshd-session[2694]: pam_unix(sshd:session): session closed for user root worker1 # [ 444.413261] systemd[1]: sshd-vsock@71-72-5:22-2:71.service: Deactivated successfully. worker1 # [ 444.418815] systemd[1]: session-84.scope: Deactivated successfully. worker1 # [ 444.423426] systemd-logind[539]: Session 84 logged out. Waiting for processes to exit. worker1 # [ 444.426201] systemd-logind[539]: Removed session 84. lb # [ 446.325930] envoy[897]: conn peer=[2001:db8:1::1]:51496 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3577 tx=1877 ms=1294 worker2 # [ 443.532619] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 443.538007] systemd[1]: Started SSH per-connection Daemon (vsock:2:50). worker2 # [ 443.637931] sshd-session[2386]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 443.647281] sshd-session[2386]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 443.658174] sshd-session[2386]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 443.679295] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 443.688877] systemd-logind[515]: New session '62' of user 'root' with class 'user' and type 'tty'. worker2 # [ 443.716932] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 443.723592] systemd[1]: Starting User Manager for UID 0... worker2 # [ 443.745983] (systemd)[2394]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 443.752682] systemd-logind[515]: New session '63' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 443.843978] systemd[2394]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 443.944408] systemd[2394]: Queued start job for default target Main User Target. worker2 # [ 443.953097] systemd[2394]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 443.957498] systemd[2394]: Created slice User Application Slice. worker2 # [ 443.958582] systemd[2394]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 443.959704] systemd[2394]: Reached target Paths. worker2 # [ 443.964530] systemd[2394]: Reached target Timers. worker2 # [ 443.965343] systemd[2394]: Starting D-Bus User Message Bus Socket... worker2 # [ 443.966270] systemd[2394]: Starting Create User Files and Directories... worker2 # [ 444.012555] systemd[2394]: Finished Create User Files and Directories. worker2 # [ 444.017363] systemd[2394]: Listening on D-Bus User Message Bus Socket. worker2 # [ 444.018468] systemd[2394]: Reached target Sockets. worker2 # [ 444.019248] systemd[2394]: Reached target Basic System. worker2 # [ 444.023602] systemd[2394]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 444.029326] systemd[2394]: Reached target Main User Target. worker2 # [ 444.030274] systemd[2394]: Startup finished in 248ms. worker2 # [ 444.031049] systemd[1]: Started User Manager for UID 0. worker2 # [ 444.031829] systemd[1]: Started Session 62 of User root. worker2 # [ 444.061022] sshd-session[2407]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 444.063635] sshd-session[2407]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 444.065770] sshd-session[2386]: pam_unix(sshd:session): session closed for user root worker2 # [ 444.069244] systemd[1]: sshd-vsock@50-51-6:22-2:50.service: Deactivated successfully. worker2 # [ 444.074816] systemd[1]: session-62.scope: Deactivated successfully. worker2 # [ 444.079349] systemd-logind[515]: Session 62 logged out. Waiting for processes to exit. worker2 # [ 444.082130] systemd-logind[515]: Removed session 62. lb # [ 448.459775] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 448.467864] systemd[1]: Started SSH per-connection Daemon (vsock:2:39). lb # [ 448.562955] sshd-session[1862]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 448.572472] sshd-session[1862]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 448.581128] sshd-session[1862]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 448.591842] systemd-logind[499]: New session '53' of user 'root' with class 'user' and type 'tty'. lb # [ 448.597728] systemd[1]: Started Session 53 of User root. lb # [ 448.631603] sshd-session[1868]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 448.634294] sshd-session[1868]: Disconnected from user root UNKNOWN port 65535 lb # [ 448.635621] sshd-session[1862]: pam_unix(sshd:session): session closed for user root lb # [ 448.639701] systemd[1]: sshd-vsock@39-40-4:22-2:39.service: Deactivated successfully. lb # [ 448.645213] systemd[1]: session-53.scope: Deactivated successfully. lb # [ 448.648708] systemd[1]: session-53.scope: Consumed 28ms CPU time over 49ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 448.653398] systemd-logind[499]: Session 53 logged out. Waiting for processes to exit. lb # [ 448.654923] systemd-logind[499]: Removed session 53. worker1 # [ 449.016508] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 449.021731] systemd[1]: Started SSH per-connection Daemon (vsock:2:72). worker1 # [ 449.119520] sshd-session[2706]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 449.128402] sshd-session[2706]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 449.139114] sshd-session[2706]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 449.150836] systemd-logind[539]: New session '85' of user 'root' with class 'user' and type 'tty'. worker1 # [ 449.157428] systemd[1]: Started Session 85 of User root. worker1 # [ 449.191973] sshd-session[2712]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 449.194477] sshd-session[2712]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 449.196518] sshd-session[2706]: pam_unix(sshd:session): session closed for user root worker1 # [ 449.200927] systemd[1]: sshd-vsock@72-73-5:22-2:72.service: Deactivated successfully. worker1 # [ 449.205802] systemd[1]: session-85.scope: Deactivated successfully. worker1 # [ 449.209155] systemd[1]: session-85.scope: Consumed 27ms CPU time over 50ms wall clock time, 3.1M memory peak, 16.3K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 449.212976] systemd-logind[539]: Session 85 logged out. Waiting for processes to exit. worker1 # [ 449.214922] systemd-logind[539]: Removed session 85. client # [ 449.376570] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 449.384568] systemd[1]: Started SSH per-connection Daemon (vsock:2:67). client # [ 449.488706] sshd-session[2165]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 449.498631] sshd-session[2165]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 449.507521] sshd-session[2165]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 449.517410] systemd-logind[427]: New session '80' of user 'root' with class 'user' and type 'tty'. client # [ 449.528554] systemd[1]: Started Session 80 of User root. client # [ 449.558786] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.pem&client-key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.key" --eval-store auto -f /nix/store/v7sckhacjvxxq8xv667z4hgvbaqhw2dd-slow.nix --argstr tag intr. client # [ 449.574769] sshd-session[2171]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 449.576752] sshd-session[2171]: Disconnected from user root UNKNOWN port 65535 client # [ 449.577820] sshd-session[2165]: pam_unix(sshd:session): session closed for user root client # [ 449.581460] systemd[1]: sshd-vsock@67-68-3:22-2:67.service: Deactivated successfully. client # [ 449.589451] systemd[1]: session-80.scope: Deactivated successfully. client # [ 449.594917] systemd-logind[427]: Session 80 logged out. Waiting for processes to exit. client # [ 449.598663] systemd-logind[427]: Removed session 80. worker2 # [ 448.213545] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48140 client # [ 449.768225] nix[2174]: don't know how to build these paths: client # [ 449.769403] nix[2174]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker1 # [ 449.774311] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 451.079744] garage[898]: 2026-11-12T09:25:52.838089Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/vr747w54dhxqrq6llhrf1rpx0x81kwvn.narinfo lb # [ 451.079928] garage[898]: 2026-11-12T09:25:52.838562Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 448.238261] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 451.097028] garage[898]: 2026-11-12T09:25:52.856477Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/vr747w54dhxqrq6llhrf1rpx0x81kwvn.narinfo lb # [ 451.102157] garage[898]: 2026-11-12T09:25:52.856910Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 451.107242] garage[898]: 2026-11-12T09:25:52.866173Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/vr747w54dhxqrq6llhrf1rpx0x81kwvn.narinfo lb # [ 451.112632] garage[898]: 2026-11-12T09:25:52.866567Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 448.264703] nix-grpc-daemon[1487]: ts=2026-11-12T09:25:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 451.123854] garage[898]: 2026-11-12T09:25:52.883310Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/85wa5czf6m5ng93xyq44r1affb74csh8.narinfo lb # [ 451.129122] garage[898]: 2026-11-12T09:25:52.883739Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 449.832151] nix[2174]: copying 1 paths to 'lb:50051'... worker1 # [ 449.837204] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44014 client # [ 449.834751] nix[2174]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker1 # [ 449.848626] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) worker1 # [ 449.866911] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) worker1 # [ 450.010819] nix-daemon[1059]: accepted connection from pid 2721, user nix-grpc-daemon (trusted) lb # [ 451.336841] niks3-server[1454]: 2026/11/12 09:25:53 INFO Received push request method=POST path=/api/pushes worker1 # [ 450.039095] nix-daemon[1059]: reaped child process 2724, status = succeeded worker1 # [ 450.042879] nix-grpc-daemon[2487]: time=2026-11-12T09:25:53.835Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 450.044812] nix-grpc-daemon[2487]: time=2026-11-12T09:25:53.835Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 451.342897] garage[898]: 2026-11-12T09:25:53.102373Z INFO garage_api_common::generic_server: 192.168.1.3:42658 PUT /farm/nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092553Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=286c59b112590872b77080a07e3d3c9c34ac94f81b90c177ab8d076f3df2c3a3 lb # [ 451.355231] garage[898]: 2026-11-12T09:25:53.113829Z INFO garage_api_common::generic_server: 192.168.1.3:42644 PUT /farm/85wa5czf6m5ng93xyq44r1affb74csh8.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092553Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f66b25194a34fef6b7ae9aa61d476cd17ff101225e230f9ae403985956817882 worker1 # [ 450.069331] nix-grpc-daemon[2487]: time=2026-11-12T09:25:53.862Z level=INFO msg="Uploading 1 narinfos" lb # [ 451.372299] garage[898]: 2026-11-12T09:25:53.126852Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 451.382158] garage[898]: 2026-11-12T09:25:53.128810Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst lb # [ 451.389255] garage[898]: 2026-11-12T09:25:53.130567Z INFO garage_api_common::generic_server: 192.168.1.3:42644 PUT /farm/85wa5czf6m5ng93xyq44r1affb74csh8.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092553Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a9a06b2b4ae21f8336308058b0c510da88f685eee1fb7ea7a03873ff8ceb4cf7 lb # [ 451.399479] niks3-server[1454]: 2026/11/12 09:25:53 INFO Received sign narinfos request method=POST path=/api/pushes/51/sign lb # [ 451.402289] niks3-server[1454]: 2026/11/12 09:25:53 INFO Signed narinfos id=51 count=1 lb # [ 451.405705] niks3-server[1454]: 2026/11/12 09:25:53 INFO Received complete push request method=POST path=/api/pushes/51/complete lb # [ 451.408435] niks3-server[1454]: 2026/11/12 09:25:53 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 451.410950] niks3-server[1454]: 2026/11/12 09:25:53 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo worker1 # [ 450.115076] nix-grpc-daemon[2487]: time=2026-11-12T09:25:53.908Z level=INFO msg="Upload complete. (238ms)" lb # [ 451.414706] garage[898]: 2026-11-12T09:25:53.139807Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/85wa5czf6m5ng93xyq44r1affb74csh8.narinfo lb # [ 451.419832] niks3-server[1454]: 2026/11/12 09:25:53 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst worker1 # [ 450.120488] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=0 paths=1 nar_bytes_in=424 lb # [ 451.423939] niks3-server[1454]: 2026/11/12 09:25:53 INFO Completed push id=51 objects=3 duration=37.40952ms worker1 # [ 450.134216] nix-daemon[1059]: reaped child process 2717, status = succeeded worker1 # [ 450.137557] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:53Z level=debug event=want client=4 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker1 # [ 450.140189] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:53Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 450.144855] nix-grpc-daemon[2296]: ts=2026-11-12T09:25:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 worker1 # [ 450.148648] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) client # [ 450.155473] nix[2174]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker1 # [ 450.162983] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) worker1 # [ 450.557146] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 450.566012] systemd[1]: Started SSH per-connection Daemon (vsock:2:73). worker1 # [ 450.663327] sshd-session[2738]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 450.671922] sshd-session[2738]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 450.682795] sshd-session[2738]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 450.694760] systemd-logind[539]: New session '86' of user 'root' with class 'user' and type 'tty'. worker1 # [ 450.699100] systemd[1]: Started Session 86 of User root. worker1 # [ 450.733451] sshd-session[2744]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 450.734989] sshd-session[2744]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 450.737253] sshd-session[2738]: pam_unix(sshd:session): session closed for user root worker1 # [ 450.741170] systemd[1]: sshd-vsock@73-74-5:22-2:73.service: Deactivated successfully. worker1 # [ 450.746835] systemd[1]: session-86.scope: Deactivated successfully. worker1 # [ 450.751236] systemd-logind[539]: Session 86 logged out. Waiting for processes to exit. worker1 # [ 450.754057] systemd-logind[539]: Removed session 86. worker2 # [ 449.269830] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 449.278721] systemd[1]: Started SSH per-connection Daemon (vsock:2:51). worker2 # [ 449.385511] sshd-session[2413]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 449.395488] sshd-session[2413]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 449.404897] sshd-session[2413]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 449.416515] systemd-logind[515]: New session '64' of user 'root' with class 'user' and type 'tty'. worker2 # [ 449.421071] systemd[1]: Started Session 64 of User root. worker2 # [ 449.457470] sshd-session[2419]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 449.459005] sshd-session[2419]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 449.460749] sshd-session[2413]: pam_unix(sshd:session): session closed for user root worker2 # [ 449.465428] systemd[1]: sshd-vsock@51-52-6:22-2:51.service: Deactivated successfully. worker2 # [ 449.471080] systemd[1]: session-64.scope: Deactivated successfully. worker2 # [ 449.475471] systemd-logind[515]: Session 64 logged out. Waiting for processes to exit. worker2 # [ 449.478383] systemd-logind[515]: Removed session 64. lb # [ 452.627169] garage[898]: 2026-11-12T09:25:54.385481Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/vr747w54dhxqrq6llhrf1rpx0x81kwvn.narinfo lb # [ 452.627424] garage[898]: 2026-11-12T09:25:54.386048Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 452.855654] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 452.858996] systemd[1]: Started SSH per-connection Daemon (vsock:2:74). worker1 # [ 452.988134] sshd-session[2758]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 453.001536] sshd-session[2758]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 453.016328] sshd-session[2758]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 453.028453] systemd-logind[539]: New session '87' of user 'root' with class 'user' and type 'tty'. worker1 # [ 453.034284] systemd[1]: Started Session 87 of User root. worker1 # [ 453.245806] sshd-session[2764]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 453.247373] sshd-session[2764]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 453.252197] sshd-session[2758]: pam_unix(sshd:session): session closed for user root worker1 # [ 453.294222] systemd[1]: sshd-vsock@74-75-5:22-2:74.service: Deactivated successfully. worker1 # [ 453.295476] systemd[1]: session-87.scope: Deactivated successfully. worker1 # [ 453.300590] systemd-logind[539]: Session 87 logged out. Waiting for processes to exit. worker1 # [ 453.301821] systemd-logind[539]: Removed session 87. worker2 # [ 451.793755] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 451.801007] systemd[1]: Started SSH per-connection Daemon (vsock:2:52). worker2 # [ 451.896592] sshd-session[2424]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 451.903784] sshd-session[2424]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 451.914358] sshd-session[2424]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 451.924516] systemd-logind[515]: New session '65' of user 'root' with class 'user' and type 'tty'. worker2 # [ 451.934812] systemd[1]: Started Session 65 of User root. worker2 # [ 451.966131] sshd-session[2430]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 451.968774] sshd-session[2430]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 451.970587] sshd-session[2424]: pam_unix(sshd:session): session closed for user root worker2 # [ 451.974128] systemd[1]: sshd-vsock@52-53-6:22-2:52.service: Deactivated successfully. worker2 # [ 451.980002] systemd[1]: session-65.scope: Deactivated successfully. worker2 # [ 451.985173] systemd-logind[515]: Session 65 logged out. Waiting for processes to exit. worker2 # [ 451.987220] systemd-logind[515]: Removed session 65. client # [ 457.269823] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 457.278044] systemd[1]: Started SSH per-connection Daemon (vsock:2:68). client # [ 457.374490] sshd-session[2187]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 457.384395] sshd-session[2187]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 457.393568] sshd-session[2187]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 457.404618] systemd-logind[427]: New session '81' of user 'root' with class 'user' and type 'tty'. client # [ 457.413017] systemd[1]: Started Session 81 of User root. client # [ 457.439841] systemd[1]: intr.service: Sent signal SIGINT to main process 2174 (nix) on client request. client # [ 457.448960] nix[2174]: shutting downerror: interrupted by the user client # [ 457.450276] sshd-session[2193]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 457.453368] sshd-session[2193]: Disconnected from user root UNKNOWN port 65535 client # [ 457.454647] sshd-session[2187]: pam_unix(sshd:session): session closed for user root client # [ 457.469565] systemd[1]: sshd-vsock@68-69-3:22-2:68.service: Deactivated successfully. client # [ 457.472541] systemd[1]: session-81.scope: Deactivated successfully. client # [ 457.476696] systemd-logind[427]: Session 81 logged out. Waiting for processes to exit. client # [ 457.479855] systemd-logind[427]: Removed session 81. client # [ 457.485617] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 457.488772] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 457.490136] systemd[1]: intr.service: Consumed 179ms CPU time over 7.928s wall clock time, 38.8M memory peak, 7.2K incoming IP traffic, 7.8K outgoing IP traffic. lb # [ 458.805435] systemd[1]: Stopping User Manager for UID 0... lb # [ 458.813289] systemd[1832]: Activating special unit Exit the Session... lb # [ 458.818256] systemd[1832]: Stopped target Main User Target. lb # [ 458.823064] systemd[1832]: Stopped target Basic System. lb # [ 458.825570] systemd[1832]: Stopped target Paths. lb # [ 458.826684] systemd[1832]: Stopped target Sockets. lb # [ 458.827801] systemd[1832]: Stopped target Timers. lb # [ 458.829394] systemd[1832]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 458.831050] systemd[1832]: Closed D-Bus User Message Bus Socket. lb # [ 458.832482] systemd[1832]: Stopped Create User Files and Directories. lb # [ 458.834033] systemd[1832]: Removed slice User Application Slice. lb # [ 458.835382] systemd[1832]: Reached target Shutdown. lb # [ 458.837151] systemd[1832]: Finished Exit the Session. lb # [ 458.838462] systemd[1832]: Reached target Exit the Session. lb # [ 458.861776] systemd-logind[499]: Removed session 51. lb # [ 458.869435] systemd[1]: user@0.service: Deactivated successfully. lb # [ 458.874875] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 457.597444] nix-daemon[1059]: reaped child process 2729, status = succeeded worker1 # [ 457.608592] nix-daemon[2731]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 457.615262] nix-daemon[1059]: reaped child process 2731, status = failed with exit code 1 lb # [ 458.935437] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 458.974495] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 458.980328] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 458.984480] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 458.071196] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. [e2e] heartbeat t=360s worker1 # [ 458.079322] systemd[1]: Started SSH per-connection Daemon (vsock:2:75). worker1 # [ 458.171452] sshd-session[2770]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 458.180558] sshd-session[2770]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 458.189076] sshd-session[2770]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 458.200644] systemd-logind[539]: New session '88' of user 'root' with class 'user' and type 'tty'. worker1 # [ 458.204986] systemd[1]: Started Session 88 of User root. worker1 # [ 458.237973] sshd-session[2776]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 458.240909] sshd-session[2776]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 458.242180] sshd-session[2770]: pam_unix(sshd:session): session closed for user root worker1 # [ 458.246712] systemd[1]: sshd-vsock@75-76-5:22-2:75.service: Deactivated successfully. worker1 # [ 458.251778] systemd[1]: session-88.scope: Deactivated successfully. worker1 # [ 458.256763] systemd-logind[539]: Session 88 logged out. Waiting for processes to exit. worker1 # [ 458.259147] systemd-logind[539]: Removed session 88. worker2 # [ 460.780530] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 460.784464] systemd[1]: Started SSH per-connection Daemon (vsock:2:53). worker2 # [ 460.882804] sshd-session[2435]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 460.891219] sshd-session[2435]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 460.902394] sshd-session[2435]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 460.914438] systemd-logind[515]: New session '66' of user 'root' with class 'user' and type 'tty'. worker2 # [ 460.921340] systemd[1]: Started Session 66 of User root. worker2 # [ 460.957128] sshd-session[2441]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 460.958715] sshd-session[2441]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 460.960992] sshd-session[2435]: pam_unix(sshd:session): session closed for user root worker2 # [ 460.965428] systemd[1]: sshd-vsock@53-54-6:22-2:53.service: Deactivated successfully. ok test farm::serial::low_disk_drains_a_worker_and_builds_go_to_the_other ... worker2 # [ 460.970788] systemd[1]: session-66.scope: Deactivated successfully. worker2 # [ 460.975233] systemd-logind[515]: Session 66 logged out. Waiting for processes to exit. worker2 # [ 460.978064] systemd-logind[515]: Removed session 66. worker1 # [ 462.966999] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 462.978356] systemd[1]: Started SSH per-connection Daemon (vsock:2:76). worker1 # [ 463.080799] sshd-session[2781]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 463.088698] sshd-session[2781]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 463.098890] sshd-session[2781]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 463.108479] systemd-logind[539]: New session '89' of user 'root' with class 'user' and type 'tty'. worker1 # [ 463.121016] systemd[1]: Started Session 89 of User root. worker1 # [ 463.156545] sshd-session[2787]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 463.159445] sshd-session[2787]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 463.160915] sshd-session[2781]: pam_unix(sshd:session): session closed for user root worker1 # [ 463.165094] systemd[1]: sshd-vsock@76-77-5:22-2:76.service: Deactivated successfully. worker1 # [ 463.170604] systemd[1]: session-89.scope: Deactivated successfully. worker1 # [ 463.175151] systemd-logind[539]: Session 89 logged out. Waiting for processes to exit. worker1 # [ 463.177791] systemd-logind[539]: Removed session 89. worker2 # [ 463.239459] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 463.247710] systemd[1]: Started SSH per-connection Daemon (vsock:2:54). worker2 # [ 463.344927] sshd-session[2446]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 463.354177] sshd-session[2446]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 463.362893] sshd-session[2446]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 463.372516] systemd-logind[515]: New session '67' of user 'root' with class 'user' and type 'tty'. worker2 # [ 463.380956] systemd[1]: Started Session 67 of User root. worker2 # [ 463.412562] sshd-session[2452]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 463.415073] sshd-session[2452]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 463.416560] sshd-session[2446]: pam_unix(sshd:session): session closed for user root worker2 # [ 463.420706] systemd[1]: sshd-vsock@54-55-6:22-2:54.service: Deactivated successfully. worker2 # [ 463.426225] systemd[1]: session-67.scope: Deactivated successfully. worker2 # [ 463.430918] systemd-logind[515]: Session 67 logged out. Waiting for processes to exit. worker2 # [ 463.433483] systemd-logind[515]: Removed session 67. lb # [ 466.327769] envoy[897]: conn peer=[2001:db8:1::1]:58102 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2707 tx=776 ms=7695 client # [ 467.644867] systemd[1]: Stopping User Manager for UID 0... client # [ 467.655310] systemd[2084]: Activating special unit Exit the Session... client # [ 467.663976] systemd[2084]: Stopped target Main User Target. client # [ 467.665906] systemd[2084]: Stopped target Basic System. client # [ 467.667166] systemd[2084]: Stopped target Paths. client # [ 467.668943] systemd[2084]: Stopped target Sockets. client # [ 467.671078] systemd[2084]: Stopped target Timers. client # [ 467.672484] systemd[2084]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 467.674197] systemd[2084]: Closed D-Bus User Message Bus Socket. client # [ 467.675584] systemd[2084]: Stopped Create User Files and Directories. client # [ 467.677189] systemd[2084]: Removed slice User Application Slice. client # [ 467.678551] systemd[2084]: Reached target Shutdown. client # [ 467.679680] systemd[2084]: Finished Exit the Session. client # [ 467.683411] systemd[2084]: Reached target Exit the Session. client # [ 467.687596] systemd-logind[427]: Removed session 76. client # [ 467.696638] systemd[1]: user@0.service: Deactivated successfully. client # [ 467.700190] systemd[1]: Stopped User Manager for UID 0. client # [ 467.769569] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 467.810372] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 467.817988] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 467.824355] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 469.234581] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 469.242709] systemd[1]: Started SSH per-connection Daemon (vsock:2:40). lb # [ 469.343159] sshd-session[1880]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 469.352294] sshd-session[1880]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 469.361906] sshd-session[1880]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 469.392486] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 469.427122] systemd-logind[499]: New session '54' of user 'root' with class 'user' and type 'tty'. lb # [ 469.439017] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 469.446444] systemd[1]: Starting User Manager for UID 0... lb # [ 469.473870] (systemd)[1889]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 469.480304] systemd-logind[499]: New session '55' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 469.573740] systemd[1889]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 469.672416] systemd[1889]: Queued start job for default target Main User Target. lb # [ 469.681218] systemd[1889]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 469.684261] systemd[1889]: Created slice User Application Slice. lb # [ 469.686773] systemd[1889]: Started Daily Cleanup of User's Temporary Directories. lb # [ 469.687946] systemd[1889]: Reached target Paths. lb # [ 469.690548] systemd[1889]: Reached target Timers. lb # [ 469.692189] systemd[1889]: Starting D-Bus User Message Bus Socket... lb # [ 469.694481] systemd[1889]: Starting Create User Files and Directories... lb # [ 469.724352] systemd[1889]: Listening on D-Bus User Message Bus Socket. lb # [ 469.725895] systemd[1889]: Reached target Sockets. lb # [ 469.740552] systemd[1889]: Finished Create User Files and Directories. lb # [ 469.742809] systemd[1889]: Reached target Basic System. lb # [ 469.743675] systemd[1889]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 469.747913] systemd[1889]: Reached target Main User Target. lb # [ 469.749009] systemd[1889]: Startup finished in 246ms. lb # [ 469.749812] systemd[1]: Started User Manager for UID 0. lb # [ 469.753605] systemd[1]: Started Session 54 of User root. lb # [ 469.786186] sshd-session[1902]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 469.789132] sshd-session[1902]: Disconnected from user root UNKNOWN port 65535 lb # [ 469.790241] sshd-session[1880]: pam_unix(sshd:session): session closed for user root lb # [ 469.794744] systemd[1]: sshd-vsock@40-41-4:22-2:40.service: Deactivated successfully. lb # [ 469.799512] systemd[1]: session-54.scope: Deactivated successfully. lb # [ 469.802849] systemd[1]: session-54.scope: Consumed 26ms CPU time over 48ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 469.807333] systemd-logind[499]: Session 54 logged out. Waiting for processes to exit. lb # [ 469.808763] systemd-logind[499]: Removed session 54. worker1 # [ 468.698980] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 468.707292] systemd[1]: Started SSH per-connection Daemon (vsock:2:77). worker1 # [ 468.806811] sshd-session[2793]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 468.816704] sshd-session[2793]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 468.825555] sshd-session[2793]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 468.836755] systemd-logind[539]: New session '90' of user 'root' with class 'user' and type 'tty'. worker1 # [ 468.846440] systemd[1]: Started Session 90 of User root. worker1 # [ 468.881351] sshd-session[2799]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 468.882960] sshd-session[2799]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 468.885007] sshd-session[2793]: pam_unix(sshd:session): session closed for user root worker1 # [ 468.888721] systemd[1]: sshd-vsock@77-78-5:22-2:77.service: Deactivated successfully. worker1 # [ 468.894140] systemd[1]: session-90.scope: Deactivated successfully. worker1 # [ 468.897091] systemd[1]: session-90.scope: Consumed 28ms CPU time over 50ms wall clock time, 3.1M memory peak, 19.1K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 468.902107] systemd-logind[539]: Session 90 logged out. Waiting for processes to exit. worker1 # [ 468.903291] systemd-logind[539]: Removed session 90. worker1 # [ 469.151114] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 469.159693] systemd[1]: Started SSH per-connection Daemon (vsock:2:78). worker1 # [ 469.253465] sshd-session[2804]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 469.261416] sshd-session[2804]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 469.271882] sshd-session[2804]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 469.280542] systemd-logind[539]: New session '91' of user 'root' with class 'user' and type 'tty'. worker1 # [ 469.293409] systemd[1]: Started Session 91 of User root. worker1 # [ 469.322982] sshd-session[2810]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 469.326019] sshd-session[2810]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 469.327923] sshd-session[2804]: pam_unix(sshd:session): session closed for user root worker1 # [ 469.332276] systemd[1]: sshd-vsock@78-79-5:22-2:78.service: Deactivated successfully. worker1 # [ 469.337640] systemd[1]: session-91.scope: Deactivated successfully. worker1 # [ 469.341941] systemd-logind[539]: Session 91 logged out. Waiting for processes to exit. worker1 # [ 469.344384] systemd-logind[539]: Removed session 91. worker1 # [ 470.609800] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 470.618808] systemd[1]: Started SSH per-connection Daemon (vsock:2:79). worker1 # [ 470.714387] sshd-session[2815]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 470.724333] sshd-session[2815]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 470.734033] sshd-session[2815]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 470.743341] systemd-logind[539]: New session '92' of user 'root' with class 'user' and type 'tty'. worker1 # [ 470.752626] systemd[1]: Started Session 92 of User root. worker1 # [ 470.783577] sshd-session[2821]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 470.786519] sshd-session[2821]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 470.787863] sshd-session[2815]: pam_unix(sshd:session): session closed for user root worker1 # [ 470.792757] systemd[1]: sshd-vsock@79-80-5:22-2:79.service: Deactivated successfully. worker1 # [ 470.797802] systemd[1]: session-92.scope: Deactivated successfully. worker1 # [ 470.802198] systemd-logind[539]: Session 92 logged out. Waiting for processes to exit. worker1 # [ 470.804735] systemd-logind[539]: Removed session 92. worker1 # [ 473.747793] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 473.756185] systemd[1]: Started SSH per-connection Daemon (vsock:2:80). worker1 # [ 473.853090] sshd-session[2826]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 473.860730] sshd-session[2826]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 473.871227] sshd-session[2826]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 473.880524] systemd-logind[539]: New session '93' of user 'root' with class 'user' and type 'tty'. worker1 # [ 473.893606] systemd[1]: Started Session 93 of User root. worker1 # [ 473.920980] sshd-session[2832]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 473.923971] sshd-session[2832]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 473.926273] sshd-session[2826]: pam_unix(sshd:session): session closed for user root worker1 # [ 473.931638] systemd[1]: sshd-vsock@80-81-5:22-2:80.service: Deactivated successfully. worker1 # [ 473.938160] systemd[1]: session-93.scope: Deactivated successfully. worker1 # [ 473.943611] systemd-logind[539]: Session 93 logged out. Waiting for processes to exit. worker1 # [ 473.946751] systemd-logind[539]: Removed session 93. worker1 # [ 475.119576] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 475.127228] systemd[1]: Started SSH per-connection Daemon (vsock:2:81). worker2 # [ 473.584323] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 473.591656] systemd[2394]: Activating special unit Exit the Session... worker2 # [ 473.596321] systemd[2394]: Stopped target Main User Target. worker2 # [ 473.597706] systemd[2394]: Stopped target Basic System. worker2 # [ 473.598941] systemd[2394]: Stopped target Paths. worker2 # [ 473.605447] systemd[2394]: Stopped target Sockets. worker2 # [ 473.606744] systemd[2394]: Stopped target Timers. worker2 # [ 473.607909] systemd[2394]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 473.609805] systemd[2394]: Closed D-Bus User Message Bus Socket. worker2 # [ 473.611212] systemd[2394]: Stopped Create User Files and Directories. worker2 # [ 473.612882] systemd[2394]: Removed slice User Application Slice. worker2 # [ 473.614207] systemd[2394]: Reached target Shutdown. worker2 # [ 473.615307] systemd[2394]: Finished Exit the Session. worker2 # [ 473.616807] systemd[2394]: Reached target Exit the Session. worker2 # [ 473.642041] systemd-logind[515]: Removed session 63. worker2 # [ 473.650436] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 473.656308] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 475.221103] sshd-session[2837]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 473.671121] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 475.230173] sshd-session[2837]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 475.240993] sshd-session[2837]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 475.252288] systemd-logind[539]: New session '94' of user 'root' with class 'user' and type 'tty'. worker1 # [ 475.256962] systemd[1]: Started Session 94 of User root. worker2 # [ 473.713639] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 473.717288] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 473.724935] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 476.683675] sshd-session[2843]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 476.685517] sshd-session[2843]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 476.688098] sshd-session[2837]: pam_unix(sshd:session): session closed for user root worker1 # [ 476.696699] systemd[1]: sshd-vsock@81-82-5:22-2:81.service: Deactivated successfully. worker1 # [ 476.700447] systemd[1]: session-94.scope: Deactivated successfully. worker1 # [ 476.701864] systemd-logind[539]: Session 94 logged out. Waiting for processes to exit. worker1 # [ 476.707132] systemd[1]: session-94.scope: Consumed 1.407s CPU time over 1.443s wall clock time, 625.1M memory peak. worker1 # [ 476.709152] systemd-logind[539]: Removed session 94. worker1 # [ 476.983056] nix-grpc-daemon[2296]: ts=2026-11-12T09:26:20Z level=info event=unhealthy reason=min_free worker1 # [ 477.476684] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 477.486285] systemd[1]: Started SSH per-connection Daemon (vsock:2:82). worker1 # [ 477.599166] sshd-session[2848]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 477.611010] sshd-session[2848]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 477.620485] sshd-session[2848]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 477.632169] systemd-logind[539]: New session '95' of user 'root' with class 'user' and type 'tty'. worker1 # [ 477.640521] systemd[1]: Started Session 95 of User root. worker1 # [ 477.675887] sshd-session[2854]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 477.678950] sshd-session[2854]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 477.680492] sshd-session[2848]: pam_unix(sshd:session): session closed for user root worker1 # [ 477.685177] systemd[1]: sshd-vsock@82-83-5:22-2:82.service: Deactivated successfully. worker1 # [ 477.704400] systemd[1]: session-95.scope: Deactivated successfully. worker1 # [ 477.709510] systemd-logind[539]: Session 95 logged out. Waiting for processes to exit. worker1 # [ 477.712354] systemd-logind[539]: Removed session 95. client # [ 478.490371] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 478.498724] systemd[1]: Started SSH per-connection Daemon (vsock:2:69). client # [ 478.596403] sshd-session[2206]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 478.604313] sshd-session[2206]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 478.614322] sshd-session[2206]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 478.644514] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 478.679754] systemd-logind[427]: New session '82' of user 'root' with class 'user' and type 'tty'. client # [ 478.691398] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 478.698903] systemd[1]: Starting User Manager for UID 0... client # [ 478.725538] (systemd)[2215]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 478.731844] systemd-logind[427]: New session '83' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 480.057141] systemd[1]: Stopping User Manager for UID 0... lb # [ 480.066537] systemd[1889]: Activating special unit Exit the Session... lb # [ 480.069450] systemd[1889]: Stopped target Main User Target. lb # [ 480.070851] systemd[1889]: Stopped target Basic System. lb # [ 480.076358] systemd[1889]: Stopped target Paths. lb # [ 480.077685] systemd[1889]: Stopped target Sockets. lb # [ 480.078811] systemd[1889]: Stopped target Timers. lb # [ 480.079932] systemd[1889]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 480.082911] systemd[1889]: Closed D-Bus User Message Bus Socket. lb # [ 480.084650] systemd[1889]: Stopped Create User Files and Directories. lb # [ 480.087093] systemd[1889]: Removed slice User Application Slice. lb # [ 480.088718] systemd[1889]: Reached target Shutdown. lb # [ 480.089993] systemd[1889]: Finished Exit the Session. lb # [ 480.091287] systemd[1889]: Reached target Exit the Session. lb # [ 480.101790] systemd-logind[499]: Removed session 55. lb # [ 480.109797] systemd[1]: user@0.service: Deactivated successfully. lb # [ 480.112687] systemd[1]: Stopped User Manager for UID 0. client # [ 478.821459] systemd[2215]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 480.175814] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 480.213572] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 480.217542] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 480.223371] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 478.937744] systemd[2215]: Queued start job for default target Main User Target. client # [ 478.945063] systemd[2215]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 478.949394] systemd[2215]: Created slice User Application Slice. client # [ 478.950523] systemd[2215]: Started Daily Cleanup of User's Temporary Directories. client # [ 478.951576] systemd[2215]: Reached target Paths. client # [ 478.954967] systemd[2215]: Reached target Timers. client # [ 478.955744] systemd[2215]: Starting D-Bus User Message Bus Socket... client # [ 478.960237] systemd[2215]: Starting Create User Files and Directories... client # [ 479.003884] systemd[2215]: Finished Create User Files and Directories. client # [ 479.008726] systemd[2215]: Listening on D-Bus User Message Bus Socket. client # [ 479.013956] systemd[2215]: Reached target Sockets. client # [ 479.014877] systemd[2215]: Reached target Basic System. client # [ 479.015651] systemd[2215]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 479.017306] systemd[2215]: Reached target Main User Target. client # [ 479.018155] systemd[2215]: Startup finished in 263ms. client # [ 479.018902] systemd[1]: Started User Manager for UID 0. client # [ 479.021457] systemd[1]: Started Session 82 of User root. worker2 # [ 477.648932] nix-grpc-daemon[1487]: ts=2026-11-12T09:26:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48140 worker2 # [ 477.657103] nix-grpc-daemon[1487]: ts=2026-11-12T09:26:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 480.518738] garage[898]: 2026-11-12T09:26:22.277018Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/g774lks418zc45bd9hwhinm61pwcwnr9.narinfo lb # [ 480.525472] garage[898]: 2026-11-12T09:26:22.277583Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 480.530779] garage[898]: 2026-11-12T09:26:22.283858Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo lb # [ 480.536351] garage[898]: 2026-11-12T09:26:22.284337Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 477.683621] nix-grpc-daemon[1487]: ts=2026-11-12T09:26:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 480.539585] garage[898]: 2026-11-12T09:26:22.284475Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo lb # [ 480.545743] garage[898]: 2026-11-12T09:26:22.284656Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 480.550461] garage[898]: 2026-11-12T09:26:22.304705Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo lb # [ 480.555543] garage[898]: 2026-11-12T09:26:22.305111Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 477.707239] nix-grpc-daemon[1487]: ts=2026-11-12T09:26:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 480.559826] garage[898]: 2026-11-12T09:26:22.309645Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo lb # [ 480.564517] garage[898]: 2026-11-12T09:26:22.310009Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 480.569821] garage[898]: 2026-11-12T09:26:22.328700Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/g774lks418zc45bd9hwhinm61pwcwnr9.narinfo lb # [ 480.575913] garage[898]: 2026-11-12T09:26:22.329143Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 480.580503] garage[898]: 2026-11-12T09:26:22.335059Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/g774lks418zc45bd9hwhinm61pwcwnr9.narinfo lb # [ 480.587088] garage[898]: 2026-11-12T09:26:22.335479Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 477.733837] nix-grpc-daemon[1487]: ts=2026-11-12T09:26:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 480.592716] garage[898]: 2026-11-12T09:26:22.352228Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo lb # [ 480.597645] garage[898]: 2026-11-12T09:26:22.352638Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 480.602386] garage[898]: 2026-11-12T09:26:22.361267Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo lb # [ 480.607155] garage[898]: 2026-11-12T09:26:22.361760Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 477.758566] nix-grpc-daemon[1487]: ts=2026-11-12T09:26:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 480.618134] garage[898]: 2026-11-12T09:26:22.377677Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo lb # [ 480.624467] garage[898]: 2026-11-12T09:26:22.378062Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 480.628342] garage[898]: 2026-11-12T09:26:22.383080Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo lb # [ 480.633705] garage[898]: 2026-11-12T09:26:22.383463Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 477.782673] nix-grpc-daemon[1487]: ts=2026-11-12T09:26:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 480.636704] garage[898]: 2026-11-12T09:26:22.383779Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo lb # [ 480.640327] garage[898]: 2026-11-12T09:26:22.384016Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 477.793727] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 477.816312] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 477.972365] nix-daemon[976]: accepted connection from pid 2466, user nix-grpc-daemon (trusted) lb # [ 480.848359] niks3-server[1454]: 2026/11/12 09:26:22 INFO Received push request method=POST path=/api/pushes worker2 # [ 477.998700] nix-daemon[976]: reaped child process 2469, status = succeeded worker2 # [ 478.003695] nix-grpc-daemon[1723]: time=2026-11-12T09:26:23.275Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker2 # [ 478.005916] nix-grpc-daemon[1723]: time=2026-11-12T09:26:23.275Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" worker2 # [ 478.007761] nix-grpc-daemon[1723]: time=2026-11-12T09:26:23.275Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" worker2 # [ 478.009738] nix-grpc-daemon[1723]: time=2026-11-12T09:26:23.275Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 480.857803] garage[898]: 2026-11-12T09:26:22.616566Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092622Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2802006ad7ae0bba515c579dd253ce42afff54c65608245e85ca07be342e696d worker2 # [ 478.029881] nix-grpc-daemon[1723]: time=2026-11-12T09:26:23.302Z level=INFO msg="Uploading 3 narinfos" lb # [ 480.885246] garage[898]: 2026-11-12T09:26:22.617341Z INFO garage_api_common::generic_server: 192.168.1.4:54250 PUT /farm/fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092622Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=09c71ace3ee795005cde512de47362e63c7f3f0d06d22028e26d3148f410466f lb # [ 480.903436] garage[898]: 2026-11-12T09:26:22.627597Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092622Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2159b92dcf8d857bfed238c24861d04637d0d07418bf641e11e0999dc3097614 lb # [ 480.913449] garage[898]: 2026-11-12T09:26:22.628151Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092622Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a375661aab411e4863a7ed46b9a2226b8abee0781e400c7dc1fdd0376c6cd0ed lb # [ 480.928997] garage[898]: 2026-11-12T09:26:22.628429Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092622Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a44708a73132a17e5193562ce725e655f0fb90cc9095b0869f0130f942815477 lb # [ 480.939242] garage[898]: 2026-11-12T09:26:22.628675Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092622Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=96c811f793c4d01a4fac86402a8b89a7f605ca71c9ed414052fde41c7a6cfd71 lb # [ 480.946870] garage[898]: 2026-11-12T09:26:22.636509Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst lb # [ 480.951665] niks3-server[1454]: 2026/11/12 09:26:22 INFO Received sign narinfos request method=POST path=/api/pushes/52/sign lb # [ 480.954287] niks3-server[1454]: 2026/11/12 09:26:22 INFO Signed narinfos id=52 count=3 worker2 # [ 478.100571] nix-grpc-daemon[1723]: time=2026-11-12T09:26:23.373Z level=INFO msg="Upload complete. (272ms)" lb # [ 480.955509] niks3-server[1454]: 2026/11/12 09:26:22 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst lb # [ 480.957784] niks3-server[1454]: 2026/11/12 09:26:22 INFO Received complete push request method=POST path=/api/pushes/52/complete lb # [ 480.960564] niks3-server[1454]: 2026/11/12 09:26:22 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 480.963296] niks3-server[1454]: 2026/11/12 09:26:22 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst worker2 # [ 478.108146] nix-grpc-daemon[1487]: ts=2026-11-12T09:26:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 paths=3 nar_bytes_in=1904 lb # [ 480.965937] niks3-server[1454]: 2026/11/12 09:26:22 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls lb # [ 480.967847] niks3-server[1454]: 2026/11/12 09:26:22 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst lb # [ 480.970265] niks3-server[1454]: 2026/11/12 09:26:22 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 480.973356] niks3-server[1454]: 2026/11/12 09:26:22 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo lb # [ 480.975534] niks3-server[1454]: 2026/11/12 09:26:22 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker1 # [ 479.675068] nix-grpc-daemon[2296]: ts=2026-11-12T09:26:23Z level=debug event=want client=5 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker2 # [ 478.123229] nix-daemon[976]: reaped child process 2462, status = succeeded lb # [ 480.977961] niks3-server[1454]: 2026/11/12 09:26:22 INFO Completed push id=52 objects=9 duration=52.16954ms worker1 # [ 479.679141] nix-grpc-daemon[2296]: ts=2026-11-12T09:26:23Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 lb # [ 480.979912] garage[898]: 2026-11-12T09:26:22.638058Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst lb # [ 480.984155] garage[898]: 2026-11-12T09:26:22.638454Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 478.131456] nix-grpc-daemon[1487]: ts=2026-11-12T09:26:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 480.987663] garage[898]: 2026-11-12T09:26:22.638702Z INFO garage_api_common::generic_server: 127.0.0.1:52594 (key GK0123456789abcdef01234567) HEAD /farm/fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 480.990577] garage[898]: 2026-11-12T09:26:22.641685Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls worker2 # [ 478.142036] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 480.993477] garage[898]: 2026-11-12T09:26:22.644381Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092622Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3961a76fd17e272f0784f3206217c8e0e76721db7a51e8d425d97717115154ee lb # [ 480.999207] garage[898]: 2026-11-12T09:26:22.644791Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092622Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83af46f6058d09e7ffddbbcdca22abdd993423e6c6c65dd0396621ea9135fb35 lb # [ 481.004853] niks3-server[1454]: 2026/11/12 09:26:22 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo lb # [ 481.007017] garage[898]: 2026-11-12T09:26:22.654644Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092622Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31711c891577ae47a21da3c2c65ef7b740304af61d97861d6f09b5c517118701 worker2 # [ 478.158288] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 481.012751] garage[898]: 2026-11-12T09:26:22.655831Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls lb # [ 481.015305] garage[898]: 2026-11-12T09:26:22.684593Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo lb # [ 481.018101] garage[898]: 2026-11-12T09:26:22.686487Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo lb # [ 481.020760] garage[898]: 2026-11-12T09:26:22.697111Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo lb # [ 482.369648] garage[898]: 2026-11-12T09:26:24.128242Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 479.804371] nix-daemon[976]: reaped child process 2474, status = succeeded worker2 # [ 479.921737] nix-daemon[976]: accepted connection from pid 2490, user nix-grpc-daemon (trusted) lb # [ 482.374783] garage[898]: 2026-11-12T09:26:24.128689Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 479.946793] nix-daemon[976]: reaped child process 2493, status = succeeded lb # [ 482.798144] niks3-server[1454]: 2026/11/12 09:26:24 INFO Received push request method=POST path=/api/pushes worker2 # [ 479.956602] nix-grpc-daemon[1723]: time=2026-11-12T09:26:25.228Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 479.958222] nix-grpc-daemon[1723]: time=2026-11-12T09:26:25.228Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 482.815103] garage[898]: 2026-11-12T09:26:24.574543Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092624Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0aa6e9479fa006bda060c0e6bd6e36a8e05b4b3c82f8757637f13ad204242d31 worker2 # [ 479.981082] nix-grpc-daemon[1723]: time=2026-11-12T09:26:25.253Z level=INFO msg="Uploading 1 narinfos" lb # [ 482.836286] garage[898]: 2026-11-12T09:26:24.585427Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092624Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2e858bcd9fda00e553fa9e73c066aa30df3405905c119ce5cccb3f3c75598ef6 lb # [ 482.847227] garage[898]: 2026-11-12T09:26:24.585866Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092624Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ff4f3652967a36226b7cc61de26e513e8c2af4fe5109d21b673acac77f0115de lb # [ 482.861372] garage[898]: 2026-11-12T09:26:24.588697Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 482.866436] garage[898]: 2026-11-12T09:26:24.590057Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 482.871885] garage[898]: 2026-11-12T09:26:24.592425Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 482.878239] garage[898]: 2026-11-12T09:26:24.594783Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092624Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4c6d4123778e4d0434aaf4b186bed2542aa343db82c9cb007aa30637fbcc0770 worker2 # [ 480.034284] nix-grpc-daemon[1723]: time=2026-11-12T09:26:25.307Z level=INFO msg="Upload complete. (263ms)" lb # [ 482.887774] niks3-server[1454]: 2026/11/12 09:26:24 INFO Received sign narinfos request method=POST path=/api/pushes/53/sign lb # [ 482.890282] niks3-server[1454]: 2026/11/12 09:26:24 INFO Signed narinfos id=53 count=1 lb # [ 482.892198] niks3-server[1454]: 2026/11/12 09:26:24 INFO Received complete push request method=POST path=/api/pushes/53/complete lb # [ 482.894769] niks3-server[1454]: 2026/11/12 09:26:24 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 482.898318] niks3-server[1454]: 2026/11/12 09:26:24 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker2 # [ 480.044973] nix-grpc-daemon[1487]: ts=2026-11-12T09:26:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=9 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 482.901612] niks3-server[1454]: 2026/11/12 09:26:24 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo lb # [ 482.904265] niks3-server[1454]: 2026/11/12 09:26:24 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 482.906668] niks3-server[1454]: 2026/11/12 09:26:24 INFO Completed push id=53 objects=4 duration=41.46808ms worker2 # [ 480.056920] nix-daemon[976]: reaped child process 2472, status = succeeded lb # [ 482.910193] garage[898]: 2026-11-12T09:26:24.619040Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker1 # [ 481.612254] nix-grpc-daemon[2296]: ts=2026-11-12T09:26:25Z level=debug event=want client=5 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker1 # [ 481.615631] nix-grpc-daemon[2296]: ts=2026-11-12T09:26:25Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 480.063217] nix-grpc-daemon[1487]: ts=2026-11-12T09:26:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 worker2 # [ 480.073270] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 480.089740] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 483.419044] garage[898]: 2026-11-12T09:26:25.177776Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/g774lks418zc45bd9hwhinm61pwcwnr9.narinfo lb # [ 483.424347] garage[898]: 2026-11-12T09:26:25.178237Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 480.934522] nix-daemon[976]: reaped child process 2498, status = succeeded worker2 # [ 481.053521] nix-daemon[976]: accepted connection from pid 2515, user nix-grpc-daemon (trusted) worker2 # [ 481.077179] nix-daemon[976]: reaped child process 2518, status = succeeded lb # [ 483.936868] niks3-server[1454]: 2026/11/12 09:26:25 INFO Received push request method=POST path=/api/pushes worker2 # [ 481.092658] nix-grpc-daemon[1723]: time=2026-11-12T09:26:26.363Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 481.096554] nix-grpc-daemon[1723]: time=2026-11-12T09:26:26.363Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" worker2 # [ 481.113977] nix-grpc-daemon[1723]: time=2026-11-12T09:26:26.386Z level=INFO msg="Uploading 1 narinfos" lb # [ 483.950711] garage[898]: 2026-11-12T09:26:25.710123Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092625Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3503d8b17920d10f125229b71144f639e30ec042dc94848ef391d772771b5d77 lb # [ 483.978194] garage[898]: 2026-11-12T09:26:25.720382Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092625Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4cfcd892cf81619e7c27a8c2e6c7a101ef29b5b0e54cf1c3fece6ac63ea529b4 lb # [ 483.990414] garage[898]: 2026-11-12T09:26:25.722839Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/g774lks418zc45bd9hwhinm61pwcwnr9.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092625Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=de6a7c219f436e8bf58accc8fb702b536219cc96ac28076b945644303d073d81 worker2 # [ 481.148135] nix-grpc-daemon[1723]: time=2026-11-12T09:26:26.421Z level=INFO msg="Upload complete. (247ms)" lb # [ 484.001742] garage[898]: 2026-11-12T09:26:25.725677Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 484.007757] garage[898]: 2026-11-12T09:26:25.729283Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 484.012716] garage[898]: 2026-11-12T09:26:25.729882Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker2 # [ 481.156723] nix-grpc-daemon[1487]: ts=2026-11-12T09:26:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=10 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 481.170071] nix-daemon[976]: reaped child process 2496, status = succeeded lb # [ 484.017918] garage[898]: 2026-11-12T09:26:25.731220Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/g774lks418zc45bd9hwhinm61pwcwnr9.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092625Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9134a67d07053053d91997273da006f6ee60641b3efae63339383bb196171a15 lb # [ 484.028422] niks3-server[1454]: 2026/11/12 09:26:25 INFO Received sign narinfos request method=POST path=/api/pushes/54/sign worker1 # [ 482.730179] nix-grpc-daemon[2296]: ts=2026-11-12T09:26:26Z level=debug event=want client=5 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 lb # [ 484.031354] niks3-server[1454]: 2026/11/12 09:26:25 INFO Signed narinfos id=54 count=1 lb # [ 484.033914] niks3-server[1454]: 2026/11/12 09:26:25 INFO Received complete push request method=POST path=/api/pushes/54/complete worker1 # [ 482.734220] nix-grpc-daemon[2296]: ts=2026-11-12T09:26:26Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 lb # [ 484.037148] niks3-server[1454]: 2026/11/12 09:26:25 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 484.040088] niks3-server[1454]: 2026/11/12 09:26:25 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 484.042800] niks3-server[1454]: 2026/11/12 09:26:25 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 481.188818] nix-grpc-daemon[1487]: ts=2026-11-12T09:26:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 484.045313] niks3-server[1454]: 2026/11/12 09:26:25 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 484.047742] niks3-server[1454]: 2026/11/12 09:26:25 INFO Completed push id=54 objects=8 duration=27.88704ms lb # [ 484.049835] garage[898]: 2026-11-12T09:26:25.735583Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 481.199200] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 481.215492] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 485.118757] garage[898]: 2026-11-12T09:26:26.877248Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 482.653296] nix-daemon[976]: reaped child process 2523, status = succeeded worker2 # [ 482.783492] nix-daemon[976]: accepted connection from pid 2539, user nix-grpc-daemon (trusted) worker2 # [ 482.807251] nix-daemon[976]: reaped child process 2542, status = succeeded lb # [ 485.124069] garage[898]: 2026-11-12T09:26:26.877832Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 485.665111] niks3-server[1454]: 2026/11/12 09:26:27 INFO Received push request method=POST path=/api/pushes worker2 # [ 482.824509] nix-grpc-daemon[1723]: time=2026-11-12T09:26:28.095Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 482.826166] nix-grpc-daemon[1723]: time=2026-11-12T09:26:28.095Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" worker2 # [ 482.847707] nix-grpc-daemon[1723]: time=2026-11-12T09:26:28.120Z level=INFO msg="Uploading 1 narinfos" lb # [ 485.685464] garage[898]: 2026-11-12T09:26:27.444790Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092627Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7628bb7e6a326b4157686c4ce6fd1d63a54e98dc3b2741dfde4629c10b92dd3f lb # [ 485.711706] garage[898]: 2026-11-12T09:26:27.455612Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092627Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=58c88cd4ec9c6d8637c2f8b7c9635736da3983371537ffbb707f7477d8633170 lb # [ 485.725476] garage[898]: 2026-11-12T09:26:27.456565Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092627Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2e62ffb5661425346e7738eed48a73fb08135045425d98e221ff183027764d52 worker2 # [ 482.882074] nix-grpc-daemon[1723]: time=2026-11-12T09:26:28.155Z level=INFO msg="Upload complete. (255ms)" lb # [ 485.735640] garage[898]: 2026-11-12T09:26:27.459335Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 485.741274] garage[898]: 2026-11-12T09:26:27.462205Z INFO garage_api_common::generic_server: 127.0.0.1:48828 (key GK0123456789abcdef01234567) HEAD /farm/bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls worker2 # [ 482.892871] nix-grpc-daemon[1487]: ts=2026-11-12T09:26:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=11 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 485.746148] garage[898]: 2026-11-12T09:26:27.462678Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092627Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d488814c62c2db2793f519a0d5111d56a514bc61391e94af7e008ef5f5cfd8ed worker2 # [ 482.904258] nix-daemon[976]: reaped child process 2521, status = succeeded lb # [ 485.755989] garage[898]: 2026-11-12T09:26:27.464706Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst lb # [ 485.761539] niks3-server[1454]: 2026/11/12 09:26:27 INFO Received sign narinfos request method=POST path=/api/pushes/55/sign lb # [ 485.764368] niks3-server[1454]: 2026/11/12 09:26:27 INFO Signed narinfos id=55 count=1 lb # [ 485.766030] niks3-server[1454]: 2026/11/12 09:26:27 INFO Received complete push request method=POST path=/api/pushes/55/complete lb # [ 485.768373] niks3-server[1454]: 2026/11/12 09:26:27 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 485.770933] niks3-server[1454]: 2026/11/12 09:26:27 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls lb # [ 485.773359] niks3-server[1454]: 2026/11/12 09:26:27 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo lb # [ 485.775614] niks3-server[1454]: 2026/11/12 09:26:27 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst lb # [ 485.778546] niks3-server[1454]: 2026/11/12 09:26:27 INFO Completed push id=55 objects=12 duration=28.7462ms client # [ 484.477593] sshd-session[2228]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 485.780334] garage[898]: 2026-11-12T09:26:27.468465Z INFO garage_api_common::generic_server: 127.0.0.1:50460 (key GK0123456789abcdef01234567) HEAD /farm/bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo client # [ 484.479871] sshd-session[2228]: Disconnected from user root UNKNOWN port 65535 client # [ 484.482984] sshd-session[2206]: pam_unix(sshd:session): session closed for user root client # [ 484.489608] systemd[1]: sshd-vsock@69-70-3:22-2:69.service: Deactivated successfully. client # [ 484.497881] systemd[1]: session-82.scope: Deactivated successfully. client # [ 484.502394] systemd[1]: session-82.scope: Consumed 205ms CPU time over 5.479s wall clock time, 38.3M memory peak, 12.2K incoming IP traffic, 13.6K outgoing IP traffic. client # [ 484.511051] systemd-logind[427]: Session 82 logged out. Waiting for processes to exit. client # [ 484.513226] systemd-logind[427]: Removed session 82. client # [ 484.814145] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 484.828244] systemd[1]: Started SSH per-connection Daemon (vsock:2:70). client # [ 484.921856] sshd-session[2247]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 484.931648] sshd-session[2247]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 484.940458] sshd-session[2247]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 484.949047] systemd-logind[427]: New session '84' of user 'root' with class 'user' and type 'tty'. client # [ 484.960535] systemd[1]: Started Session 84 of User root. lb # [ 486.328390] envoy[897]: conn peer=[2001:db8:1::1]:56940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=6339 tx=4006 ms=5274 client # [ 485.104538] sshd-session[2253]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 485.107033] sshd-session[2253]: Disconnected from user root UNKNOWN port 65535 client # [ 485.109105] sshd-session[2247]: pam_unix(sshd:session): session closed for user root client # [ 485.113304] systemd[1]: sshd-vsock@70-71-3:22-2:70.service: Deactivated successfully. client # [ 485.118140] systemd[1]: session-84.scope: Deactivated successfully. client # [ 485.122431] systemd-logind[427]: Session 84 logged out. Waiting for processes to exit. client # [ 485.125022] systemd-logind[427]: Removed session 84. worker1 # [ 485.464382] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 485.468306] systemd[1]: Started SSH per-connection Daemon (vsock:2:83). worker1 # [ 485.568624] sshd-session[2865]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 485.576252] sshd-session[2865]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 485.587071] sshd-session[2865]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 485.597683] systemd-logind[539]: New session '96' of user 'root' with class 'user' and type 'tty'. worker1 # [ 485.608996] systemd[1]: Started Session 96 of User root. worker1 # [ 485.629108] sshd-session[2871]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 485.630765] sshd-session[2871]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 485.632942] sshd-session[2865]: pam_unix(sshd:session): session closed for user root worker1 # [ 485.637490] systemd[1]: sshd-vsock@83-84-5:22-2:83.service: Deactivated successfully. worker1 # [ 485.643341] systemd[1]: session-96.scope: Deactivated successfully. worker1 # [ 485.648619] systemd-logind[539]: Session 96 logged out. Waiting for processes to exit. worker1 # [ 485.650987] systemd-logind[539]: Removed session 96. [e2e] heartbeat t=390s worker2 # [ 487.059392] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 487.067430] systemd[1]: Started SSH per-connection Daemon (vsock:2:55). worker2 # [ 487.164700] sshd-session[2544]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 487.173060] sshd-session[2544]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 487.184456] sshd-session[2544]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 487.205415] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 487.215085] systemd-logind[515]: New session '68' of user 'root' with class 'user' and type 'tty'. worker2 # [ 487.245212] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 487.251752] systemd[1]: Starting User Manager for UID 0... worker2 # [ 487.277657] (systemd)[2552]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 487.283202] systemd-logind[515]: New session '69' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 487.375417] systemd[2552]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 487.473962] systemd[2552]: Queued start job for default target Main User Target. worker2 # [ 487.481063] systemd[2552]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 487.485375] systemd[2552]: Created slice User Application Slice. worker2 # [ 487.486456] systemd[2552]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 487.487639] systemd[2552]: Reached target Paths. worker2 # [ 487.491205] systemd[2552]: Reached target Timers. worker2 # [ 487.493268] systemd[2552]: Starting D-Bus User Message Bus Socket... worker2 # [ 487.494233] systemd[2552]: Starting Create User Files and Directories... worker2 # [ 487.541237] systemd[2552]: Listening on D-Bus User Message Bus Socket. worker2 # [ 487.544078] systemd[2552]: Finished Create User Files and Directories. worker2 # [ 487.545146] systemd[2552]: Reached target Sockets. worker2 # [ 487.545888] systemd[2552]: Reached target Basic System. worker2 # [ 487.546661] systemd[2552]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 487.551275] systemd[2552]: Reached target Main User Target. worker2 # [ 487.555156] systemd[2552]: Startup finished in 244ms. worker2 # [ 487.556996] systemd[1]: Started User Manager for UID 0. worker2 # [ 487.557809] systemd[1]: Started Session 68 of User root. worker2 # [ 487.572882] sshd-session[2565]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 487.574361] sshd-session[2565]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 487.576400] sshd-session[2544]: pam_unix(sshd:session): session closed for user root worker2 # [ 487.580141] systemd[1]: sshd-vsock@55-56-6:22-2:55.service: Deactivated successfully. worker2 # [ 487.585662] systemd[1]: session-68.scope: Deactivated successfully. worker2 # [ 487.589869] systemd-logind[515]: Session 68 logged out. Waiting for processes to exit. worker2 # [ 487.592446] systemd-logind[515]: Removed session 68. worker1 # [ 491.227851] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 491.235559] systemd[1]: Started SSH per-connection Daemon (vsock:2:84). worker1 # [ 491.349957] sshd-session[2876]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 491.360737] sshd-session[2876]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 491.370338] sshd-session[2876]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 491.382734] systemd-logind[539]: New session '97' of user 'root' with class 'user' and type 'tty'. worker1 # [ 491.388701] systemd[1]: Started Session 97 of User root. worker1 # [ 491.560951] sshd-session[2882]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 491.562744] sshd-session[2882]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 491.565141] sshd-session[2876]: pam_unix(sshd:session): session closed for user root worker1 # [ 491.569709] systemd[1]: sshd-vsock@84-85-5:22-2:84.service: Deactivated successfully. worker1 # [ 491.575166] systemd[1]: session-97.scope: Deactivated successfully. worker1 # [ 491.579695] systemd-logind[539]: Session 97 logged out. Waiting for processes to exit. worker1 # [ 491.583304] systemd-logind[539]: Removed session 97. worker1 # [ 491.991282] nix-grpc-daemon[2296]: ts=2026-11-12T09:26:35Z level=info event=healthy reason=min_free worker1 # [ 492.885241] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 492.893653] systemd[1]: Started SSH per-connection Daemon (vsock:2:85). worker1 # [ 492.996958] sshd-session[2887]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 493.007910] sshd-session[2887]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 493.016298] sshd-session[2887]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 493.027636] systemd-logind[539]: New session '98' of user 'root' with class 'user' and type 'tty'. worker1 # [ 493.032600] systemd[1]: Started Session 98 of User root. worker1 # [ 493.063023] sshd-session[2893]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 493.066670] sshd-session[2893]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 493.067754] sshd-session[2887]: pam_unix(sshd:session): session closed for user root worker1 # [ 493.071721] systemd[1]: sshd-vsock@85-86-5:22-2:85.service: Deactivated successfully. ok test farm::serial::one_node_schedules_and_both_builders_hold_a_worker_session ... worker1 # [ 493.077974] systemd[1]: session-98.scope: Deactivated successfully. worker1 # [ 493.082530] systemd-logind[539]: Session 98 logged out. Waiting for processes to exit. worker1 # [ 493.086203] systemd-logind[539]: Removed session 98. worker1 # [ 493.750741] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 493.758660] systemd[1]: Started SSH per-connection Daemon (vsock:2:86). worker1 # [ 493.859520] sshd-session[2898]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 493.868303] sshd-session[2898]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 493.878339] sshd-session[2898]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 493.886859] systemd-logind[539]: New session '99' of user 'root' with class 'user' and type 'tty'. worker1 # [ 493.893007] systemd[1]: Started Session 99 of User root. worker1 # [ 493.926137] sshd-session[2904]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 493.927648] sshd-session[2904]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 493.929409] sshd-session[2898]: pam_unix(sshd:session): session closed for user root worker1 # [ 493.933872] systemd[1]: sshd-vsock@86-87-5:22-2:86.service: Deactivated successfully. worker1 # [ 493.940226] systemd[1]: session-99.scope: Deactivated successfully. worker1 # [ 493.944648] systemd-logind[539]: Session 99 logged out. Waiting for processes to exit. worker1 # [ 493.947856] systemd-logind[539]: Removed session 99. client # [ 495.145378] systemd[1]: Stopping User Manager for UID 0... client # [ 495.151554] systemd[2215]: Activating special unit Exit the Session... client # [ 495.157948] systemd[2215]: Stopped target Main User Target. client # [ 495.159358] systemd[2215]: Stopped target Basic System. client # [ 495.163487] systemd[2215]: Stopped target Paths. client # [ 495.166058] systemd[2215]: Stopped target Sockets. client # [ 495.167197] systemd[2215]: Stopped target Timers. client # [ 495.168459] systemd[2215]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 495.170104] systemd[2215]: Closed D-Bus User Message Bus Socket. client # [ 495.171458] systemd[2215]: Stopped Create User Files and Directories. client # [ 495.173131] systemd[2215]: Removed slice User Application Slice. client # [ 495.174490] systemd[2215]: Reached target Shutdown. client # [ 495.175628] systemd[2215]: Finished Exit the Session. client # [ 495.177016] systemd[2215]: Reached target Exit the Session. client # [ 495.190042] systemd-logind[427]: Removed session 83. client # [ 495.197658] systemd[1]: user@0.service: Deactivated successfully. client # [ 495.203161] systemd[1]: Stopped User Manager for UID 0. client # [ 495.263719] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 495.297828] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 495.302016] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 495.307951] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 494.883248] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 494.893188] systemd[1]: Started SSH per-connection Daemon (vsock:2:56). worker2 # [ 494.986508] sshd-session[2570]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 494.994272] sshd-session[2570]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 495.005393] sshd-session[2570]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 495.014948] systemd-logind[515]: New session '70' of user 'root' with class 'user' and type 'tty'. worker2 # [ 495.020587] systemd[1]: Started Session 70 of User root. worker2 # [ 495.057813] sshd-session[2576]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 495.059312] sshd-session[2576]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 495.061019] sshd-session[2570]: pam_unix(sshd:session): session closed for user root worker2 # [ 495.065325] systemd[1]: sshd-vsock@56-57-6:22-2:56.service: Deactivated successfully. worker2 # [ 495.070740] systemd[1]: session-70.scope: Deactivated successfully. worker2 # [ 495.075287] systemd-logind[515]: Session 70 logged out. Waiting for processes to exit. worker2 # [ 495.077957] systemd-logind[515]: Removed session 70. lb # [ 501.301951] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 501.311621] systemd[1]: Started SSH per-connection Daemon (vsock:2:41). lb # [ 501.409414] sshd-session[1919]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 501.417681] sshd-session[1919]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 501.428163] sshd-session[1919]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 501.456518] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 501.493057] systemd-logind[499]: New session '56' of user 'root' with class 'user' and type 'tty'. lb # [ 501.503293] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 501.510692] systemd[1]: Starting User Manager for UID 0... lb # [ 501.537698] (systemd)[1928]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 501.543910] systemd-logind[499]: New session '57' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 501.634461] systemd[1928]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 501.733024] systemd[1928]: Queued start job for default target Main User Target. lb # [ 501.741045] systemd[1928]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 501.745300] systemd[1928]: Created slice User Application Slice. lb # [ 501.746345] systemd[1928]: Started Daily Cleanup of User's Temporary Directories. lb # [ 501.747418] systemd[1928]: Reached target Paths. lb # [ 501.750722] systemd[1928]: Reached target Timers. lb # [ 501.751523] systemd[1928]: Starting D-Bus User Message Bus Socket... lb # [ 501.756289] systemd[1928]: Starting Create User Files and Directories... lb # [ 501.797839] systemd[1928]: Listening on D-Bus User Message Bus Socket. lb # [ 501.798972] systemd[1928]: Reached target Sockets. lb # [ 501.801111] systemd[1928]: Finished Create User Files and Directories. lb # [ 501.802106] systemd[1928]: Reached target Basic System. lb # [ 501.802905] systemd[1928]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 501.808404] systemd[1928]: Reached target Main User Target. lb # [ 501.809358] systemd[1928]: Startup finished in 242ms. lb # [ 501.810103] systemd[1]: Started User Manager for UID 0. lb # [ 501.815804] systemd[1]: Started Session 56 of User root. lb # [ 501.851133] sshd-session[1941]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 501.852964] sshd-session[1941]: Disconnected from user root UNKNOWN port 65535 lb # [ 501.854301] sshd-session[1919]: pam_unix(sshd:session): session closed for user root lb # [ 501.858794] systemd[1]: sshd-vsock@41-42-4:22-2:41.service: Deactivated successfully. lb # [ 501.863758] systemd[1]: session-56.scope: Deactivated successfully. lb # [ 501.865550] systemd[1]: session-56.scope: Consumed 29ms CPU time over 52ms wall clock time, 4.6M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 501.870556] systemd-logind[499]: Session 56 logged out. Waiting for processes to exit. lb # [ 501.873123] systemd-logind[499]: Removed session 56. worker1 # [ 504.041550] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 504.047457] systemd[2663]: Activating special unit Exit the Session... worker1 # [ 504.052836] systemd[2663]: Stopped target Main User Target. worker1 # [ 504.054344] systemd[2663]: Stopped target Basic System. worker1 # [ 504.055605] systemd[2663]: Stopped target Paths. worker1 # [ 504.062667] systemd[2663]: Stopped target Sockets. worker1 # [ 504.064322] systemd[2663]: Stopped target Timers. worker1 # [ 504.065690] systemd[2663]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 504.067457] systemd[2663]: Closed D-Bus User Message Bus Socket. worker1 # [ 504.069105] systemd[2663]: Stopped Create User Files and Directories. worker1 # [ 504.070836] systemd[2663]: Removed slice User Application Slice. worker1 # [ 504.072662] systemd[2663]: Reached target Shutdown. worker1 # [ 504.073962] systemd[2663]: Finished Exit the Session. worker1 # [ 504.075229] systemd[2663]: Reached target Exit the Session. worker1 # [ 504.099476] systemd-logind[539]: Removed session 82. worker1 # [ 504.106202] (sd-pam)[2665]: pam_unix(systemd-user:session): session closed for user root worker1 # [ 504.112510] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 504.116869] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 504.134022] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 504.173988] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 504.179436] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 504.184696] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 505.084937] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 505.092830] systemd[2552]: Activating special unit Exit the Session... worker2 # [ 505.099465] systemd[2552]: Stopped target Main User Target. worker2 # [ 505.103831] systemd[2552]: Stopped target Basic System. worker2 # [ 505.106061] systemd[2552]: Stopped target Paths. worker2 # [ 505.107276] systemd[2552]: Stopped target Sockets. worker2 # [ 505.108736] systemd[2552]: Stopped target Timers. worker2 # [ 505.109906] systemd[2552]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 505.111743] systemd[2552]: Closed D-Bus User Message Bus Socket. worker2 # [ 505.113359] systemd[2552]: Stopped Create User Files and Directories. worker2 # [ 505.114939] systemd[2552]: Removed slice User Application Slice. worker2 # [ 505.117751] systemd[2552]: Reached target Shutdown. worker2 # [ 505.119030] systemd[2552]: Finished Exit the Session. worker2 # [ 505.120421] systemd[2552]: Reached target Exit the Session. worker2 # [ 505.140608] systemd-logind[515]: Removed session 69. worker2 # [ 505.150290] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 505.155653] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 505.171121] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 505.214848] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 505.220780] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 505.224450] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 506.909264] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 506.917771] systemd[1]: Started SSH per-connection Daemon (vsock:2:87). worker1 # [ 507.019273] sshd-session[2914]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 507.029504] sshd-session[2914]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 507.041386] sshd-session[2914]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 507.058070] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 507.071078] systemd-logind[539]: New session '100' of user 'root' with class 'user' and type 'tty'. worker1 # [ 507.103821] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 507.113733] systemd[1]: Starting User Manager for UID 0... worker1 # [ 507.144991] (systemd)[2922]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 507.151272] systemd-logind[539]: New session '101' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 507.247657] systemd[2922]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 507.348468] systemd[2922]: Queued start job for default target Main User Target. worker1 # [ 507.357048] systemd[2922]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 507.360168] systemd[2922]: Created slice User Application Slice. worker1 # [ 507.362649] systemd[2922]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 507.363813] systemd[2922]: Reached target Paths. worker1 # [ 507.366393] systemd[2922]: Reached target Timers. worker1 # [ 507.367165] systemd[2922]: Starting D-Bus User Message Bus Socket... worker1 # [ 507.370014] systemd[2922]: Starting Create User Files and Directories... worker1 # [ 507.416196] systemd[2922]: Finished Create User Files and Directories. worker1 # [ 507.420703] systemd[2922]: Listening on D-Bus User Message Bus Socket. worker1 # [ 507.423140] systemd[2922]: Reached target Sockets. worker1 # [ 507.423961] systemd[2922]: Reached target Basic System. worker1 # [ 507.427682] systemd[2922]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 507.429611] systemd[2922]: Reached target Main User Target. worker1 # [ 507.430463] systemd[2922]: Startup finished in 252ms. worker1 # [ 507.431226] systemd[1]: Started User Manager for UID 0. worker1 # [ 507.433465] systemd[1]: Started Session 100 of User root. worker1 # [ 507.466993] sshd-session[2935]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 507.469949] sshd-session[2935]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 507.471817] sshd-session[2914]: pam_unix(sshd:session): session closed for user root worker1 # [ 507.476805] systemd[1]: sshd-vsock@87-88-5:22-2:87.service: Deactivated successfully. worker1 # [ 507.481962] systemd[1]: session-100.scope: Deactivated successfully. worker1 # [ 507.483659] systemd[1]: session-100.scope: Consumed 27ms CPU time over 50ms wall clock time, 3.1M memory peak, 19.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 507.490215] systemd-logind[539]: Session 100 logged out. Waiting for processes to exit. worker1 # [ 507.491433] systemd-logind[539]: Removed session 100. lb # [ 509.706865] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 509.716145] systemd[1]: Started SSH per-connection Daemon (vsock:2:42). lb # [ 509.810185] sshd-session[1950]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 509.820363] sshd-session[1950]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 509.828781] sshd-session[1950]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 509.839997] systemd-logind[499]: New session '58' of user 'root' with class 'user' and type 'tty'. lb # [ 509.845634] systemd[1]: Started Session 58 of User root. lb # [ 509.880701] sshd-session[1956]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 509.883029] sshd-session[1956]: Disconnected from user root UNKNOWN port 65535 lb # [ 509.885204] sshd-session[1950]: pam_unix(sshd:session): session closed for user root lb # [ 509.889336] systemd[1]: sshd-vsock@42-43-4:22-2:42.service: Deactivated successfully. lb # [ 509.894349] systemd[1]: session-58.scope: Deactivated successfully. lb # [ 509.897748] systemd[1]: session-58.scope: Consumed 28ms CPU time over 50ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 509.902364] systemd-logind[499]: Session 58 logged out. Waiting for processes to exit. lb # [ 509.903663] systemd-logind[499]: Removed session 58. worker1 # [ 509.985745] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 509.993851] systemd[1]: Started SSH per-connection Daemon (vsock:2:88). worker1 # [ 510.091088] sshd-session[2940]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 510.098840] sshd-session[2940]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 510.109956] sshd-session[2940]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 510.119485] systemd-logind[539]: New session '102' of user 'root' with class 'user' and type 'tty'. worker1 # [ 510.127200] systemd[1]: Started Session 102 of User root. worker1 # [ 510.153568] sshd-session[2946]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 510.156326] sshd-session[2946]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 510.158792] sshd-session[2940]: pam_unix(sshd:session): session closed for user root worker1 # [ 510.162908] systemd[1]: sshd-vsock@88-89-5:22-2:88.service: Deactivated successfully. worker1 # [ 510.168448] systemd[1]: session-102.scope: Deactivated successfully. worker1 # [ 510.172995] systemd-logind[539]: Session 102 logged out. Waiting for processes to exit. worker1 # [ 510.175217] systemd-logind[539]: Removed session 102. worker1 # [ 513.576585] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 513.584889] systemd[1]: Started SSH per-connection Daemon (vsock:2:89). worker1 # [ 513.682196] sshd-session[2951]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 513.692661] sshd-session[2951]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 513.701990] sshd-session[2951]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 513.712682] systemd-logind[539]: New session '103' of user 'root' with class 'user' and type 'tty'. worker1 # [ 513.721898] systemd[1]: Started Session 103 of User root. worker1 # [ 513.757957] sshd-session[2957]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 513.760783] sshd-session[2957]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 513.762356] sshd-session[2951]: pam_unix(sshd:session): session closed for user root worker1 # [ 513.767001] systemd[1]: sshd-vsock@89-90-5:22-2:89.service: Deactivated successfully. worker1 # [ 513.772637] systemd[1]: session-103.scope: Deactivated successfully. worker1 # [ 513.774394] systemd[1]: session-103.scope: Consumed 29ms CPU time over 53ms wall clock time, 4.8M memory peak, 19.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 513.781016] systemd-logind[539]: Session 103 logged out. Waiting for processes to exit. worker1 # [ 513.782261] systemd-logind[539]: Removed session 103. lb # [ 517.363548] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 517.372124] systemd[1]: Started SSH per-connection Daemon (vsock:2:43). lb # [ 517.487497] sshd-session[1961]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 517.501803] sshd-session[1961]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 517.513115] sshd-session[1961]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 517.521154] systemd-logind[499]: New session '59' of user 'root' with class 'user' and type 'tty'. lb # [ 517.532519] systemd[1]: Started Session 59 of User root. lb # [ 517.567548] sshd-session[1972]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 517.569466] sshd-session[1972]: Disconnected from user root UNKNOWN port 65535 lb # [ 517.570798] sshd-session[1961]: pam_unix(sshd:session): session closed for user root lb # [ 517.574905] systemd[1]: sshd-vsock@43-44-4:22-2:43.service: Deactivated successfully. lb # [ 517.580676] systemd[1]: session-59.scope: Deactivated successfully. lb # [ 517.582201] systemd[1]: session-59.scope: Consumed 26ms CPU time over 47ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 517.588404] systemd-logind[499]: Session 59 logged out. Waiting for processes to exit. lb # [ 517.589733] systemd-logind[499]: Removed session 59. worker2 # [ 515.114934] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 515.125017] systemd[1]: Started SSH per-connection Daemon (vsock:2:57). worker2 # [ 515.230353] sshd-session[2586]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 515.238398] sshd-session[2586]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 515.248557] sshd-session[2586]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 515.268890] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 515.279575] systemd-logind[515]: New session '71' of user 'root' with class 'user' and type 'tty'. worker2 # [ 515.310126] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 515.321289] systemd[1]: Starting User Manager for UID 0... worker2 # [ 515.346873] (systemd)[2594]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 515.354142] systemd-logind[515]: New session '72' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 515.449589] systemd[2594]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 515.551936] systemd[2594]: Queued start job for default target Main User Target. worker2 # [ 515.557209] systemd[2594]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 515.561599] systemd[2594]: Created slice User Application Slice. worker2 # [ 515.562694] systemd[2594]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 515.563817] systemd[2594]: Reached target Paths. worker2 # [ 515.564954] systemd[2594]: Reached target Timers. worker2 # [ 515.567674] systemd[2594]: Starting D-Bus User Message Bus Socket... worker2 # [ 515.570405] systemd[2594]: Starting Create User Files and Directories... worker2 # [ 515.613713] systemd[2594]: Finished Create User Files and Directories. worker2 # [ 515.620136] systemd[2594]: Listening on D-Bus User Message Bus Socket. worker2 # [ 515.621265] systemd[2594]: Reached target Sockets. worker2 # [ 515.622033] systemd[2594]: Reached target Basic System. worker2 # [ 515.622836] systemd[2594]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 515.628297] systemd[2594]: Reached target Main User Target. worker2 # [ 515.629243] systemd[2594]: Startup finished in 249ms. worker2 # [ 515.629967] systemd[1]: Started User Manager for UID 0. worker2 # [ 515.635320] systemd[1]: Started Session 71 of User root. worker2 # [ 515.667126] sshd-session[2607]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 515.669018] sshd-session[2607]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 515.670400] sshd-session[2586]: pam_unix(sshd:session): session closed for user root worker2 # [ 515.674515] systemd[1]: sshd-vsock@57-58-6:22-2:57.service: Deactivated successfully. worker2 # [ 515.680497] systemd[1]: session-71.scope: Deactivated successfully. worker2 # [ 515.682425] systemd[1]: session-71.scope: Consumed 26ms CPU time over 49ms wall clock time, 3.1M memory peak, 13.1K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 515.687738] systemd-logind[515]: Session 71 logged out. Waiting for processes to exit. worker2 # [ 515.690559] systemd-logind[515]: Removed session 71. [e2e] heartbeat t=420s worker1 # [ 518.986453] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 518.994837] systemd[1]: Started SSH per-connection Daemon (vsock:2:90). worker1 # [ 519.094562] sshd-session[2962]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 519.104306] sshd-session[2962]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 519.115209] sshd-session[2962]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 519.125428] systemd-logind[539]: New session '104' of user 'root' with class 'user' and type 'tty'. worker1 # [ 519.132653] systemd[1]: Started Session 104 of User root. worker1 # [ 519.170828] sshd-session[2968]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 519.173697] sshd-session[2968]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 519.175094] sshd-session[2962]: pam_unix(sshd:session): session closed for user root worker1 # [ 519.179964] systemd[1]: sshd-vsock@90-91-5:22-2:90.service: Deactivated successfully. worker1 # [ 519.185787] systemd[1]: session-104.scope: Deactivated successfully. worker1 # [ 519.187893] systemd[1]: session-104.scope: Consumed 29ms CPU time over 54ms wall clock time, 3.1M memory peak, 19.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 519.193637] systemd-logind[539]: Session 104 logged out. Waiting for processes to exit. worker1 # [ 519.195607] systemd-logind[539]: Removed session 104. worker1 # [ 523.236605] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 523.246209] systemd[1]: Started SSH per-connection Daemon (vsock:2:91). worker1 # [ 523.346035] sshd-session[2973]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 523.356641] sshd-session[2973]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 523.366397] sshd-session[2973]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 523.378609] systemd-logind[539]: New session '105' of user 'root' with class 'user' and type 'tty'. worker1 # [ 523.385730] systemd[1]: Started Session 105 of User root. worker1 # [ 523.423567] sshd-session[2979]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 523.425560] sshd-session[2979]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 523.427433] sshd-session[2973]: pam_unix(sshd:session): session closed for user root worker1 # [ 523.431972] systemd[1]: sshd-vsock@91-92-5:22-2:91.service: Deactivated successfully. worker1 # [ 523.437537] systemd[1]: session-105.scope: Deactivated successfully. worker1 # [ 523.439385] systemd[1]: session-105.scope: Consumed 30ms CPU time over 54ms wall clock time, 5.1M memory peak, 19.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 523.446116] systemd-logind[539]: Session 105 logged out. Waiting for processes to exit. worker1 # [ 523.447316] systemd-logind[539]: Removed session 105. lb # [ 527.806950] systemd[1]: Stopping User Manager for UID 0... lb # [ 527.814200] systemd[1928]: Activating special unit Exit the Session... lb # [ 527.820187] systemd[1928]: Stopped target Main User Target. lb # [ 527.821718] systemd[1928]: Stopped target Basic System. lb # [ 527.823004] systemd[1928]: Stopped target Paths. lb # [ 527.827524] systemd[1928]: Stopped target Sockets. lb # [ 527.829078] systemd[1928]: Stopped target Timers. lb # [ 527.830188] systemd[1928]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 527.831832] systemd[1928]: Closed D-Bus User Message Bus Socket. lb # [ 527.834485] systemd[1928]: Stopped Create User Files and Directories. lb # [ 527.835984] systemd[1928]: Removed slice User Application Slice. lb # [ 527.837706] systemd[1928]: Reached target Shutdown. lb # [ 527.838859] systemd[1928]: Finished Exit the Session. lb # [ 527.840105] systemd[1928]: Reached target Exit the Session. lb # [ 527.859461] systemd-logind[499]: Removed session 57. lb # [ 527.865788] systemd[1]: user@0.service: Deactivated successfully. lb # [ 527.868931] systemd[1]: Stopped User Manager for UID 0. lb # [ 527.939349] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 527.973850] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 527.978788] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 527.984722] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 525.833905] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 525.841658] systemd[2594]: Activating special unit Exit the Session... worker2 # [ 525.846878] systemd[2594]: Stopped target Main User Target. worker2 # [ 525.852962] systemd[2594]: Stopped target Basic System. worker2 # [ 525.854297] systemd[2594]: Stopped target Paths. worker2 # [ 525.855395] systemd[2594]: Stopped target Sockets. worker2 # [ 525.856960] systemd[2594]: Stopped target Timers. worker2 # [ 525.858075] systemd[2594]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 525.859756] systemd[2594]: Closed D-Bus User Message Bus Socket. worker2 # [ 525.861294] systemd[2594]: Stopped Create User Files and Directories. worker2 # [ 525.862703] systemd[2594]: Removed slice User Application Slice. worker2 # [ 525.864320] systemd[2594]: Reached target Shutdown. worker2 # [ 525.865570] systemd[2594]: Finished Exit the Session. worker2 # [ 525.866816] systemd[2594]: Reached target Exit the Session. worker2 # [ 525.879757] systemd-logind[515]: Removed session 72. worker2 # [ 525.886790] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 525.889921] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 525.910961] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 525.953396] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 525.957474] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 525.963398] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 528.538903] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 528.546733] systemd[1]: Started SSH per-connection Daemon (vsock:2:92). worker1 # [ 528.641211] sshd-session[2984]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 528.651853] sshd-session[2984]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 528.661438] sshd-session[2984]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 528.671146] systemd-logind[539]: New session '106' of user 'root' with class 'user' and type 'tty'. worker1 # [ 528.676555] systemd[1]: Started Session 106 of User root. worker1 # [ 528.713945] sshd-session[2990]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 528.716598] sshd-session[2990]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 528.718027] sshd-session[2984]: pam_unix(sshd:session): session closed for user root worker1 # [ 528.722522] systemd[1]: sshd-vsock@92-93-5:22-2:92.service: Deactivated successfully. worker1 # [ 528.727447] systemd[1]: session-106.scope: Deactivated successfully. ok test farm::serial::queue_gauges_show_a_burst_while_every_build_blocks ... worker1 # [ 528.729373] systemd[1]: session-106.scope: Consumed 29ms CPU time over 52ms wall clock time, 4.8M memory peak, 19.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 528.734531] systemd-logind[539]: Session 106 logged out. Waiting for processes to exit. worker1 # [ 528.736848] systemd-logind[539]: Removed session 106. worker1 # [ 529.294772] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 529.304844] systemd[1]: Started SSH per-connection Daemon (vsock:2:93). worker1 # [ 529.401758] sshd-session[2995]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 529.410436] sshd-session[2995]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 529.421333] sshd-session[2995]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 529.430616] systemd-logind[539]: New session '107' of user 'root' with class 'user' and type 'tty'. worker1 # [ 529.440836] systemd[1]: Started Session 107 of User root. worker1 # [ 529.475568] sshd-session[3001]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 529.478732] sshd-session[3001]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 529.480350] sshd-session[2995]: pam_unix(sshd:session): session closed for user root worker1 # [ 529.484709] systemd[1]: sshd-vsock@93-94-5:22-2:93.service: Deactivated successfully. worker1 # [ 529.490617] systemd[1]: session-107.scope: Deactivated successfully. worker1 # [ 529.495014] systemd-logind[539]: Session 107 logged out. Waiting for processes to exit. worker1 # [ 529.498206] systemd-logind[539]: Removed session 107. worker2 # [ 532.853690] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 532.862112] systemd[1]: Started SSH per-connection Daemon (vsock:2:58). worker2 # [ 532.961228] sshd-session[2616]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 532.970819] sshd-session[2616]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 532.980306] sshd-session[2616]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 533.002097] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 533.012879] systemd-logind[515]: New session '73' of user 'root' with class 'user' and type 'tty'. worker2 # [ 533.045631] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 533.051865] systemd[1]: Starting User Manager for UID 0... worker2 # [ 533.082366] (systemd)[2624]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 533.089115] systemd-logind[515]: New session '74' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 533.179397] systemd[2624]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 533.283750] systemd[2624]: Queued start job for default target Main User Target. worker2 # [ 533.293181] systemd[2624]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 533.298019] systemd[2624]: Created slice User Application Slice. worker2 # [ 533.299195] systemd[2624]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 533.302780] systemd[2624]: Reached target Paths. worker2 # [ 533.303768] systemd[2624]: Reached target Timers. worker2 # [ 533.307204] systemd[2624]: Starting D-Bus User Message Bus Socket... worker2 # [ 533.312350] systemd[2624]: Starting Create User Files and Directories... worker2 # [ 533.354145] systemd[2624]: Finished Create User Files and Directories. worker2 # [ 533.359178] systemd[2624]: Listening on D-Bus User Message Bus Socket. worker2 # [ 533.364589] systemd[2624]: Reached target Sockets. worker2 # [ 533.365530] systemd[2624]: Reached target Basic System. worker2 # [ 533.366406] systemd[2624]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 533.368754] systemd[2624]: Reached target Main User Target. worker2 # [ 533.369742] systemd[2624]: Startup finished in 256ms. worker2 # [ 533.370624] systemd[1]: Started User Manager for UID 0. worker2 # [ 533.374989] systemd[1]: Started Session 73 of User root. worker2 # [ 533.404881] sshd-session[2637]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 533.407459] sshd-session[2637]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 533.409005] sshd-session[2616]: pam_unix(sshd:session): session closed for user root worker2 # [ 533.413156] systemd[1]: sshd-vsock@58-59-6:22-2:58.service: Deactivated successfully. worker2 # [ 533.418690] systemd[1]: session-73.scope: Deactivated successfully. worker2 # [ 533.423184] systemd-logind[515]: Session 73 logged out. Waiting for processes to exit. worker2 # [ 533.426125] systemd-logind[515]: Removed session 73. lb # [ 536.563023] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 536.571219] systemd[1]: Started SSH per-connection Daemon (vsock:2:44). lb # [ 536.671290] sshd-session[1984]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 536.680592] sshd-session[1984]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 536.691492] sshd-session[1984]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 536.720537] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 536.755657] systemd-logind[499]: New session '60' of user 'root' with class 'user' and type 'tty'. lb # [ 536.769058] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 536.774797] systemd[1]: Starting User Manager for UID 0... lb # [ 536.803493] (systemd)[1993]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 536.810454] systemd-logind[499]: New session '61' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 536.906280] systemd[1993]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 537.004859] systemd[1993]: Queued start job for default target Main User Target. lb # [ 537.009060] systemd[1993]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 537.012621] systemd[1993]: Created slice User Application Slice. lb # [ 537.013668] systemd[1993]: Started Daily Cleanup of User's Temporary Directories. lb # [ 537.014737] systemd[1993]: Reached target Paths. lb # [ 537.015487] systemd[1993]: Reached target Timers. lb # [ 537.019982] systemd[1993]: Starting D-Bus User Message Bus Socket... lb # [ 537.022443] systemd[1993]: Starting Create User Files and Directories... lb # [ 537.074806] systemd[1993]: Listening on D-Bus User Message Bus Socket. lb # [ 537.077885] systemd[1993]: Finished Create User Files and Directories. lb # [ 537.079014] systemd[1993]: Reached target Sockets. lb # [ 537.083558] systemd[1993]: Reached target Basic System. lb # [ 537.084974] systemd[1993]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 537.086485] systemd[1993]: Reached target Main User Target. lb # [ 537.087339] systemd[1993]: Startup finished in 253ms. lb # [ 537.091462] systemd[1]: Started User Manager for UID 0. lb # [ 537.093632] systemd[1]: Started Session 60 of User root. lb # [ 537.130348] sshd-session[2006]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 537.133226] sshd-session[2006]: Disconnected from user root UNKNOWN port 65535 lb # [ 537.135217] sshd-session[1984]: pam_unix(sshd:session): session closed for user root lb # [ 537.139108] systemd[1]: sshd-vsock@44-45-4:22-2:44.service: Deactivated successfully. lb # [ 537.145394] systemd[1]: session-60.scope: Deactivated successfully. lb # [ 537.149358] systemd[1]: session-60.scope: Consumed 30ms CPU time over 58ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 537.153990] systemd-logind[499]: Session 60 logged out. Waiting for processes to exit. lb # [ 537.155291] systemd-logind[499]: Removed session 60. worker1 # [ 538.400901] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 538.410207] systemd[1]: Started SSH per-connection Daemon (vsock:2:94). worker1 # [ 538.509940] sshd-session[3007]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 538.518542] sshd-session[3007]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 538.529845] sshd-session[3007]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 538.539615] systemd-logind[539]: New session '108' of user 'root' with class 'user' and type 'tty'. worker1 # [ 538.546509] systemd[1]: Started Session 108 of User root. worker1 # [ 538.580911] sshd-session[3013]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 538.583656] sshd-session[3013]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 538.585786] sshd-session[3007]: pam_unix(sshd:session): session closed for user root worker1 # [ 538.589529] systemd[1]: sshd-vsock@94-95-5:22-2:94.service: Deactivated successfully. worker1 # [ 538.594757] systemd[1]: session-108.scope: Deactivated successfully. worker1 # [ 538.596548] systemd[1]: session-108.scope: Consumed 28ms CPU time over 51ms wall clock time, 4.8M memory peak, 19.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 538.601935] systemd-logind[539]: Session 108 logged out. Waiting for processes to exit. worker1 # [ 538.604208] systemd-logind[539]: Removed session 108. worker2 # [ 543.584675] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 543.591099] systemd[2624]: Activating special unit Exit the Session... worker2 # [ 543.597441] systemd[2624]: Stopped target Main User Target. worker2 # [ 543.598884] systemd[2624]: Stopped target Basic System. worker2 # [ 543.603090] systemd[2624]: Stopped target Paths. worker2 # [ 543.604885] systemd[2624]: Stopped target Sockets. worker2 # [ 543.606112] systemd[2624]: Stopped target Timers. worker2 # [ 543.607302] systemd[2624]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 543.609318] systemd[2624]: Closed D-Bus User Message Bus Socket. worker2 # [ 543.610730] systemd[2624]: Stopped Create User Files and Directories. worker2 # [ 543.612303] systemd[2624]: Removed slice User Application Slice. worker2 # [ 543.613686] systemd[2624]: Reached target Shutdown. worker2 # [ 543.614874] systemd[2624]: Finished Exit the Session. worker2 # [ 543.617091] systemd[2624]: Reached target Exit the Session. worker2 # [ 543.642160] systemd-logind[515]: Removed session 74. worker2 # [ 543.649555] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 543.654629] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 543.670414] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 543.709098] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 543.712817] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 543.718300] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 546.568706] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 546.576433] systemd[1]: Started SSH per-connection Daemon (vsock:2:45). lb # [ 546.669990] sshd-session[2014]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 546.679554] sshd-session[2014]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 546.688332] sshd-session[2014]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 546.698537] systemd-logind[499]: New session '62' of user 'root' with class 'user' and type 'tty'. lb # [ 546.705425] systemd[1]: Started Session 62 of User root. lb # [ 546.739997] sshd-session[2020]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 546.742488] sshd-session[2020]: Disconnected from user root UNKNOWN port 65535 lb # [ 546.744551] sshd-session[2014]: pam_unix(sshd:session): session closed for user root lb # [ 546.748820] systemd[1]: sshd-vsock@45-46-4:22-2:45.service: Deactivated successfully. lb # [ 546.753611] systemd[1]: session-62.scope: Deactivated successfully. lb # [ 546.757284] systemd[1]: session-62.scope: Consumed 27ms CPU time over 50ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 546.761363] systemd-logind[499]: Session 62 logged out. Waiting for processes to exit. lb # [ 546.762637] systemd-logind[499]: Removed session 62. worker1 # [ 546.372888] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 546.381019] systemd[1]: Started SSH per-connection Daemon (vsock:2:95). worker1 # [ 546.479069] sshd-session[3018]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 546.486401] sshd-session[3018]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 546.496163] sshd-session[3018]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 546.505538] systemd-logind[539]: New session '109' of user 'root' with class 'user' and type 'tty'. worker1 # [ 546.513109] systemd[1]: Started Session 109 of User root. worker1 # [ 546.557546] sshd-session[3024]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 546.560562] sshd-session[3024]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 546.562149] sshd-session[3018]: pam_unix(sshd:session): session closed for user root worker1 # [ 546.567184] systemd[1]: sshd-vsock@95-96-5:22-2:95.service: Deactivated successfully. worker1 # [ 546.572871] systemd[1]: session-109.scope: Deactivated successfully. worker1 # [ 546.576887] systemd[1]: session-109.scope: Consumed 29ms CPU time over 61ms wall clock time, 3.1M memory peak, 19.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 546.581714] systemd-logind[539]: Session 109 logged out. Waiting for processes to exit. worker1 # [ 546.582971] systemd-logind[539]: Removed session 109. client # [ 547.050591] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 547.059163] systemd[1]: Started SSH per-connection Daemon (vsock:2:71). client # [ 547.153184] sshd-session[2265]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 547.163265] sshd-session[2265]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 547.172240] sshd-session[2265]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 547.192234] systemd-logind[427]: New session '85' of user 'root' with class 'user' and type 'tty'. client # [ 547.204461] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 547.243093] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 547.250167] systemd[1]: Starting User Manager for UID 0... client # [ 547.278491] (systemd)[2274]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 547.285408] systemd-logind[427]: New session '86' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 547.372266] systemd[2274]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 547.472181] systemd[2274]: Queued start job for default target Main User Target. client # [ 547.481269] systemd[2274]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 547.485508] systemd[2274]: Created slice User Application Slice. client # [ 547.486551] systemd[2274]: Started Daily Cleanup of User's Temporary Directories. client # [ 547.487638] systemd[2274]: Reached target Paths. client # [ 547.491081] systemd[2274]: Reached target Timers. client # [ 547.491885] systemd[2274]: Starting D-Bus User Message Bus Socket... client # [ 547.496271] systemd[2274]: Starting Create User Files and Directories... client # [ 547.530895] systemd[2274]: Finished Create User Files and Directories. client # [ 547.535679] systemd[2274]: Listening on D-Bus User Message Bus Socket. client # [ 547.540782] systemd[2274]: Reached target Sockets. client # [ 547.541650] systemd[2274]: Reached target Basic System. client # [ 547.542421] systemd[2274]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 547.543849] systemd[2274]: Reached target Main User Target. client # [ 547.545286] systemd[2274]: Startup finished in 236ms. client # [ 547.546098] systemd[1]: Started User Manager for UID 0. client # [ 547.554045] systemd[1]: Started Session 85 of User root. client # [ 547.580193] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.pem&client-key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.key" --eval-store auto --impure --expr "map (tag: import /nix/store/v7sckhacjvxxq8xv667z4hgvbaqhw2dd-slow.nix { inherit tag; }) [ \"q0\" \"q1\" \"q2\" \"q3\" ]". client # [ 547.590786] sshd-session[2287]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 547.597630] sshd-session[2287]: Disconnected from user root UNKNOWN port 65535 client # [ 547.598730] sshd-session[2265]: pam_unix(sshd:session): session closed for user root client # [ 547.602473] systemd[1]: sshd-vsock@71-72-3:22-2:71.service: Deactivated successfully. client # [ 547.613756] systemd[1]: session-85.scope: Deactivated successfully. client # [ 547.621104] systemd-logind[427]: Session 85 logged out. Waiting for processes to exit. client # [ 547.626222] systemd-logind[427]: Removed session 85. client # [ 547.786942] nix[2290]: don't know how to build these paths: worker1 # [ 547.789520] nix-grpc-daemon[2296]: ts=2026-11-12T09:27:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44014 client # [ 547.787976] nix[2290]: /nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv client # [ 547.789376] nix[2290]: /nix/store/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv client # [ 547.790421] nix[2290]: /nix/store/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv client # [ 547.791530] nix[2290]: /nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv worker1 # [ 547.794909] nix-grpc-daemon[2296]: ts=2026-11-12T09:27:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 549.103880] garage[898]: 2026-11-12T09:27:30.863233Z INFO garage_api_common::generic_server: 127.0.0.1:44970 (key GK0123456789abcdef01234567) HEAD /farm/gjyi8j90pk5flrsqqdhj6h132pcb7n33.narinfo lb # [ 549.109393] garage[898]: 2026-11-12T09:27:30.868586Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 549.116377] garage[898]: 2026-11-12T09:27:30.874024Z INFO garage_api_common::generic_server: 127.0.0.1:44970 (key GK0123456789abcdef01234567) HEAD /farm/l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.narinfo lb # [ 549.125735] garage[898]: 2026-11-12T09:27:30.874444Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 546.273577] nix-grpc-daemon[1487]: ts=2026-11-12T09:27:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 549.129543] garage[898]: 2026-11-12T09:27:30.875343Z INFO garage_api_common::generic_server: 127.0.0.1:44970 (key GK0123456789abcdef01234567) HEAD /farm/y3qkgrgq2zzpgvi2rf5chq94i627wkdb.narinfo lb # [ 549.140200] garage[898]: 2026-11-12T09:27:30.875610Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 549.143724] garage[898]: 2026-11-12T09:27:30.877096Z INFO garage_api_common::generic_server: 127.0.0.1:44970 (key GK0123456789abcdef01234567) HEAD /farm/k6zivhvzgmlyxfmy64fzd759bxlhf9b5.narinfo lb # [ 549.153394] garage[898]: 2026-11-12T09:27:30.877431Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 549.157685] garage[898]: 2026-11-12T09:27:30.895387Z INFO garage_api_common::generic_server: 127.0.0.1:44970 (key GK0123456789abcdef01234567) HEAD /farm/l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.narinfo lb # [ 549.163035] garage[898]: 2026-11-12T09:27:30.895806Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 546.310285] nix-grpc-daemon[1487]: ts=2026-11-12T09:27:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 549.166876] garage[898]: 2026-11-12T09:27:30.895914Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/k6zivhvzgmlyxfmy64fzd759bxlhf9b5.narinfo lb # [ 549.171576] garage[898]: 2026-11-12T09:27:30.896189Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 549.178008] garage[898]: 2026-11-12T09:27:30.897347Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/gjyi8j90pk5flrsqqdhj6h132pcb7n33.narinfo lb # [ 549.182791] garage[898]: 2026-11-12T09:27:30.897618Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 547.882869] nix[2290]: copying 4 paths to 'lb:50051'... client # [ 547.884374] nix[2290]: copying path '/nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv' to 'lb:50051'... lb # [ 549.186783] garage[898]: 2026-11-12T09:27:30.897711Z INFO garage_api_common::generic_server: 127.0.0.1:44970 (key GK0123456789abcdef01234567) HEAD /farm/y3qkgrgq2zzpgvi2rf5chq94i627wkdb.narinfo worker2 # [ 546.335735] nix-grpc-daemon[1487]: ts=2026-11-12T09:27:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 client # [ 547.886590] nix[2290]: copying path '/nix/store/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv' to 'lb:50051'... lb # [ 549.190864] garage[898]: 2026-11-12T09:27:30.897886Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 547.888830] nix[2290]: copying path '/nix/store/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv' to 'lb:50051'... client # [ 547.891382] nix[2290]: copying path '/nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv' to 'lb:50051'... lb # [ 549.193848] garage[898]: 2026-11-12T09:27:30.909469Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/k6zivhvzgmlyxfmy64fzd759bxlhf9b5.narinfo lb # [ 549.197862] garage[898]: 2026-11-12T09:27:30.909866Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 546.345944] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 549.200547] garage[898]: 2026-11-12T09:27:30.909973Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/y3qkgrgq2zzpgvi2rf5chq94i627wkdb.narinfo lb # [ 549.203988] garage[898]: 2026-11-12T09:27:30.910146Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 549.206506] garage[898]: 2026-11-12T09:27:30.910226Z INFO garage_api_common::generic_server: 127.0.0.1:44970 (key GK0123456789abcdef01234567) HEAD /farm/l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.narinfo lb # [ 549.209941] garage[898]: 2026-11-12T09:27:30.910397Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 549.212373] garage[898]: 2026-11-12T09:27:30.911169Z INFO garage_api_common::generic_server: 127.0.0.1:44970 (key GK0123456789abcdef01234567) HEAD /farm/gjyi8j90pk5flrsqqdhj6h132pcb7n33.narinfo lb # [ 549.215459] garage[898]: 2026-11-12T09:27:30.911408Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 549.217917] garage[898]: 2026-11-12T09:27:30.935797Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/d4rrlfallgfbcpmjnsn604l2mgff4hgx.narinfo lb # [ 549.221100] garage[898]: 2026-11-12T09:27:30.936233Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 546.368370] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 549.223522] garage[898]: 2026-11-12T09:27:30.936339Z INFO garage_api_common::generic_server: 127.0.0.1:44970 (key GK0123456789abcdef01234567) HEAD /farm/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.narinfo lb # [ 549.226647] garage[898]: 2026-11-12T09:27:30.936526Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 549.228891] garage[898]: 2026-11-12T09:27:30.936594Z INFO garage_api_common::generic_server: 127.0.0.1:44990 (key GK0123456789abcdef01234567) HEAD /farm/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy.narinfo lb # [ 549.232074] garage[898]: 2026-11-12T09:27:30.936782Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 549.234496] garage[898]: 2026-11-12T09:27:30.936859Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/dspy0axfmddglppg9zj9blmxlzhfs40x.narinfo lb # [ 549.239679] garage[898]: 2026-11-12T09:27:30.937278Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 546.513674] nix-daemon[976]: accepted connection from pid 2653, user nix-grpc-daemon (trusted) [e2e] heartbeat t=450s lb # [ 549.390619] niks3-server[1454]: 2026/11/12 09:27:31 INFO Received push request method=POST path=/api/pushes worker2 # [ 546.539759] nix-daemon[976]: reaped child process 2656, status = succeeded worker2 # [ 546.548228] nix-grpc-daemon[1723]: time=2026-11-12T09:27:31.818Z level=INFO msg="Uploading 4 paths to lb (0 already cached)" worker2 # [ 546.549990] nix-grpc-daemon[1723]: time=2026-11-12T09:27:31.818Z level=INFO msg="Uploading jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv (416B)" worker2 # [ 546.551802] nix-grpc-daemon[1723]: time=2026-11-12T09:27:31.818Z level=INFO msg="Uploading d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv (416B)" worker2 # [ 546.554343] nix-grpc-daemon[1723]: time=2026-11-12T09:27:31.818Z level=INFO msg="Uploading pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv (416B)" lb # [ 549.400835] garage[898]: 2026-11-12T09:27:31.159866Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/nar/06ismykzsix0w29371dm1hbzzf3ljf9jn7dyh8skp5wqfkkw0vlk.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092731Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5675587af55136c4b5c11362a50c82cda3784c2a3ce05eae40f1b80aa8133e64 worker2 # [ 546.556287] nix-grpc-daemon[1723]: time=2026-11-12T09:27:31.818Z level=INFO msg="Uploading dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv (416B)" worker2 # [ 546.593236] nix-grpc-daemon[1723]: time=2026-11-12T09:27:31.865Z level=INFO msg="Uploading 4 narinfos" lb # [ 549.426565] garage[898]: 2026-11-12T09:27:31.160561Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/nar/1fyfjzlx8vymsfmdv5cv8ymgjkr18fwm737qvys29plwwiwmyvwr.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092731Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=45bc764d64924564b7fab5b61fb87de2729020757757aaecc00d837769e15f6e worker2 # [ 546.617657] nix-grpc-daemon[1723]: time=2026-11-12T09:27:31.890Z level=INFO msg="Upload complete. (238ms)" lb # [ 549.472235] garage[898]: 2026-11-12T09:27:31.175331Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/nar/1fyfjzlx8vymsfmdv5cv8ymgjkr18fwm737qvys29plwwiwmyvwr.nar.zst lb # [ 549.479415] garage[898]: 2026-11-12T09:27:31.175868Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/nar/1k21jrz411xc9gkca2pnr9mrjq1s3bg3zhsam3nnv4j066dgzgm7.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092731Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dbe78e038295b5f230ec05764be64d80139cdf1c361e4ccda3fead0f48882fba worker2 # [ 546.624337] nix-grpc-daemon[1487]: ts=2026-11-12T09:27:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 paths=4 nar_bytes_in=1664 worker2 # [ 546.637656] nix-daemon[976]: reaped child process 2649, status = succeeded lb # [ 549.486913] garage[898]: 2026-11-12T09:27:31.178653Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/nar/06mdwsnf16qmfi86y8r33asi4vcrp5z7kdxqki87psgfpgvvpdki.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092731Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4ede478ff8133ba8258f7fb6003992dc7e639c66700871641fd0b02fe0feb78f worker1 # [ 548.197100] nix-grpc-daemon[2296]: ts=2026-11-12T09:27:31Z level=debug event=want client=6 drv=dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv cached=0 lb # [ 549.495885] garage[898]: 2026-11-12T09:27:31.179115Z INFO garage_api_common::generic_server: 192.168.1.4:54250 PUT /farm/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092731Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f89498faf8320dcceb67c4bddd38c9b9221c34d3397c20791f67938378baca6a worker1 # [ 548.200689] nix-grpc-daemon[2296]: ts=2026-11-12T09:27:31Z level=debug event=assigned drv=dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv worker=192.168.1.4:50051 clients=1 worker1 # [ 548.205036] nix-grpc-daemon[2296]: ts=2026-11-12T09:27:31Z level=debug event=want client=6 drv=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv cached=0 lb # [ 549.503282] garage[898]: 2026-11-12T09:27:31.179349Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/d4rrlfallgfbcpmjnsn604l2mgff4hgx.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092731Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5c290fb7540cb876e4264da98bdbd8ad23851e6b8ad545efdfe147216f8ece7f worker1 # [ 548.207956] nix-grpc-daemon[2296]: ts=2026-11-12T09:27:31Z level=debug event=assigned drv=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv worker=192.168.1.3:50051 clients=1 lb # [ 549.511237] niks3-server[1454]: 2026/11/12 09:27:31 INFO Registered completed upload object_key=nar/1fyfjzlx8vymsfmdv5cv8ymgjkr18fwm737qvys29plwwiwmyvwr.nar.zst worker2 # [ 546.658432] nix-grpc-daemon[1487]: ts=2026-11-12T09:27:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 549.513674] niks3-server[1454]: 2026/11/12 09:27:31 INFO Registered completed upload object_key=nar/06ismykzsix0w29371dm1hbzzf3ljf9jn7dyh8skp5wqfkkw0vlk.nar.zst worker1 # [ 548.213206] nix-grpc-daemon[2296]: ts=2026-11-12T09:27:31Z level=debug event=want client=6 drv=d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv cached=0 lb # [ 549.515913] niks3-server[1454]: 2026/11/12 09:27:31 INFO Received sign narinfos request method=POST path=/api/pushes/56/sign lb # [ 549.517675] niks3-server[1454]: 2026/11/12 09:27:31 INFO Signed narinfos id=56 count=4 lb # [ 549.518862] niks3-server[1454]: 2026/11/12 09:27:31 INFO Registered completed upload object_key=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy.ls worker1 # [ 548.218271] nix-grpc-daemon[2296]: ts=2026-11-12T09:27:31Z level=debug event=want client=6 drv=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv cached=0 lb # [ 549.520768] niks3-server[1454]: 2026/11/12 09:27:31 INFO Registered completed upload object_key=nar/1k21jrz411xc9gkca2pnr9mrjq1s3bg3zhsam3nnv4j066dgzgm7.nar.zst worker2 # [ 546.669344] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 549.522921] niks3-server[1454]: 2026/11/12 09:27:31 INFO Registered completed upload object_key=nar/06mdwsnf16qmfi86y8r33asi4vcrp5z7kdxqki87psgfpgvvpdki.nar.zst lb # [ 549.525023] niks3-server[1454]: 2026/11/12 09:27:31 INFO Registered completed upload object_key=d4rrlfallgfbcpmjnsn604l2mgff4hgx.ls lb # [ 549.526791] niks3-server[1454]: 2026/11/12 09:27:31 INFO Registered completed upload object_key=dspy0axfmddglppg9zj9blmxlzhfs40x.ls worker1 # [ 548.225342] nix-grpc-daemon[2296]: ts=2026-11-12T09:27:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 549.528931] niks3-server[1454]: 2026/11/12 09:27:31 INFO Registered completed upload object_key=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.ls lb # [ 549.530553] niks3-server[1454]: 2026/11/12 09:27:31 INFO Received complete push request method=POST path=/api/pushes/56/complete lb # [ 549.532150] niks3-server[1454]: 2026/11/12 09:27:31 INFO Registered completed upload object_key=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.narinfo lb # [ 549.534279] niks3-server[1454]: 2026/11/12 09:27:31 INFO Completed push id=56 objects=12 duration=5.6294ms client # [ 548.231091] nix[2290]: building '/nix/store/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv' on lb:50051... lb # [ 549.535637] niks3-server[1454]: 2026/11/12 09:27:31 INFO Registered completed upload object_key=dspy0axfmddglppg9zj9blmxlzhfs40x.narinfo worker2 # [ 546.682055] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker1 # [ 548.235867] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 549.537481] niks3-server[1454]: 2026/11/12 09:27:31 INFO Registered completed upload object_key=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy.narinfo lb # [ 549.539116] niks3-server[1454]: 2026/11/12 09:27:31 INFO Registered completed upload object_key=d4rrlfallgfbcpmjnsn604l2mgff4hgx.narinfo lb # [ 549.542720] garage[898]: 2026-11-12T09:27:31.179590Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092731Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9a6a4d209d2991b8b9d03066ec19237483047fb25e8e816df410a9e7d694706e lb # [ 549.549203] garage[898]: 2026-11-12T09:27:31.179838Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/nar/06ismykzsix0w29371dm1hbzzf3ljf9jn7dyh8skp5wqfkkw0vlk.nar.zst worker1 # [ 548.250975] nix-grpc-daemon[2296]: copying path '/nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv' from 'http://lb:5751'... lb # [ 549.552427] garage[898]: 2026-11-12T09:27:31.182607Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/dspy0axfmddglppg9zj9blmxlzhfs40x.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092731Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a3c9503367b39a10d0e1804ab642c55857f66ca78a9a4f08aabcc02aedff5f4f lb # [ 549.562193] garage[898]: 2026-11-12T09:27:31.203322Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/dspy0axfmddglppg9zj9blmxlzhfs40x.ls lb # [ 549.566158] garage[898]: 2026-11-12T09:27:31.203905Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/nar/1k21jrz411xc9gkca2pnr9mrjq1s3bg3zhsam3nnv4j066dgzgm7.nar.zst worker1 # [ 548.266869] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 549.569122] garage[898]: 2026-11-12T09:27:31.204558Z INFO garage_api_common::generic_server: 127.0.0.1:44970 (key GK0123456789abcdef01234567) HEAD /farm/d4rrlfallgfbcpmjnsn604l2mgff4hgx.ls lb # [ 549.571600] garage[898]: 2026-11-12T09:27:31.205021Z INFO garage_api_common::generic_server: 127.0.0.1:44990 (key GK0123456789abcdef01234567) HEAD /farm/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy.ls lb # [ 549.574716] garage[898]: 2026-11-12T09:27:31.210747Z INFO garage_api_common::generic_server: 127.0.0.1:44990 (key GK0123456789abcdef01234567) HEAD /farm/nar/06mdwsnf16qmfi86y8r33asi4vcrp5z7kdxqki87psgfpgvvpdki.nar.zst lb # [ 549.578000] garage[898]: 2026-11-12T09:27:31.211343Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092731Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c42e70c59e80e3e82d889bf49944be1ff489481c9e265bd9639a5cd66d58a3d1 worker1 # [ 548.283622] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 549.584115] garage[898]: 2026-11-12T09:27:31.215753Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/dspy0axfmddglppg9zj9blmxlzhfs40x.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092731Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ce7379a360fa01ee98149de41dee6366ec70365e90b08a4d58e88dba4cb1cf98 client # [ 548.286933] nix[2290]: building '/nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv' on lb:50051... lb # [ 549.589827] garage[898]: 2026-11-12T09:27:31.216272Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092731Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c027fd28f33db3ade37948b9f4a1e9ba64e8e0ef321485a14097dba4426deae2 lb # [ 549.595613] garage[898]: 2026-11-12T09:27:31.217990Z INFO garage_api_common::generic_server: 192.168.1.4:54250 PUT /farm/d4rrlfallgfbcpmjnsn604l2mgff4hgx.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092731Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6a973ba2726fb93215e0bf7fc7814b2fdd0217209d45ba6659e74ddb7e8f2947 lb # [ 549.601531] garage[898]: 2026-11-12T09:27:31.218434Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.ls lb # [ 549.604180] garage[898]: 2026-11-12T09:27:31.229020Z INFO garage_api_common::generic_server: 127.0.0.1:44990 (key GK0123456789abcdef01234567) HEAD /farm/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.narinfo lb # [ 549.606772] garage[898]: 2026-11-12T09:27:31.230736Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/dspy0axfmddglppg9zj9blmxlzhfs40x.narinfo lb # [ 549.609591] garage[898]: 2026-11-12T09:27:31.231333Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy.narinfo lb # [ 549.612202] garage[898]: 2026-11-12T09:27:31.231551Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/d4rrlfallgfbcpmjnsn604l2mgff4hgx.narinfo lb # [ 549.614777] garage[898]: 2026-11-12T09:27:31.301551Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.narinfo lb # [ 549.617564] garage[898]: 2026-11-12T09:27:31.302626Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) GET /farm/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.narinfo lb # [ 549.620151] garage[898]: 2026-11-12T09:27:31.318558Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/nar/1k21jrz411xc9gkca2pnr9mrjq1s3bg3zhsam3nnv4j066dgzgm7.nar.zst lb # [ 549.622985] garage[898]: 2026-11-12T09:27:31.319291Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) GET /farm/nar/1k21jrz411xc9gkca2pnr9mrjq1s3bg3zhsam3nnv4j066dgzgm7.nar.zst lb # [ 549.900195] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 549.904137] systemd[1]: Started SSH per-connection Daemon (vsock:2:46). lb # [ 550.002253] sshd-session[2025]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 550.011204] sshd-session[2025]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 550.019239] sshd-session[2025]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 550.027771] systemd-logind[499]: New session '63' of user 'root' with class 'user' and type 'tty'. lb # [ 550.032501] systemd[1]: Started Session 63 of User root. lb # [ 550.067208] sshd-session[2031]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 550.070350] sshd-session[2031]: Disconnected from user root UNKNOWN port 65535 lb # [ 550.071438] sshd-session[2025]: pam_unix(sshd:session): session closed for user root lb # [ 550.075850] systemd[1]: sshd-vsock@46-47-4:22-2:46.service: Deactivated successfully. lb # [ 550.081026] systemd[1]: session-63.scope: Deactivated successfully. lb # [ 550.082659] systemd[1]: session-63.scope: Consumed 26ms CPU time over 49ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 550.088811] systemd-logind[499]: Session 63 logged out. Waiting for processes to exit. lb # [ 550.090002] systemd-logind[499]: Removed session 63. worker1 # [ 548.805615] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 548.815442] systemd[1]: Started SSH per-connection Daemon (vsock:2:96). lb # [ 550.167104] garage[898]: 2026-11-12T09:27:31.925421Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.narinfo lb # [ 550.171697] garage[898]: 2026-11-12T09:27:31.925882Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 548.948404] sshd-session[3046]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 548.957669] sshd-session[3046]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 548.975835] sshd-session[3046]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 548.990699] systemd-logind[539]: New session '110' of user 'root' with class 'user' and type 'tty'. worker1 # [ 548.997467] systemd[1]: Started Session 110 of User root. worker1 # [ 549.109702] sshd-session[3054]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 549.111128] sshd-session[3054]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 549.112748] sshd-session[3046]: pam_unix(sshd:session): session closed for user root worker1 # [ 549.117079] systemd[1]: sshd-vsock@96-97-5:22-2:96.service: Deactivated successfully. worker1 # [ 549.122759] systemd[1]: session-110.scope: Deactivated successfully. worker1 # [ 549.124698] systemd[1]: session-110.scope: Consumed 28ms CPU time over 127ms wall clock time, 3.1M memory peak, 19.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 549.130178] systemd-logind[539]: Session 110 logged out. Waiting for processes to exit. worker1 # [ 549.133110] systemd-logind[539]: Removed session 110. worker1 # [ 549.415674] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 549.420667] systemd[1]: Started SSH per-connection Daemon (vsock:2:97). lb # [ 550.727238] garage[898]: 2026-11-12T09:27:32.486669Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/y3qkgrgq2zzpgvi2rf5chq94i627wkdb.narinfo lb # [ 550.732412] garage[898]: 2026-11-12T09:27:32.487118Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 549.545745] sshd-session[3066]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 549.560100] sshd-session[3066]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 549.571891] sshd-session[3066]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 549.585965] systemd-logind[539]: New session '111' of user 'root' with class 'user' and type 'tty'. worker1 # [ 549.593250] systemd[1]: Started Session 111 of User root. worker1 # [ 549.802324] sshd-session[3072]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 549.803754] sshd-session[3072]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 549.809417] sshd-session[3066]: pam_unix(sshd:session): session closed for user root worker1 # [ 549.821182] systemd[1]: sshd-vsock@97-98-5:22-2:97.service: Deactivated successfully. worker1 # [ 549.824853] systemd[1]: session-111.scope: Deactivated successfully. worker1 # [ 549.828700] systemd-logind[539]: Session 111 logged out. Waiting for processes to exit. worker1 # [ 549.831663] systemd-logind[539]: Removed session 111. worker1 # [ 549.937266] nix-daemon[1059]: reaped child process 3039, status = succeeded worker1 # [ 550.052152] nix-daemon[1059]: accepted connection from pid 3078, user nix-grpc-daemon (trusted) worker1 # [ 550.075588] nix-daemon[1059]: reaped child process 3081, status = succeeded lb # [ 551.380790] niks3-server[1454]: 2026/11/12 09:27:33 INFO Received push request method=POST path=/api/pushes worker1 # [ 550.091864] nix-grpc-daemon[2487]: time=2026-11-12T09:27:33.884Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 550.096206] nix-grpc-daemon[2487]: time=2026-11-12T09:27:33.884Z level=INFO msg="Uploading l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx-slow-q1 (120B)" lb # [ 551.396777] garage[898]: 2026-11-12T09:27:33.155943Z INFO garage_api_common::generic_server: 192.168.1.3:34162 PUT /farm/l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=220f9b28d613dcafe6300ac663b060d5a992f5501c9ed0800baa2f2d0d4a7d43 worker1 # [ 550.117517] nix-grpc-daemon[2487]: time=2026-11-12T09:27:33.911Z level=INFO msg="Uploading 1 narinfos" lb # [ 551.426518] garage[898]: 2026-11-12T09:27:33.166153Z INFO garage_api_common::generic_server: 192.168.1.3:34146 PUT /farm/nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=925a443b8319bcb2cf482bd24ff2ec5e27b6eb6e2ac2acb56e04222957217dbd lb # [ 551.437991] garage[898]: 2026-11-12T09:27:33.166493Z INFO garage_api_common::generic_server: 192.168.1.3:34158 PUT /farm/log/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d8a8d43b09be51b9e8ec8ee2392c854cac45fc8f9ee627566e602335db8ff404 lb # [ 551.447005] garage[898]: 2026-11-12T09:27:33.170068Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.ls worker1 # [ 550.152489] nix-grpc-daemon[2487]: time=2026-11-12T09:27:33.946Z level=INFO msg="Upload complete. (247ms)" lb # [ 551.452918] garage[898]: 2026-11-12T09:27:33.175417Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/log/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv lb # [ 551.459776] garage[898]: 2026-11-12T09:27:33.176833Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst worker1 # [ 550.164774] nix-grpc-daemon[2296]: ts=2026-11-12T09:27:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=1 drv=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv assign_id=13 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 551.465677] garage[898]: 2026-11-12T09:27:33.178988Z INFO garage_api_common::generic_server: 192.168.1.3:34158 PUT /farm/l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b6941e7cedcd8065484c8e335b759c10534c6f97eb8c9417ffeb3830428c1982 lb # [ 551.474780] niks3-server[1454]: 2026/11/12 09:27:33 INFO Received sign narinfos request method=POST path=/api/pushes/57/sign lb # [ 551.477164] niks3-server[1454]: 2026/11/12 09:27:33 INFO Registered completed upload object_key=l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.ls worker1 # [ 550.176522] nix-grpc-daemon[2296]: ts=2026-11-12T09:27:33Z level=debug event=assigned drv=d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv worker=192.168.1.3:50051 clients=1 lb # [ 551.479456] niks3-server[1454]: 2026/11/12 09:27:33 INFO Signed narinfos id=57 count=1 worker1 # [ 550.179854] nix-grpc-daemon[2296]: ts=2026-11-12T09:27:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 551.481162] niks3-server[1454]: 2026/11/12 09:27:33 INFO Received complete push request method=POST path=/api/pushes/57/complete lb # [ 551.485709] niks3-server[1454]: 2026/11/12 09:27:33 INFO Registered completed upload object_key=log/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv worker1 # [ 550.187669] nix-daemon[1059]: reaped child process 3037, status = succeeded worker1 # [ 550.189536] nix-grpc-daemon[2296]: copying path '/nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv' from 'http://lb:5751'... lb # [ 551.488803] niks3-server[1454]: 2026/11/12 09:27:33 INFO Registered completed upload object_key=nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst lb # [ 551.494344] niks3-server[1454]: 2026/11/12 09:27:33 INFO Completed push id=57 objects=4 duration=30.9559ms lb # [ 551.496412] niks3-server[1454]: 2026/11/12 09:27:33 INFO Registered completed upload object_key=l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.narinfo lb # [ 551.498702] garage[898]: 2026-11-12T09:27:33.183566Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.narinfo worker1 # [ 550.202803] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 551.502557] garage[898]: 2026-11-12T09:27:33.244143Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/d4rrlfallgfbcpmjnsn604l2mgff4hgx.narinfo lb # [ 551.506248] garage[898]: 2026-11-12T09:27:33.245087Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) GET /farm/d4rrlfallgfbcpmjnsn604l2mgff4hgx.narinfo lb # [ 551.509972] garage[898]: 2026-11-12T09:27:33.253006Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/nar/06ismykzsix0w29371dm1hbzzf3ljf9jn7dyh8skp5wqfkkw0vlk.nar.zst worker1 # [ 550.214085] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 551.514222] garage[898]: 2026-11-12T09:27:33.253733Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) GET /farm/nar/06ismykzsix0w29371dm1hbzzf3ljf9jn7dyh8skp5wqfkkw0vlk.nar.zst client # [ 550.211748] nix[2290]: building '/nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv' on lb:50051... lb # [ 552.718731] garage[898]: 2026-11-12T09:27:34.477431Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/k6zivhvzgmlyxfmy64fzd759bxlhf9b5.narinfo lb # [ 552.718919] garage[898]: 2026-11-12T09:27:34.477943Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 550.067724] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 550.074049] systemd[1]: Started SSH per-connection Daemon (vsock:2:59). worker2 # [ 550.202350] sshd-session[2677]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 550.212892] sshd-session[2677]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 550.232213] sshd-session[2677]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 550.306505] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 550.326529] systemd-logind[515]: New session '75' of user 'root' with class 'user' and type 'tty'. worker2 # [ 550.417619] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 550.419773] systemd[1]: Starting User Manager for UID 0... worker2 # [ 550.544693] (systemd)[2685]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 550.560258] systemd-logind[515]: New session '76' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 550.864768] systemd[2685]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 552.233310] systemd[2685]: Queued start job for default target Main User Target. worker2 # [ 552.239303] systemd[2685]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 552.242940] systemd[2685]: Created slice User Application Slice. worker2 # [ 552.243954] systemd[2685]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 552.260260] systemd[2685]: Reached target Paths. worker2 # [ 552.261017] systemd[2685]: Reached target Timers. worker2 # [ 552.261746] systemd[2685]: Starting D-Bus User Message Bus Socket... worker2 # [ 552.262695] systemd[2685]: Starting Create User Files and Directories... worker2 # [ 552.344719] systemd[2685]: Finished Create User Files and Directories. worker2 # [ 552.345858] systemd[2685]: Listening on D-Bus User Message Bus Socket. worker2 # [ 552.346807] systemd[2685]: Reached target Sockets. worker2 # [ 552.358725] systemd[2685]: Reached target Basic System. worker2 # [ 552.359881] systemd[2685]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 552.369254] systemd[2685]: Reached target Main User Target. worker2 # [ 552.370238] systemd[2685]: Startup finished in 1.678s. worker2 # [ 552.371545] systemd[1]: Started User Manager for UID 0. worker2 # [ 552.376223] systemd[1]: Started Session 75 of User root. worker2 # [ 552.565376] sshd-session[2698]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 552.566812] sshd-session[2698]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 552.569945] sshd-session[2677]: pam_unix(sshd:session): session closed for user root worker2 # [ 552.576314] systemd[1]: sshd-vsock@59-60-6:22-2:59.service: Deactivated successfully. worker2 # [ 552.581637] systemd-logind[515]: Session 75 logged out. Waiting for processes to exit. worker2 # [ 552.582884] systemd[1]: session-75.scope: Deactivated successfully. worker2 # [ 552.587667] systemd-logind[515]: Removed session 75. worker2 # [ 552.738586] nix-daemon[976]: reaped child process 2661, status = succeeded worker2 # [ 552.854297] nix-daemon[976]: accepted connection from pid 2704, user nix-grpc-daemon (trusted) worker2 # [ 552.879239] nix-daemon[976]: reaped child process 2707, status = succeeded lb # [ 555.738331] niks3-server[1454]: 2026/11/12 09:27:37 INFO Received push request method=POST path=/api/pushes worker2 # [ 552.892521] nix-grpc-daemon[1723]: time=2026-11-12T09:27:38.164Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 552.894181] nix-grpc-daemon[1723]: time=2026-11-12T09:27:38.164Z level=INFO msg="Uploading y3qkgrgq2zzpgvi2rf5chq94i627wkdb-slow-q3 (120B)" worker2 # [ 552.915680] nix-grpc-daemon[1723]: time=2026-11-12T09:27:38.188Z level=INFO msg="Uploading 1 narinfos" lb # [ 555.752297] garage[898]: 2026-11-12T09:27:37.511039Z INFO garage_api_common::generic_server: 192.168.1.4:54250 PUT /farm/log/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092737Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=22ce3943ab2a29732b82f30fe5dcd77e3681224bfd5a4c22653059d5a71e7e8e worker2 # [ 552.925470] nix-grpc-daemon[1723]: time=2026-11-12T09:27:38.198Z level=INFO msg="Upload complete. (216ms)" lb # [ 555.778885] garage[898]: 2026-11-12T09:27:37.522255Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/y3qkgrgq2zzpgvi2rf5chq94i627wkdb.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092737Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f96d212b8528dc1c04e4e2946263663a5482688b1f1b8bc2ed37865daffbd231 worker2 # [ 552.932752] nix-grpc-daemon[1487]: ts=2026-11-12T09:27:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=6 drv=dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv assign_id=12 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 554.491002] nix-grpc-daemon[2296]: ts=2026-11-12T09:27:38Z level=debug event=assigned drv=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv worker=192.168.1.4:50051 clients=1 lb # [ 555.790112] garage[898]: 2026-11-12T09:27:37.523644Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092737Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=654c020bf5aed9a4e619b2aeab7ea5ba7cce65f261b70fdfd8ea2ac1c2c5f64f worker2 # [ 552.947241] nix-daemon[976]: reaped child process 2659, status = succeeded lb # [ 555.800181] garage[898]: 2026-11-12T09:27:37.526224Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst worker2 # [ 552.952843] nix-grpc-daemon[1487]: ts=2026-11-12T09:27:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 555.805292] garage[898]: 2026-11-12T09:27:37.529194Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/log/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv worker2 # [ 552.961565] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 555.810229] garage[898]: 2026-11-12T09:27:37.529708Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/y3qkgrgq2zzpgvi2rf5chq94i627wkdb.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092737Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ced7cca1b7eb64b0f9e8e520cb11fd9db142f8227af1a617286ed0e5f1ea2848 lb # [ 555.819077] garage[898]: 2026-11-12T09:27:37.530073Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/y3qkgrgq2zzpgvi2rf5chq94i627wkdb.ls lb # [ 555.823893] niks3-server[1454]: 2026/11/12 09:27:37 INFO Received sign narinfos request method=POST path=/api/pushes/58/sign client # [ 554.521587] nix[2290]: building '/nix/store/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv' on lb:50051... lb # [ 555.826547] niks3-server[1454]: 2026/11/12 09:27:37 INFO Signed narinfos id=58 count=1 worker2 # [ 552.974553] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 555.828246] niks3-server[1454]: 2026/11/12 09:27:37 INFO Registered completed upload object_key=nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst lb # [ 555.831102] niks3-server[1454]: 2026/11/12 09:27:37 INFO Received complete push request method=POST path=/api/pushes/58/complete lb # [ 555.833508] niks3-server[1454]: 2026/11/12 09:27:37 INFO Registered completed upload object_key=y3qkgrgq2zzpgvi2rf5chq94i627wkdb.ls lb # [ 555.835703] niks3-server[1454]: 2026/11/12 09:27:37 INFO Registered completed upload object_key=log/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv lb # [ 555.838211] niks3-server[1454]: 2026/11/12 09:27:37 INFO Completed push id=58 objects=4 duration=6.07242ms lb # [ 555.839942] niks3-server[1454]: 2026/11/12 09:27:37 INFO Registered completed upload object_key=y3qkgrgq2zzpgvi2rf5chq94i627wkdb.narinfo lb # [ 555.842377] garage[898]: 2026-11-12T09:27:37.535163Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/y3qkgrgq2zzpgvi2rf5chq94i627wkdb.narinfo client # [ 555.108261] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 555.113405] systemd[1]: Started SSH per-connection Daemon (vsock:2:72). client # [ 555.206827] sshd-session[2306]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 555.216762] sshd-session[2306]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 555.225673] sshd-session[2306]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 555.237197] systemd-logind[427]: New session '87' of user 'root' with class 'user' and type 'tty'. client # [ 555.244262] systemd[1]: Started Session 87 of User root. client # [ 555.269242] sshd-session[2312]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 555.270798] sshd-session[2312]: Disconnected from user root UNKNOWN port 65535 client # [ 555.273031] sshd-session[2306]: pam_unix(sshd:session): session closed for user root client # [ 555.277007] systemd[1]: sshd-vsock@72-73-3:22-2:72.service: Deactivated successfully. client # [ 555.282292] systemd[1]: session-87.scope: Deactivated successfully. client # [ 555.286463] systemd-logind[427]: Session 87 logged out. Waiting for processes to exit. client # [ 555.289659] systemd-logind[427]: Removed session 87. lb # [ 556.950907] garage[898]: 2026-11-12T09:27:38.709650Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/gjyi8j90pk5flrsqqdhj6h132pcb7n33.narinfo lb # [ 556.955950] garage[898]: 2026-11-12T09:27:38.710098Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 556.142542] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 556.143906] systemd[1]: Started SSH per-connection Daemon (vsock:2:98). worker1 # [ 556.269753] sshd-session[3103]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 556.284100] sshd-session[3103]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 556.295968] sshd-session[3103]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 556.311609] systemd-logind[539]: New session '112' of user 'root' with class 'user' and type 'tty'. worker1 # [ 556.317555] systemd[1]: Started Session 112 of User root. worker1 # [ 556.510576] sshd-session[3109]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 556.513092] sshd-session[3109]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 556.522277] sshd-session[3103]: pam_unix(sshd:session): session closed for user root worker1 # [ 556.523480] systemd[1]: sshd-vsock@98-99-5:22-2:98.service: Deactivated successfully. worker1 # [ 556.531570] systemd[1]: session-112.scope: Deactivated successfully. worker1 # [ 556.532791] systemd-logind[539]: Session 112 logged out. Waiting for processes to exit. worker1 # [ 556.534004] systemd-logind[539]: Removed session 112. worker1 # [ 556.712756] nix-daemon[1059]: reaped child process 3087, status = succeeded worker1 # [ 556.783525] nix-daemon[1059]: accepted connection from pid 3115, user nix-grpc-daemon (trusted) worker1 # [ 556.806399] nix-daemon[1059]: reaped child process 3118, status = succeeded lb # [ 558.111826] niks3-server[1454]: 2026/11/12 09:27:39 INFO Received push request method=POST path=/api/pushes worker1 # [ 556.820507] nix-grpc-daemon[2487]: time=2026-11-12T09:27:40.613Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 555.268076] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 556.822270] nix-grpc-daemon[2487]: time=2026-11-12T09:27:40.613Z level=INFO msg="Uploading k6zivhvzgmlyxfmy64fzd759bxlhf9b5-slow-q0 (120B)" worker2 # [ 555.271580] systemd[1]: Started SSH per-connection Daemon (vsock:2:60). lb # [ 558.127449] garage[898]: 2026-11-12T09:27:39.886115Z INFO garage_api_common::generic_server: 192.168.1.3:34146 PUT /farm/nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092739Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2779ffcf4fd42e6d03732dd8540011b4e73b9fcca35f241a4956581e1865251f worker1 # [ 556.849723] nix-grpc-daemon[2487]: time=2026-11-12T09:27:40.643Z level=INFO msg="Uploading 1 narinfos" worker1 # [ 556.856079] nix-grpc-daemon[2487]: time=2026-11-12T09:27:40.649Z level=INFO msg="Upload complete. (223ms)" lb # [ 558.156170] garage[898]: 2026-11-12T09:27:39.897418Z INFO garage_api_common::generic_server: 192.168.1.3:34158 PUT /farm/log/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092739Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=979dd53871be9224c3b9cab09afd970a327c50d2de15744f10fe39b778fe995b worker1 # [ 556.864660] nix-grpc-daemon[2296]: ts=2026-11-12T09:27:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=6 drv=d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv assign_id=14 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 558.167010] garage[898]: 2026-11-12T09:27:39.900369Z INFO garage_api_common::generic_server: 192.168.1.3:34162 PUT /farm/k6zivhvzgmlyxfmy64fzd759bxlhf9b5.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092739Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=673220d43060e5bb5dc0a7f16db01f5592b346bc2b7d2c76ff11af127e2d5372 worker1 # [ 556.878073] nix-daemon[1059]: reaped child process 3085, status = succeeded lb # [ 558.176665] garage[898]: 2026-11-12T09:27:39.901713Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst lb # [ 558.181543] garage[898]: 2026-11-12T09:27:39.904976Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/log/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv lb # [ 558.186022] garage[898]: 2026-11-12T09:27:39.907784Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/k6zivhvzgmlyxfmy64fzd759bxlhf9b5.ls lb # [ 558.190564] garage[898]: 2026-11-12T09:27:39.909916Z INFO garage_api_common::generic_server: 192.168.1.3:34162 PUT /farm/k6zivhvzgmlyxfmy64fzd759bxlhf9b5.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092739Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=00b5ced47b530061ab61d1946643212f57396299304e8c0ac5d473683bad0804 lb # [ 558.199850] niks3-server[1454]: 2026/11/12 09:27:39 INFO Received sign narinfos request method=POST path=/api/pushes/59/sign lb # [ 558.202495] niks3-server[1454]: 2026/11/12 09:27:39 INFO Registered completed upload object_key=nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst lb # [ 558.205516] niks3-server[1454]: 2026/11/12 09:27:39 INFO Signed narinfos id=59 count=1 lb # [ 558.207051] niks3-server[1454]: 2026/11/12 09:27:39 INFO Registered completed upload object_key=log/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv lb # [ 558.209722] niks3-server[1454]: 2026/11/12 09:27:39 INFO Registered completed upload object_key=k6zivhvzgmlyxfmy64fzd759bxlhf9b5.ls lb # [ 558.211921] niks3-server[1454]: 2026/11/12 09:27:39 INFO Received complete push request method=POST path=/api/pushes/59/complete lb # [ 558.214224] niks3-server[1454]: 2026/11/12 09:27:39 INFO Completed push id=59 objects=4 duration=2.5209ms lb # [ 558.215984] niks3-server[1454]: 2026/11/12 09:27:39 INFO Registered completed upload object_key=k6zivhvzgmlyxfmy64fzd759bxlhf9b5.narinfo lb # [ 558.218326] garage[898]: 2026-11-12T09:27:39.914856Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/k6zivhvzgmlyxfmy64fzd759bxlhf9b5.narinfo worker2 # [ 555.414017] sshd-session[2728]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 555.422573] sshd-session[2728]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 555.438889] sshd-session[2728]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 555.450684] systemd-logind[515]: New session '77' of user 'root' with class 'user' and type 'tty'. worker2 # [ 555.457179] systemd[1]: Started Session 77 of User root. worker2 # [ 555.655566] sshd-session[2734]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 555.661915] sshd-session[2734]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 555.663188] sshd-session[2728]: pam_unix(sshd:session): session closed for user root worker2 # [ 555.674790] systemd[1]: sshd-vsock@60-61-6:22-2:60.service: Deactivated successfully. worker2 # [ 555.679274] systemd[1]: session-77.scope: Deactivated successfully. worker2 # [ 555.683578] systemd-logind[515]: Session 77 logged out. Waiting for processes to exit. worker2 # [ 555.687482] systemd-logind[515]: Removed session 77. client # [ 557.413276] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 555.866837] nix-daemon[976]: reaped child process 2712, status = succeeded client # [ 557.421059] systemd[1]: Started SSH per-connection Daemon (vsock:2:73). worker2 # [ 555.933596] nix-daemon[976]: accepted connection from pid 2740, user nix-grpc-daemon (trusted) lb # [ 558.812693] niks3-server[1454]: 2026/11/12 09:27:40 INFO Received push request method=POST path=/api/pushes worker2 # [ 555.962155] nix-daemon[976]: reaped child process 2743, status = succeeded worker2 # [ 555.966515] nix-grpc-daemon[1723]: time=2026-11-12T09:27:41.238Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 555.968540] nix-grpc-daemon[1723]: time=2026-11-12T09:27:41.238Z level=INFO msg="Uploading gjyi8j90pk5flrsqqdhj6h132pcb7n33-slow-q2 (120B)" client # [ 557.519956] sshd-session[2317]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 558.820260] garage[898]: 2026-11-12T09:27:40.579676Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/log/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092740Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c630bf72ab8d33a50f36dd12ed7c859df35d22576b5416677a3fe364722137a0 client # [ 557.530212] sshd-session[2317]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 555.980592] nix-grpc-daemon[1723]: time=2026-11-12T09:27:41.253Z level=INFO msg="Uploading 1 narinfos" client # [ 557.539871] sshd-session[2317]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 555.990548] nix-grpc-daemon[1723]: time=2026-11-12T09:27:41.263Z level=INFO msg="Upload complete. (204ms)" worker2 # [ 555.996684] nix-grpc-daemon[1487]: ts=2026-11-12T09:27:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=3 drv=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv assign_id=15 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 558.844946] garage[898]: 2026-11-12T09:27:40.590175Z INFO garage_api_common::generic_server: 192.168.1.4:54250 PUT /farm/gjyi8j90pk5flrsqqdhj6h132pcb7n33.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092740Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6c5b56493ac9d7a6b938b4708ddde95bcc14843cf17316595921c1f63a6d9c71 worker2 # [ 556.008370] nix-daemon[976]: reaped child process 2710, status = succeeded client # [ 557.550214] systemd-logind[427]: New session '88' of user 'root' with class 'user' and type 'tty'. lb # [ 558.856627] garage[898]: 2026-11-12T09:27:40.590590Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092740Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e69a9ae5d72a1130b0089b6d5d9bde26331b170b466981306c690a49305fe5d7 client # [ 557.561948] systemd[1]: Started Session 88 of User root. lb # [ 558.866662] garage[898]: 2026-11-12T09:27:40.594269Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/gjyi8j90pk5flrsqqdhj6h132pcb7n33.ls lb # [ 558.871506] garage[898]: 2026-11-12T09:27:40.594745Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/gjyi8j90pk5flrsqqdhj6h132pcb7n33.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092740Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=14c0f70735ba8eab6ca83826a561762516cc2d0187bfd08fd485f2ad03db10e3 lb # [ 558.881344] garage[898]: 2026-11-12T09:27:40.597645Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/log/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv lb # [ 558.885923] garage[898]: 2026-11-12T09:27:40.600544Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst lb # [ 558.890729] niks3-server[1454]: 2026/11/12 09:27:40 INFO Received sign narinfos request method=POST path=/api/pushes/60/sign lb # [ 558.893258] niks3-server[1454]: 2026/11/12 09:27:40 INFO Signed narinfos id=60 count=1 lb # [ 558.894973] niks3-server[1454]: 2026/11/12 09:27:40 INFO Received complete push request method=POST path=/api/pushes/60/complete lb # [ 558.897467] niks3-server[1454]: 2026/11/12 09:27:40 INFO Registered completed upload object_key=gjyi8j90pk5flrsqqdhj6h132pcb7n33.ls lb # [ 558.899680] niks3-server[1454]: 2026/11/12 09:27:40 INFO Registered completed upload object_key=log/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv lb # [ 558.902262] niks3-server[1454]: 2026/11/12 09:27:40 INFO Completed push id=60 objects=4 duration=7.37034ms client # [ 557.601496] sshd-session[2323]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 558.904131] niks3-server[1454]: 2026/11/12 09:27:40 INFO Registered completed upload object_key=nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst client # [ 557.602954] sshd-session[2323]: Disconnected from user root UNKNOWN port 65535 lb # [ 558.906906] niks3-server[1454]: 2026/11/12 09:27:40 INFO Registered completed upload object_key=gjyi8j90pk5flrsqqdhj6h132pcb7n33.narinfo client # [ 557.604540] sshd-session[2317]: pam_unix(sshd:session): session closed for user root lb # [ 558.909357] garage[898]: 2026-11-12T09:27:40.601034Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/gjyi8j90pk5flrsqqdhj6h132pcb7n33.narinfo client # [ 557.608914] systemd[1]: sshd-vsock@73-74-3:22-2:73.service: Deactivated successfully. client # [ 557.614411] systemd[1]: session-88.scope: Deactivated successfully. client # [ 557.618562] systemd-logind[427]: Session 88 logged out. Waiting for processes to exit. client # [ 557.624678] systemd-logind[427]: Removed session 88. client # [ 557.625675] systemd[1]: burst.service: Deactivated successfully. client # [ 557.626551] systemd[1]: burst.service: Consumed 195ms CPU time over 10.043s wall clock time, 41M memory peak, 13.9K incoming IP traffic, 14.8K outgoing IP traffic. lb # [ 560.309041] systemd[1]: Stopping User Manager for UID 0... lb # [ 560.313124] systemd[1993]: Activating special unit Exit the Session... lb # [ 560.318208] systemd[1993]: Stopped target Main User Target. lb # [ 560.319642] systemd[1993]: Stopped target Basic System. lb # [ 560.324637] systemd[1993]: Stopped target Paths. lb # [ 560.325793] systemd[1993]: Stopped target Sockets. lb # [ 560.326897] systemd[1993]: Stopped target Timers. lb # [ 560.327974] systemd[1993]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 560.331020] systemd[1993]: Closed D-Bus User Message Bus Socket. lb # [ 560.332565] systemd[1993]: Stopped Create User Files and Directories. lb # [ 560.333986] systemd[1993]: Removed slice User Application Slice. lb # [ 560.335465] systemd[1993]: Reached target Shutdown. lb # [ 560.337728] systemd[1993]: Finished Exit the Session. lb # [ 560.338932] systemd[1993]: Reached target Exit the Session. lb # [ 560.361860] systemd-logind[499]: Removed session 61. lb # [ 560.371049] systemd[1]: user@0.service: Deactivated successfully. lb # [ 560.375886] systemd[1]: Stopped User Manager for UID 0. lb # [ 560.434652] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 560.474195] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 560.479323] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 560.483126] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 559.435225] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 559.443001] systemd[1]: Started SSH per-connection Daemon (vsock:2:99). worker1 # [ 559.541875] sshd-session[3120]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 559.551660] sshd-session[3120]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 559.560674] sshd-session[3120]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 559.569995] systemd-logind[539]: New session '113' of user 'root' with class 'user' and type 'tty'. worker1 # [ 559.576508] systemd[1]: Started Session 113 of User root. worker1 # [ 559.611174] sshd-session[3126]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 559.614116] sshd-session[3126]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 559.615530] sshd-session[3120]: pam_unix(sshd:session): session closed for user root worker1 # [ 559.620197] systemd[1]: sshd-vsock@99-100-5:22-2:99.service: Deactivated successfully. worker1 # [ 559.625339] systemd[1]: session-113.scope: Deactivated successfully. worker1 # [ 559.629934] systemd-logind[539]: Session 113 logged out. Waiting for processes to exit. worker1 # [ 559.632355] systemd-logind[539]: Removed session 113. worker2 # [ 558.209362] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 558.217970] systemd[1]: Started SSH per-connection Daemon (vsock:2:61). worker2 # [ 558.329648] sshd-session[2745]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 558.338866] sshd-session[2745]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 558.350358] sshd-session[2745]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 558.362308] systemd-logind[515]: New session '78' of user 'root' with class 'user' and type 'tty'. worker2 # [ 558.368706] systemd[1]: Started Session 78 of User root. worker2 # [ 558.406766] sshd-session[2751]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 558.410044] sshd-session[2751]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 558.412316] sshd-session[2745]: pam_unix(sshd:session): session closed for user root worker2 # [ 558.417291] systemd[1]: sshd-vsock@61-62-6:22-2:61.service: Deactivated successfully. worker2 # [ 558.422913] systemd[1]: session-78.scope: Deactivated successfully. worker2 # [ 558.428323] systemd-logind[515]: Session 78 logged out. Waiting for processes to exit. worker2 # [ 558.430751] systemd-logind[515]: Removed session 78. client # [ 560.181742] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 560.190220] systemd[1]: Started SSH per-connection Daemon (vsock:2:74). client # [ 560.285284] sshd-session[2331]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 560.295384] sshd-session[2331]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 560.304369] sshd-session[2331]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 560.315256] systemd-logind[427]: New session '89' of user 'root' with class 'user' and type 'tty'. client # [ 560.320561] systemd[1]: Started Session 89 of User root. client # [ 560.347023] sshd-session[2337]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 560.350231] sshd-session[2337]: Disconnected from user root UNKNOWN port 65535 client # [ 560.351426] sshd-session[2331]: pam_unix(sshd:session): session closed for user root client # [ 560.355706] systemd[1]: sshd-vsock@74-75-3:22-2:74.service: Deactivated successfully. client # [ 560.362000] systemd[1]: session-89.scope: Deactivated successfully. client # [ 560.365916] systemd-logind[427]: Session 89 logged out. Waiting for processes to exit. client # [ 560.369326] systemd-logind[427]: Removed session 89. client # [ 561.618812] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 561.626334] systemd[1]: Started SSH per-connection Daemon (vsock:2:75). client # [ 561.727929] sshd-session[2342]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 561.738263] sshd-session[2342]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 561.747476] sshd-session[2342]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 561.757168] systemd-logind[427]: New session '90' of user 'root' with class 'user' and type 'tty'. client # [ 561.769290] systemd[1]: Started Session 90 of User root. client # [ 561.801649] sshd-session[2348]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 561.804607] sshd-session[2348]: Disconnected from user root UNKNOWN port 65535 client # [ 561.806244] sshd-session[2342]: pam_unix(sshd:session): session closed for user root client # [ 561.810912] systemd[1]: sshd-vsock@75-76-3:22-2:75.service: Deactivated successfully. client # [ 561.818004] systemd[1]: session-90.scope: Deactivated successfully. client # [ 561.822275] systemd-logind[427]: Session 90 logged out. Waiting for processes to exit. client # [ 561.826164] systemd-logind[427]: Removed session 90. lb # [ 564.380939] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 564.388694] systemd[1]: Started SSH per-connection Daemon (vsock:2:47). lb # [ 564.487967] sshd-session[2044]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 564.496348] sshd-session[2044]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 564.506502] sshd-session[2044]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 564.532525] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 564.561627] systemd-logind[499]: New session '64' of user 'root' with class 'user' and type 'tty'. lb # [ 564.572452] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 564.578709] systemd[1]: Starting User Manager for UID 0... lb # [ 564.605426] (systemd)[2053]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 564.611488] systemd-logind[499]: New session '65' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 564.701619] systemd[2053]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 564.801167] systemd[2053]: Queued start job for default target Main User Target. lb # [ 564.805039] systemd[2053]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 564.807869] systemd[2053]: Created slice User Application Slice. lb # [ 564.809087] systemd[2053]: Started Daily Cleanup of User's Temporary Directories. lb # [ 564.810213] systemd[2053]: Reached target Paths. lb # [ 564.812294] systemd[2053]: Reached target Timers. lb # [ 564.814827] systemd[2053]: Starting D-Bus User Message Bus Socket... lb # [ 564.817051] systemd[2053]: Starting Create User Files and Directories... lb # [ 564.858913] systemd[2053]: Finished Create User Files and Directories. lb # [ 564.863360] systemd[2053]: Listening on D-Bus User Message Bus Socket. lb # [ 564.865208] systemd[2053]: Reached target Sockets. lb # [ 564.867314] systemd[2053]: Reached target Basic System. lb # [ 564.870452] systemd[2053]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 564.871946] systemd[2053]: Reached target Main User Target. lb # [ 564.873032] systemd[2053]: Startup finished in 239ms. lb # [ 564.873783] systemd[1]: Started User Manager for UID 0. lb # [ 564.876664] systemd[1]: Started Session 64 of User root. lb # [ 564.910611] sshd-session[2066]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 564.913089] sshd-session[2066]: Disconnected from user root UNKNOWN port 65535 lb # [ 564.914640] sshd-session[2044]: pam_unix(sshd:session): session closed for user root lb # [ 564.918601] systemd[1]: sshd-vsock@47-48-4:22-2:47.service: Deactivated successfully. lb # [ 564.923829] systemd[1]: session-64.scope: Deactivated successfully. lb # [ 564.926854] systemd[1]: session-64.scope: Consumed 26ms CPU time over 48ms wall clock time, 4.8M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 564.931022] systemd-logind[499]: Session 64 logged out. Waiting for processes to exit. lb # [ 564.933571] systemd-logind[499]: Removed session 64. lb # [ 566.332350] envoy[897]: conn peer=[2001:db8:1::1]:55318 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=6734 tx=4790 ms=9809 worker1 # [ 565.372385] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 565.375972] systemd[1]: Started SSH per-connection Daemon (vsock:2:100). worker1 # [ 565.477555] sshd-session[3131]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 565.487309] sshd-session[3131]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 565.496900] sshd-session[3131]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 565.508583] systemd-logind[539]: New session '114' of user 'root' with class 'user' and type 'tty'. worker1 # [ 565.513616] systemd[1]: Started Session 114 of User root. worker1 # [ 565.549368] sshd-session[3137]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 565.550772] sshd-session[3137]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 565.552817] sshd-session[3131]: pam_unix(sshd:session): session closed for user root worker1 # [ 565.556985] systemd[1]: sshd-vsock@100-101-5:22-2:100.service: Deactivated successfully. worker1 # [ 565.562034] systemd[1]: session-114.scope: Deactivated successfully. worker1 # [ 565.565314] systemd[1]: session-114.scope: Consumed 28ms CPU time over 50ms wall clock time, 4.8M memory peak, 19.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 565.569315] systemd-logind[539]: Session 114 logged out. Waiting for processes to exit. worker1 # [ 565.571202] systemd-logind[539]: Removed session 114. lb # [ 567.519204] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 567.528165] systemd[1]: Started SSH per-connection Daemon (vsock:2:48). lb # [ 567.629109] sshd-session[2071]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 567.638556] sshd-session[2071]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 567.647576] sshd-session[2071]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 567.659288] systemd-logind[499]: New session '66' of user 'root' with class 'user' and type 'tty'. lb # [ 567.665468] systemd[1]: Started Session 66 of User root. lb # [ 567.700268] sshd-session[2077]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 567.701905] sshd-session[2077]: Disconnected from user root UNKNOWN port 65535 lb # [ 567.703532] sshd-session[2071]: pam_unix(sshd:session): session closed for user root lb # [ 567.708844] systemd[1]: sshd-vsock@48-49-4:22-2:48.service: Deactivated successfully. lb # [ 567.713604] systemd[1]: session-66.scope: Deactivated successfully. lb # [ 567.715413] systemd[1]: session-66.scope: Consumed 27ms CPU time over 50ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 567.721679] systemd-logind[499]: Session 66 logged out. Waiting for processes to exit. lb # [ 567.722923] systemd-logind[499]: Removed session 66. worker1 # [ 566.795474] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 566.803474] systemd[1]: Started SSH per-connection Daemon (vsock:2:101). worker1 # [ 566.897682] sshd-session[3142]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 566.907138] sshd-session[3142]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 566.915726] sshd-session[3142]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 566.925216] systemd-logind[539]: New session '115' of user 'root' with class 'user' and type 'tty'. worker1 # [ 566.933582] systemd[1]: Started Session 115 of User root. worker1 # [ 566.968976] sshd-session[3148]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 566.970476] sshd-session[3148]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 566.972153] sshd-session[3142]: pam_unix(sshd:session): session closed for user root worker1 # [ 566.976633] systemd[1]: sshd-vsock@101-102-5:22-2:101.service: Deactivated successfully. worker1 # [ 566.981771] systemd[1]: session-115.scope: Deactivated successfully. worker1 # [ 566.984994] systemd[1]: session-115.scope: Consumed 28ms CPU time over 50ms wall clock time, 3.1M memory peak, 19.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 566.989696] systemd-logind[539]: Session 115 logged out. Waiting for processes to exit. worker1 # [ 566.990906] systemd-logind[539]: Removed session 115. ok test farm::serial::repeat_is_answered_from_the_cache_without_building ... worker1 # [ 567.861893] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 567.870303] systemd[1]: Started SSH per-connection Daemon (vsock:2:102). worker1 # [ 567.974120] sshd-session[3153]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 567.984191] sshd-session[3153]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 567.993621] sshd-session[3153]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 568.005336] systemd-logind[539]: New session '116' of user 'root' with class 'user' and type 'tty'. worker1 # [ 568.013779] systemd[1]: Started Session 116 of User root. worker1 # [ 568.047332] sshd-session[3159]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 568.050269] sshd-session[3159]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 568.051558] sshd-session[3153]: pam_unix(sshd:session): session closed for user root worker1 # [ 568.055843] systemd[1]: sshd-vsock@102-103-5:22-2:102.service: Deactivated successfully. worker1 # [ 568.061682] systemd[1]: session-116.scope: Deactivated successfully. worker1 # [ 568.065674] systemd-logind[539]: Session 116 logged out. Waiting for processes to exit. worker1 # [ 568.067608] systemd-logind[539]: Removed session 116. worker2 # [ 566.887459] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 566.895499] systemd[1]: Started SSH per-connection Daemon (vsock:2:62). worker2 # [ 566.994861] sshd-session[2756]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 567.003245] sshd-session[2756]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 567.014552] sshd-session[2756]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 567.024504] systemd-logind[515]: New session '79' of user 'root' with class 'user' and type 'tty'. worker2 # [ 567.036576] systemd[1]: Started Session 79 of User root. worker2 # [ 567.073342] sshd-session[2762]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 567.075028] sshd-session[2762]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 567.076773] sshd-session[2756]: pam_unix(sshd:session): session closed for user root worker2 # [ 567.081066] systemd[1]: sshd-vsock@62-63-6:22-2:62.service: Deactivated successfully. worker2 # [ 567.086717] systemd[1]: session-79.scope: Deactivated successfully. worker2 # [ 567.091370] systemd-logind[515]: Session 79 logged out. Waiting for processes to exit. worker2 # [ 567.093986] systemd-logind[515]: Removed session 79. lb # [ 572.379130] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 572.387110] systemd[1]: Started SSH per-connection Daemon (vsock:2:49). lb # [ 572.580657] sshd-session[2082]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 572.590780] sshd-session[2082]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 572.601377] sshd-session[2082]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 572.615514] systemd-logind[499]: New session '67' of user 'root' with class 'user' and type 'tty'. lb # [ 572.621974] systemd[1]: Started Session 67 of User root. lb # [ 572.662638] sshd-session[2088]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 572.664996] sshd-session[2088]: Disconnected from user root UNKNOWN port 65535 lb # [ 572.667059] sshd-session[2082]: pam_unix(sshd:session): session closed for user root lb # [ 572.671482] systemd[1]: sshd-vsock@49-50-4:22-2:49.service: Deactivated successfully. lb # [ 572.677858] systemd[1]: session-67.scope: Deactivated successfully. lb # [ 572.681181] systemd[1]: session-67.scope: Consumed 33ms CPU time over 61ms wall clock time, 7.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 572.686681] systemd-logind[499]: Session 67 logged out. Waiting for processes to exit. lb # [ 572.688540] systemd-logind[499]: Removed session 67. client # [ 571.893752] systemd[1]: Stopping User Manager for UID 0... client # [ 571.924159] systemd[2274]: Activating special unit Exit the Session... client # [ 571.929118] systemd[2274]: Stopped target Main User Target. client # [ 571.930529] systemd[2274]: Stopped target Basic System. client # [ 571.931716] systemd[2274]: Stopped target Paths. client # [ 571.935031] systemd[2274]: Stopped target Sockets. client # [ 571.936536] systemd[2274]: Stopped target Timers. client # [ 571.937716] systemd[2274]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 571.939376] systemd[2274]: Closed D-Bus User Message Bus Socket. client # [ 571.941063] systemd[2274]: Stopped Create User Files and Directories. client # [ 571.942502] systemd[2274]: Removed slice User Application Slice. client # [ 571.943841] systemd[2274]: Reached target Shutdown. client # [ 571.946079] systemd[2274]: Finished Exit the Session. client # [ 571.947276] systemd[2274]: Reached target Exit the Session. client # [ 571.970870] systemd-logind[427]: Removed session 86. client # [ 571.977304] systemd[1]: user@0.service: Deactivated successfully. client # [ 571.982594] systemd[1]: Stopped User Manager for UID 0. client # [ 572.042008] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 572.081183] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 572.086410] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 572.090501] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 575.198163] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 575.207625] systemd[1]: Started SSH per-connection Daemon (vsock:2:103). worker1 # [ 575.326438] sshd-session[3170]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 575.336338] sshd-session[3170]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 575.349068] sshd-session[3170]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 575.360582] systemd-logind[539]: New session '117' of user 'root' with class 'user' and type 'tty'. worker1 # [ 575.371340] systemd[1]: Started Session 117 of User root. worker1 # [ 575.412983] sshd-session[3176]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 575.415835] sshd-session[3176]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 575.418390] sshd-session[3170]: pam_unix(sshd:session): session closed for user root worker1 # [ 575.422712] systemd[1]: sshd-vsock@103-104-5:22-2:103.service: Deactivated successfully. worker1 # [ 575.429332] systemd[1]: session-117.scope: Deactivated successfully. worker1 # [ 575.433367] systemd[1]: session-117.scope: Consumed 32ms CPU time over 62ms wall clock time, 3.1M memory peak, 19.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 575.437716] systemd-logind[539]: Session 117 logged out. Waiting for processes to exit. worker1 # [ 575.439802] systemd-logind[539]: Removed session 117. [e2e] heartbeat t=480s client # [ 578.350262] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 578.358344] systemd[1]: Started SSH per-connection Daemon (vsock:2:76). client # [ 578.455231] sshd-session[2358]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 578.465168] sshd-session[2358]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 578.473532] sshd-session[2358]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 578.504122] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 578.543355] systemd-logind[427]: New session '91' of user 'root' with class 'user' and type 'tty'. client # [ 578.552106] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 578.558872] systemd[1]: Starting User Manager for UID 0... client # [ 578.586266] (systemd)[2367]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 578.591627] systemd-logind[427]: New session '92' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 578.680285] systemd[2367]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 578.778818] systemd[2367]: Queued start job for default target Main User Target. client # [ 578.789116] systemd[2367]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 578.792093] systemd[2367]: Created slice User Application Slice. client # [ 578.794804] systemd[2367]: Started Daily Cleanup of User's Temporary Directories. client # [ 578.795978] systemd[2367]: Reached target Paths. client # [ 578.797128] systemd[2367]: Reached target Timers. client # [ 578.799407] systemd[2367]: Starting D-Bus User Message Bus Socket... client # [ 578.801551] systemd[2367]: Starting Create User Files and Directories... client # [ 578.847604] systemd[2367]: Finished Create User Files and Directories. client # [ 578.851845] systemd[2367]: Listening on D-Bus User Message Bus Socket. client # [ 578.854201] systemd[2367]: Reached target Sockets. client # [ 578.855002] systemd[2367]: Reached target Basic System. client # [ 578.855780] systemd[2367]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 578.860524] systemd[2367]: Reached target Main User Target. client # [ 578.862168] systemd[2367]: Startup finished in 245ms. client # [ 578.862928] systemd[1]: Started User Manager for UID 0. client # [ 578.866755] systemd[1]: Started Session 91 of User root. worker2 # [ 577.334238] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 577.340957] systemd[2685]: Activating special unit Exit the Session... worker2 # [ 577.345619] systemd[2685]: Stopped target Main User Target. worker2 # [ 577.347234] systemd[2685]: Stopped target Basic System. worker2 # [ 577.351892] systemd[2685]: Stopped target Paths. worker2 # [ 577.353268] systemd[2685]: Stopped target Sockets. worker2 # [ 577.354198] systemd[2685]: Stopped target Timers. worker2 # [ 577.355198] systemd[2685]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 577.356737] systemd[2685]: Closed D-Bus User Message Bus Socket. worker2 # [ 577.357811] systemd[2685]: Stopped Create User Files and Directories. worker2 # [ 577.358970] systemd[2685]: Removed slice User Application Slice. worker2 # [ 577.360052] systemd[2685]: Reached target Shutdown. worker2 # [ 577.360955] systemd[2685]: Finished Exit the Session. worker2 # [ 577.361834] systemd[2685]: Reached target Exit the Session. worker2 # [ 577.390642] systemd-logind[515]: Removed session 76. worker2 # [ 577.399704] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 577.403121] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 577.422358] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 577.461872] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 577.467225] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 577.472701] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 579.051746] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44014 worker1 # [ 579.057222] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 580.359390] garage[898]: 2026-11-12T09:28:02.118079Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/9rr6p15riahlmkgcbf3kdjbdzf2ij8rl.narinfo lb # [ 580.359712] garage[898]: 2026-11-12T09:28:02.118532Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 580.370476] garage[898]: 2026-11-12T09:28:02.128816Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/akxj8fqwlmjcvzh225ihk2cy3w5qx1bl.narinfo lb # [ 580.376482] garage[898]: 2026-11-12T09:28:02.129272Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 580.380732] garage[898]: 2026-11-12T09:28:02.135087Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/fv70fgvb02ad9pk16v4cqs5pxb7g49ci.narinfo lb # [ 580.386162] garage[898]: 2026-11-12T09:28:02.135482Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 579.087331] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 580.393148] garage[898]: 2026-11-12T09:28:02.152534Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/9rr6p15riahlmkgcbf3kdjbdzf2ij8rl.narinfo lb # [ 580.397978] garage[898]: 2026-11-12T09:28:02.153018Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 580.403247] garage[898]: 2026-11-12T09:28:02.162232Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/9rr6p15riahlmkgcbf3kdjbdzf2ij8rl.narinfo lb # [ 580.408707] garage[898]: 2026-11-12T09:28:02.162655Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 577.562463] nix-grpc-daemon[1487]: ts=2026-11-12T09:28:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 580.421605] garage[898]: 2026-11-12T09:28:02.180856Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/akxj8fqwlmjcvzh225ihk2cy3w5qx1bl.narinfo lb # [ 580.426691] garage[898]: 2026-11-12T09:28:02.181432Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 580.432290] garage[898]: 2026-11-12T09:28:02.190855Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/akxj8fqwlmjcvzh225ihk2cy3w5qx1bl.narinfo lb # [ 580.437860] garage[898]: 2026-11-12T09:28:02.191266Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 577.589628] nix-grpc-daemon[1487]: ts=2026-11-12T09:28:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 580.448871] garage[898]: 2026-11-12T09:28:02.208209Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/fv70fgvb02ad9pk16v4cqs5pxb7g49ci.narinfo lb # [ 580.453242] garage[898]: 2026-11-12T09:28:02.208752Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 580.459025] garage[898]: 2026-11-12T09:28:02.217458Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/fv70fgvb02ad9pk16v4cqs5pxb7g49ci.narinfo lb # [ 580.464293] garage[898]: 2026-11-12T09:28:02.217962Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 577.616421] nix-grpc-daemon[1487]: ts=2026-11-12T09:28:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 580.477808] garage[898]: 2026-11-12T09:28:02.236953Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/1j6x0g5cw17jcxqfdac3gds6i3bcamsv.narinfo lb # [ 580.483816] garage[898]: 2026-11-12T09:28:02.237424Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 580.488256] garage[898]: 2026-11-12T09:28:02.242190Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/pjxk3s2a9kdzndkbimy95xzz4y2j99ff.narinfo lb # [ 580.493341] garage[898]: 2026-11-12T09:28:02.242565Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 579.196168] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 580.496509] garage[898]: 2026-11-12T09:28:02.242784Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/nb8icv679kyd6nr0i3d2l8j3xzx6jg6n.narinfo lb # [ 580.500554] garage[898]: 2026-11-12T09:28:02.242977Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 579.206598] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) worker1 # [ 579.226320] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) worker1 # [ 579.367408] nix-daemon[1059]: accepted connection from pid 3185, user nix-grpc-daemon (trusted) lb # [ 580.691681] niks3-server[1454]: 2026/11/12 09:28:02 INFO Received push request method=POST path=/api/pushes worker1 # [ 579.395673] nix-daemon[1059]: reaped child process 3188, status = succeeded worker1 # [ 579.399305] nix-grpc-daemon[2487]: time=2026-11-12T09:28:03.192Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker1 # [ 579.406436] nix-grpc-daemon[2487]: time=2026-11-12T09:28:03.195Z level=INFO msg="Uploading pjxk3s2a9kdzndkbimy95xzz4y2j99ff-farm-b.drv (632B)" worker1 # [ 579.408461] nix-grpc-daemon[2487]: time=2026-11-12T09:28:03.195Z level=INFO msg="Uploading 1j6x0g5cw17jcxqfdac3gds6i3bcamsv-farm-a.drv (520B)" worker1 # [ 579.410380] nix-grpc-daemon[2487]: time=2026-11-12T09:28:03.195Z level=INFO msg="Uploading nb8icv679kyd6nr0i3d2l8j3xzx6jg6n-farm-top.drv (760B)" lb # [ 580.703838] garage[898]: 2026-11-12T09:28:02.463043Z INFO garage_api_common::generic_server: 192.168.1.3:34162 PUT /farm/nar/0g97svw3ym0cbpjcs2ma64hscdc1g60par1n1andr2n8hwbhw4w5.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092802Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=12c815ceb1022934a92a9c287c73909e267a17fc8054320b05f20f4bd430c975 worker1 # [ 579.434032] nix-grpc-daemon[2487]: time=2026-11-12T09:28:03.227Z level=INFO msg="Uploading 3 narinfos" lb # [ 580.743158] garage[898]: 2026-11-12T09:28:02.474099Z INFO garage_api_common::generic_server: 192.168.1.3:34146 PUT /farm/nar/12gydfgr6c0gwgfnizcgc15kh97zpnm6izqgkyjq53kd70hfnlq2.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092802Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6ab06100ad868935a728efee4d1b3b12f4f9816f8a57bdf2a31a85ba91fd0b08 lb # [ 580.762459] garage[898]: 2026-11-12T09:28:02.475058Z INFO garage_api_common::generic_server: 192.168.1.3:34158 PUT /farm/nar/0bhnmppz9pk08fw6ghjgn4g37rr32i991q5qzw4q31w4cphvsaa0.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092802Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=64d8ab99465e54bd65566469ab6be06e5842bd51f00aa0e7a89eb4011aa0949d lb # [ 580.770442] garage[898]: 2026-11-12T09:28:02.475795Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/nb8icv679kyd6nr0i3d2l8j3xzx6jg6n.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092802Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6ab9187ba7f9ef55623a5efc2192959cc1262f902451903e87ab7ebbc3aa07c1 worker1 # [ 579.478930] nix-grpc-daemon[2487]: time=2026-11-12T09:28:03.272Z level=INFO msg="Upload complete. (239ms)" lb # [ 580.778850] garage[898]: 2026-11-12T09:28:02.476212Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/1j6x0g5cw17jcxqfdac3gds6i3bcamsv.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092802Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=67f2685c5b1a79209dfb641929d80151b2f0c4b79c48c8bcd51f85c26e237c18 lb # [ 580.786158] niks3-server[1454]: 2026/11/12 09:28:02 INFO Received sign narinfos request method=POST path=/api/pushes/61/sign worker1 # [ 579.485748] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=0 paths=3 nar_bytes_in=1912 lb # [ 580.788878] niks3-server[1454]: 2026/11/12 09:28:02 INFO Signed narinfos id=61 count=3 lb # [ 580.790809] niks3-server[1454]: 2026/11/12 09:28:02 INFO Registered completed upload object_key=nar/0g97svw3ym0cbpjcs2ma64hscdc1g60par1n1andr2n8hwbhw4w5.nar.zst lb # [ 580.794656] niks3-server[1454]: 2026/11/12 09:28:02 INFO Registered completed upload object_key=nb8icv679kyd6nr0i3d2l8j3xzx6jg6n.ls lb # [ 580.797465] niks3-server[1454]: 2026/11/12 09:28:02 INFO Registered completed upload object_key=nar/12gydfgr6c0gwgfnizcgc15kh97zpnm6izqgkyjq53kd70hfnlq2.nar.zst worker1 # [ 579.500990] nix-daemon[1059]: reaped child process 3181, status = succeeded lb # [ 580.800453] niks3-server[1454]: 2026/11/12 09:28:02 INFO Registered completed upload object_key=nar/0bhnmppz9pk08fw6ghjgn4g37rr32i991q5qzw4q31w4cphvsaa0.nar.zst lb # [ 580.803471] niks3-server[1454]: 2026/11/12 09:28:02 INFO Registered completed upload object_key=1j6x0g5cw17jcxqfdac3gds6i3bcamsv.ls lb # [ 580.806139] niks3-server[1454]: 2026/11/12 09:28:02 INFO Received complete push request method=POST path=/api/pushes/61/complete lb # [ 580.810544] niks3-server[1454]: 2026/11/12 09:28:02 INFO Registered completed upload object_key=pjxk3s2a9kdzndkbimy95xzz4y2j99ff.ls worker1 # [ 579.511260] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:03Z level=debug event=want client=7 drv=1j6x0g5cw17jcxqfdac3gds6i3bcamsv-farm-a.drv cached=0 lb # [ 580.812963] niks3-server[1454]: 2026/11/12 09:28:02 INFO Registered completed upload object_key=nb8icv679kyd6nr0i3d2l8j3xzx6jg6n.narinfo lb # [ 580.815608] niks3-server[1454]: 2026/11/12 09:28:02 INFO Registered completed upload object_key=pjxk3s2a9kdzndkbimy95xzz4y2j99ff.narinfo worker1 # [ 579.515668] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:03Z level=debug event=assigned drv=1j6x0g5cw17jcxqfdac3gds6i3bcamsv-farm-a.drv worker=192.168.1.3:50051 clients=1 lb # [ 580.818812] niks3-server[1454]: 2026/11/12 09:28:02 INFO Completed push id=61 objects=9 duration=24.93038ms lb # [ 580.821062] niks3-server[1454]: 2026/11/12 09:28:02 INFO Registered completed upload object_key=1j6x0g5cw17jcxqfdac3gds6i3bcamsv.narinfo worker1 # [ 579.524864] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 580.822974] garage[898]: 2026-11-12T09:28:02.476577Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/pjxk3s2a9kdzndkbimy95xzz4y2j99ff.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092802Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=22fe6328168c454367685cede61f4ab5d02241b588a3ccc9c17b34678cb99382 worker1 # [ 579.531502] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 580.830002] garage[898]: 2026-11-12T09:28:02.483171Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/nar/0g97svw3ym0cbpjcs2ma64hscdc1g60par1n1andr2n8hwbhw4w5.nar.zst lb # [ 580.833494] garage[898]: 2026-11-12T09:28:02.485934Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/nar/0bhnmppz9pk08fw6ghjgn4g37rr32i991q5qzw4q31w4cphvsaa0.nar.zst lb # [ 580.836931] garage[898]: 2026-11-12T09:28:02.486542Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/nar/12gydfgr6c0gwgfnizcgc15kh97zpnm6izqgkyjq53kd70hfnlq2.nar.zst lb # [ 580.840079] garage[898]: 2026-11-12T09:28:02.486869Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/nb8icv679kyd6nr0i3d2l8j3xzx6jg6n.ls worker1 # [ 579.543140] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 580.843487] garage[898]: 2026-11-12T09:28:02.491483Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/1j6x0g5cw17jcxqfdac3gds6i3bcamsv.ls lb # [ 580.846476] garage[898]: 2026-11-12T09:28:02.492078Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/pjxk3s2a9kdzndkbimy95xzz4y2j99ff.ls lb # [ 580.849448] garage[898]: 2026-11-12T09:28:02.494323Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/1j6x0g5cw17jcxqfdac3gds6i3bcamsv.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092802Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d8c3f718ebe22de6cc51c8cdbcab1fe2de3aeb1176740f343df933414590e2e1 lb # [ 580.855289] garage[898]: 2026-11-12T09:28:02.498715Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/nb8icv679kyd6nr0i3d2l8j3xzx6jg6n.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092802Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=183f6afe7c76a6a117821f75023f0a776e0d4d54ffaf29a64727dddad98da557 lb # [ 580.861044] garage[898]: 2026-11-12T09:28:02.499316Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/pjxk3s2a9kdzndkbimy95xzz4y2j99ff.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092802Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=79b635032df99e94b60b440cdf4cf66018b90d67c103412037af57b5b9afb8ff lb # [ 580.866819] garage[898]: 2026-11-12T09:28:02.515753Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/1j6x0g5cw17jcxqfdac3gds6i3bcamsv.narinfo lb # [ 580.870638] garage[898]: 2026-11-12T09:28:02.516270Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/nb8icv679kyd6nr0i3d2l8j3xzx6jg6n.narinfo lb # [ 580.873376] garage[898]: 2026-11-12T09:28:02.519539Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/pjxk3s2a9kdzndkbimy95xzz4y2j99ff.narinfo lb # [ 581.253479] garage[898]: 2026-11-12T09:28:03.012817Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/fv70fgvb02ad9pk16v4cqs5pxb7g49ci.narinfo lb # [ 581.258449] garage[898]: 2026-11-12T09:28:03.013266Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 580.392792] nix-daemon[1059]: reaped child process 3195, status = succeeded worker1 # [ 580.511172] nix-daemon[1059]: accepted connection from pid 3211, user nix-grpc-daemon (trusted) worker1 # [ 580.538513] nix-daemon[1059]: reaped child process 3214, status = succeeded lb # [ 581.839736] niks3-server[1454]: 2026/11/12 09:28:03 INFO Received push request method=POST path=/api/pushes worker1 # [ 580.548736] nix-grpc-daemon[2487]: time=2026-11-12T09:28:04.341Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 580.550352] nix-grpc-daemon[2487]: time=2026-11-12T09:28:04.341Z level=INFO msg="Uploading fv70fgvb02ad9pk16v4cqs5pxb7g49ci-farm-a (128B)" lb # [ 581.857052] garage[898]: 2026-11-12T09:28:03.615214Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/log/1j6x0g5cw17jcxqfdac3gds6i3bcamsv-farm-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092803Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2f6a3405a39fb36a6d34aa87d1e30284a7181ed0cb9c944dbe7ab0e4ba218787 worker1 # [ 580.575142] nix-grpc-daemon[2487]: time=2026-11-12T09:28:04.368Z level=INFO msg="Uploading 1 narinfos" lb # [ 581.878624] garage[898]: 2026-11-12T09:28:03.627497Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/log/1j6x0g5cw17jcxqfdac3gds6i3bcamsv-farm-a.drv lb # [ 581.889376] garage[898]: 2026-11-12T09:28:03.628023Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/nar/0qhfs9pr5xxfizcwpqh96c0jbca9mjh8rbm67b485msx8p2v3n0k.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092803Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ed3af921832420511b600f5f7ef1c16e0230695959fcee1440513413e9c345c5 lb # [ 581.900491] garage[898]: 2026-11-12T09:28:03.629801Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/fv70fgvb02ad9pk16v4cqs5pxb7g49ci.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092803Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f828e0ea37d8b4e63e6f7bd666ced7d7dbda65000268d337569bb4f89994a99e worker1 # [ 580.610232] nix-grpc-daemon[2487]: time=2026-11-12T09:28:04.404Z level=INFO msg="Upload complete. (253ms)" lb # [ 581.910428] garage[898]: 2026-11-12T09:28:03.634682Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/nar/0qhfs9pr5xxfizcwpqh96c0jbca9mjh8rbm67b485msx8p2v3n0k.nar.zst worker1 # [ 580.618185] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=1 drv=1j6x0g5cw17jcxqfdac3gds6i3bcamsv-farm-a.drv assign_id=16 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 581.917228] garage[898]: 2026-11-12T09:28:03.636281Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/fv70fgvb02ad9pk16v4cqs5pxb7g49ci.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092803Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=41e38a09c7a6a70c533624e9421d96b435594b9f422fb88b463c915ea5ab8348 lb # [ 581.926772] niks3-server[1454]: 2026/11/12 09:28:03 INFO Registered completed upload object_key=log/1j6x0g5cw17jcxqfdac3gds6i3bcamsv-farm-a.drv lb # [ 581.929985] niks3-server[1454]: 2026/11/12 09:28:03 INFO Received sign narinfos request method=POST path=/api/pushes/62/sign lb # [ 581.932962] niks3-server[1454]: 2026/11/12 09:28:03 INFO Signed narinfos id=62 count=1 worker1 # [ 580.635816] nix-daemon[1059]: reaped child process 3193, status = succeeded lb # [ 581.934708] niks3-server[1454]: 2026/11/12 09:28:03 INFO Registered completed upload object_key=nar/0qhfs9pr5xxfizcwpqh96c0jbca9mjh8rbm67b485msx8p2v3n0k.nar.zst lb # [ 581.939245] niks3-server[1454]: 2026/11/12 09:28:03 INFO Received complete push request method=POST path=/api/pushes/62/complete worker1 # [ 580.639670] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:04Z level=debug event=want client=7 drv=pjxk3s2a9kdzndkbimy95xzz4y2j99ff-farm-b.drv cached=0 lb # [ 581.941853] niks3-server[1454]: 2026/11/12 09:28:03 INFO Registered completed upload object_key=fv70fgvb02ad9pk16v4cqs5pxb7g49ci.narinfo worker1 # [ 580.643647] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:04Z level=debug event=assigned drv=pjxk3s2a9kdzndkbimy95xzz4y2j99ff-farm-b.drv worker=192.168.1.3:50051 clients=1 lb # [ 581.945023] niks3-server[1454]: 2026/11/12 09:28:03 INFO Completed push id=62 objects=4 duration=24.16948ms lb # [ 581.948050] niks3-server[1454]: 2026/11/12 09:28:03 INFO Registered completed upload object_key=fv70fgvb02ad9pk16v4cqs5pxb7g49ci.ls worker1 # [ 580.649125] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 581.950619] garage[898]: 2026-11-12T09:28:03.644453Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/fv70fgvb02ad9pk16v4cqs5pxb7g49ci.ls lb # [ 581.954843] garage[898]: 2026-11-12T09:28:03.645973Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/fv70fgvb02ad9pk16v4cqs5pxb7g49ci.narinfo worker1 # [ 580.658548] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) worker1 # [ 580.670987] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 582.619713] garage[898]: 2026-11-12T09:28:04.378885Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/akxj8fqwlmjcvzh225ihk2cy3w5qx1bl.narinfo lb # [ 582.619964] garage[898]: 2026-11-12T09:28:04.379498Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 582.805691] systemd[1]: Stopping User Manager for UID 0... lb # [ 582.813292] systemd[2053]: Activating special unit Exit the Session... lb # [ 582.820801] systemd[2053]: Stopped target Main User Target. lb # [ 582.822319] systemd[2053]: Stopped target Basic System. lb # [ 582.823551] systemd[2053]: Stopped target Paths. lb # [ 582.828756] systemd[2053]: Stopped target Sockets. lb # [ 582.829984] systemd[2053]: Stopped target Timers. lb # [ 582.831072] systemd[2053]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 582.833587] systemd[2053]: Closed D-Bus User Message Bus Socket. lb # [ 582.835128] systemd[2053]: Stopped Create User Files and Directories. lb # [ 582.836790] systemd[2053]: Removed slice User Application Slice. lb # [ 582.838154] systemd[2053]: Reached target Shutdown. lb # [ 582.839299] systemd[2053]: Finished Exit the Session. lb # [ 582.840942] systemd[2053]: Reached target Exit the Session. lb # [ 582.868495] systemd-logind[499]: Removed session 65. lb # [ 582.874355] systemd[1]: user@0.service: Deactivated successfully. lb # [ 582.877299] systemd[1]: Stopped User Manager for UID 0. lb # [ 582.943764] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 582.982359] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 582.987714] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 582.993615] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 581.704438] nix-daemon[1059]: reaped child process 3221, status = succeeded worker1 # [ 581.818141] nix-daemon[1059]: accepted connection from pid 3237, user nix-grpc-daemon (trusted) worker1 # [ 581.843868] nix-daemon[1059]: reaped child process 3240, status = succeeded lb # [ 583.145143] niks3-server[1454]: 2026/11/12 09:28:04 INFO Received push request method=POST path=/api/pushes worker1 # [ 581.856085] nix-grpc-daemon[2487]: time=2026-11-12T09:28:05.646Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 581.857753] nix-grpc-daemon[2487]: time=2026-11-12T09:28:05.646Z level=INFO msg="Uploading akxj8fqwlmjcvzh225ihk2cy3w5qx1bl-farm-b (184B)" lb # [ 583.156670] garage[898]: 2026-11-12T09:28:04.915316Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/log/pjxk3s2a9kdzndkbimy95xzz4y2j99ff-farm-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092804Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0b0dd78fb78788d4b84cad652e5eedf01f6b1a800ebd4f8483f57e5c70f54c5e worker1 # [ 581.875204] nix-grpc-daemon[2487]: time=2026-11-12T09:28:05.668Z level=INFO msg="Uploading 1 narinfos" lb # [ 583.180958] garage[898]: 2026-11-12T09:28:04.926504Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/akxj8fqwlmjcvzh225ihk2cy3w5qx1bl.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092804Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b09810330b9d8315f9c9ec05dc85dcc1948ddc12d427d5f137a420a57bd7acb3 lb # [ 583.189746] garage[898]: 2026-11-12T09:28:04.926965Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/nar/06dxyx6m40nb25bclwnljvxfj1mkh59ma1nkx1kdwd6wlpmrz5i7.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092804Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91847b2a187b125997edce62257a8805464a59d999659b53f08a02597bdc97de lb # [ 583.202878] garage[898]: 2026-11-12T09:28:04.929827Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/nar/06dxyx6m40nb25bclwnljvxfj1mkh59ma1nkx1kdwd6wlpmrz5i7.nar.zst lb # [ 583.207872] garage[898]: 2026-11-12T09:28:04.930897Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/log/pjxk3s2a9kdzndkbimy95xzz4y2j99ff-farm-b.drv worker1 # [ 581.913491] nix-grpc-daemon[2487]: time=2026-11-12T09:28:05.707Z level=INFO msg="Upload complete. (225ms)" lb # [ 583.213229] garage[898]: 2026-11-12T09:28:04.932698Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/akxj8fqwlmjcvzh225ihk2cy3w5qx1bl.ls worker1 # [ 581.921006] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=1 drv=pjxk3s2a9kdzndkbimy95xzz4y2j99ff-farm-b.drv assign_id=17 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 583.218727] garage[898]: 2026-11-12T09:28:04.935083Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/akxj8fqwlmjcvzh225ihk2cy3w5qx1bl.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092804Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4887b4818e673835fcc1a7ce8bf03224a14667db6789aef192e4b8bcda01d81d lb # [ 583.228361] niks3-server[1454]: 2026/11/12 09:28:04 INFO Received sign narinfos request method=POST path=/api/pushes/63/sign lb # [ 583.230660] niks3-server[1454]: 2026/11/12 09:28:04 INFO Signed narinfos id=63 count=1 lb # [ 583.232371] niks3-server[1454]: 2026/11/12 09:28:04 INFO Registered completed upload object_key=log/pjxk3s2a9kdzndkbimy95xzz4y2j99ff-farm-b.drv lb # [ 583.234769] niks3-server[1454]: 2026/11/12 09:28:04 INFO Received complete push request method=POST path=/api/pushes/63/complete worker1 # [ 581.938247] nix-daemon[1059]: reaped child process 3219, status = succeeded lb # [ 583.236898] niks3-server[1454]: 2026/11/12 09:28:04 INFO Registered completed upload object_key=nar/06dxyx6m40nb25bclwnljvxfj1mkh59ma1nkx1kdwd6wlpmrz5i7.nar.zst lb # [ 583.239643] niks3-server[1454]: 2026/11/12 09:28:04 INFO Registered completed upload object_key=akxj8fqwlmjcvzh225ihk2cy3w5qx1bl.narinfo lb # [ 583.242203] niks3-server[1454]: 2026/11/12 09:28:04 INFO Registered completed upload object_key=akxj8fqwlmjcvzh225ihk2cy3w5qx1bl.ls lb # [ 583.245832] niks3-server[1454]: 2026/11/12 09:28:04 INFO Completed push id=63 objects=8 duration=34.02196ms worker1 # [ 581.946461] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:05Z level=debug event=want client=7 drv=nb8icv679kyd6nr0i3d2l8j3xzx6jg6n-farm-top.drv cached=0 lb # [ 583.247736] garage[898]: 2026-11-12T09:28:04.940054Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/akxj8fqwlmjcvzh225ihk2cy3w5qx1bl.narinfo worker1 # [ 581.950469] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:05Z level=debug event=assigned drv=nb8icv679kyd6nr0i3d2l8j3xzx6jg6n-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 581.955892] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 worker1 # [ 581.965371] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) worker1 # [ 581.979998] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 584.101230] garage[898]: 2026-11-12T09:28:05.860558Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/9rr6p15riahlmkgcbf3kdjbdzf2ij8rl.narinfo lb # [ 584.101557] garage[898]: 2026-11-12T09:28:05.861001Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 583.225964] nix-daemon[1059]: reaped child process 3247, status = succeeded worker1 # [ 583.344649] nix-daemon[1059]: accepted connection from pid 3263, user nix-grpc-daemon (trusted) lb # [ 584.668700] niks3-server[1454]: 2026/11/12 09:28:06 INFO Received push request method=POST path=/api/pushes worker1 # [ 583.372847] nix-daemon[1059]: reaped child process 3266, status = succeeded worker1 # [ 583.378478] nix-grpc-daemon[2487]: time=2026-11-12T09:28:07.171Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 583.380253] nix-grpc-daemon[2487]: time=2026-11-12T09:28:07.171Z level=INFO msg="Uploading 9rr6p15riahlmkgcbf3kdjbdzf2ij8rl-farm-top (232B)" lb # [ 584.679005] garage[898]: 2026-11-12T09:28:06.437807Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/log/nb8icv679kyd6nr0i3d2l8j3xzx6jg6n-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092806Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b0fae70dbb94800185c696de8c413f3f472fdce58bfab661164f0cce83a4375 worker1 # [ 583.398427] nix-grpc-daemon[2487]: time=2026-11-12T09:28:07.191Z level=INFO msg="Uploading 1 narinfos" lb # [ 584.704849] garage[898]: 2026-11-12T09:28:06.449295Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/9rr6p15riahlmkgcbf3kdjbdzf2ij8rl.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092806Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=318374c623bd48a54fd1c1a44f33fe6be25c3242be6949374f6a82878f44c2ac lb # [ 584.713890] garage[898]: 2026-11-12T09:28:06.449779Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/nar/1kb9gg8zm3il3fjisd70mvrlx33qmmpvwi1mmi1fgdmjswz7m83l.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092806Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=84336d9017bdd529a1be73c0a522bc30b1786f5d4c1cb7932788d632da845245 lb # [ 584.726693] garage[898]: 2026-11-12T09:28:06.453264Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/9rr6p15riahlmkgcbf3kdjbdzf2ij8rl.ls lb # [ 584.734493] garage[898]: 2026-11-12T09:28:06.454789Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/nar/1kb9gg8zm3il3fjisd70mvrlx33qmmpvwi1mmi1fgdmjswz7m83l.nar.zst lb # [ 584.739653] garage[898]: 2026-11-12T09:28:06.458317Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/9rr6p15riahlmkgcbf3kdjbdzf2ij8rl.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092806Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a501e76854137ee67e61e1815e0684ee539a5c8e677c7a6a4c764d1aa8288d23 lb # [ 584.750393] garage[898]: 2026-11-12T09:28:06.460167Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/log/nb8icv679kyd6nr0i3d2l8j3xzx6jg6n-farm-top.drv worker1 # [ 583.457267] nix-grpc-daemon[2487]: time=2026-11-12T09:28:07.251Z level=INFO msg="Upload complete. (266ms)" lb # [ 584.758056] niks3-server[1454]: 2026/11/12 09:28:06 INFO Received sign narinfos request method=POST path=/api/pushes/64/sign lb # [ 584.761085] niks3-server[1454]: 2026/11/12 09:28:06 INFO Signed narinfos id=64 count=1 lb # [ 584.763795] niks3-server[1454]: 2026/11/12 09:28:06 INFO Received complete push request method=POST path=/api/pushes/64/complete lb # [ 584.766898] niks3-server[1454]: 2026/11/12 09:28:06 INFO Registered completed upload object_key=log/nb8icv679kyd6nr0i3d2l8j3xzx6jg6n-farm-top.drv lb # [ 584.770215] niks3-server[1454]: 2026/11/12 09:28:06 INFO Registered completed upload object_key=9rr6p15riahlmkgcbf3kdjbdzf2ij8rl.ls worker1 # [ 583.468724] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=1 drv=nb8icv679kyd6nr0i3d2l8j3xzx6jg6n-farm-top.drv assign_id=18 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 584.773365] niks3-server[1454]: 2026/11/12 09:28:06 INFO Registered completed upload object_key=nar/1kb9gg8zm3il3fjisd70mvrlx33qmmpvwi1mmi1fgdmjswz7m83l.nar.zst lb # [ 584.776188] niks3-server[1454]: 2026/11/12 09:28:06 INFO Completed push id=64 objects=12 duration=55.42014ms lb # [ 584.778214] garage[898]: 2026-11-12T09:28:06.493209Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/9rr6p15riahlmkgcbf3kdjbdzf2ij8rl.narinfo lb # [ 584.781911] niks3-server[1454]: 2026/11/12 09:28:06 INFO Registered completed upload object_key=9rr6p15riahlmkgcbf3kdjbdzf2ij8rl.narinfo worker1 # [ 583.482808] nix-daemon[1059]: reaped child process 3245, status = succeeded client # [ 583.493311] sshd-session[2380]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 583.493688] sshd-session[2380]: Disconnected from user root UNKNOWN port 65535 client # [ 583.498979] sshd-session[2358]: pam_unix(sshd:session): session closed for user root client # [ 583.505984] systemd[1]: sshd-vsock@76-77-3:22-2:76.service: Deactivated successfully. client # [ 583.514191] systemd[1]: session-91.scope: Deactivated successfully. client # [ 583.518625] systemd[1]: session-91.scope: Consumed 202ms CPU time over 4.651s wall clock time, 42.3M memory peak, 12.4K incoming IP traffic, 13.8K outgoing IP traffic. client # [ 583.526597] systemd-logind[427]: Session 91 logged out. Waiting for processes to exit. client # [ 583.528874] systemd-logind[427]: Removed session 91. client # [ 584.533309] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 584.540722] systemd[1]: Started SSH per-connection Daemon (vsock:2:77). client # [ 584.641070] sshd-session[2399]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 584.651002] sshd-session[2399]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 584.659728] sshd-session[2399]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 584.670828] systemd-logind[427]: New session '93' of user 'root' with class 'user' and type 'tty'. client # [ 584.676640] systemd[1]: Started Session 93 of User root. client # [ 584.817981] sshd-session[2405]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 584.820419] sshd-session[2405]: Disconnected from user root UNKNOWN port 65535 client # [ 584.822011] sshd-session[2399]: pam_unix(sshd:session): session closed for user root client # [ 584.826132] systemd[1]: sshd-vsock@77-78-3:22-2:77.service: Deactivated successfully. client # [ 584.831597] systemd[1]: session-93.scope: Deactivated successfully. client # [ 584.836761] systemd-logind[427]: Session 93 logged out. Waiting for processes to exit. client # [ 584.839055] systemd-logind[427]: Removed session 93. lb # [ 586.329889] envoy[897]: conn peer=[2001:db8:1::1]:49734 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=6361 tx=3993 ms=4435 worker1 # [ 585.538555] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 585.548744] systemd[2922]: Activating special unit Exit the Session... worker1 # [ 585.550407] systemd[2922]: Stopped target Main User Target. worker1 # [ 585.551749] systemd[2922]: Stopped target Basic System. worker1 # [ 585.559388] systemd[2922]: Stopped target Paths. worker1 # [ 585.562007] systemd[2922]: Stopped target Sockets. worker1 # [ 585.563130] systemd[2922]: Stopped target Timers. worker1 # [ 585.564348] systemd[2922]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 585.565988] systemd[2922]: Closed D-Bus User Message Bus Socket. worker1 # [ 585.567355] systemd[2922]: Stopped Create User Files and Directories. worker1 # [ 585.568870] systemd[2922]: Removed slice User Application Slice. worker1 # [ 585.570231] systemd[2922]: Reached target Shutdown. worker1 # [ 585.571346] systemd[2922]: Finished Exit the Session. worker1 # [ 585.572975] systemd[2922]: Reached target Exit the Session. worker1 # [ 585.590029] systemd-logind[539]: Removed session 101. worker1 # [ 585.598115] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 585.601399] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 585.618223] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 585.661672] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 585.665392] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 585.671516] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 586.358346] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 586.366611] systemd[1]: Started SSH per-connection Daemon (vsock:2:104). worker1 # [ 586.471160] sshd-session[3272]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 586.482187] sshd-session[3272]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 586.491808] sshd-session[3272]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 586.513934] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 586.521799] systemd-logind[539]: New session '118' of user 'root' with class 'user' and type 'tty'. worker1 # [ 586.554837] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 586.563404] systemd[1]: Starting User Manager for UID 0... worker1 # [ 586.590845] (systemd)[3280]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 586.598330] systemd-logind[539]: New session '119' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 586.690691] systemd[3280]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 586.790689] systemd[3280]: Queued start job for default target Main User Target. worker1 # [ 586.801133] systemd[3280]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 586.805413] systemd[3280]: Created slice User Application Slice. worker1 # [ 586.806452] systemd[3280]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 586.807519] systemd[3280]: Reached target Paths. worker1 # [ 586.811000] systemd[3280]: Reached target Timers. worker1 # [ 586.811793] systemd[3280]: Starting D-Bus User Message Bus Socket... worker1 # [ 586.816261] systemd[3280]: Starting Create User Files and Directories... worker1 # [ 586.862907] systemd[3280]: Finished Create User Files and Directories. worker1 # [ 586.864943] systemd[3280]: Listening on D-Bus User Message Bus Socket. worker1 # [ 586.865950] systemd[3280]: Reached target Sockets. worker1 # [ 586.866696] systemd[3280]: Reached target Basic System. worker1 # [ 586.867478] systemd[3280]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 586.876461] systemd[3280]: Reached target Main User Target. worker1 # [ 586.877397] systemd[3280]: Startup finished in 250ms. worker1 # [ 586.878153] systemd[1]: Started User Manager for UID 0. worker1 # [ 586.878923] systemd[1]: Started Session 118 of User root. worker1 # [ 587.084294] nix-daemon[1059]: reaped child process 3183, status = failed due to signal 9 (Killed) worker1 # [ 587.259814] sshd-session[3293]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 587.261858] sshd-session[3293]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 587.263994] sshd-session[3272]: pam_unix(sshd:session): session closed for user root worker1 # [ 587.269192] systemd[1]: sshd-vsock@104-105-5:22-2:104.service: Deactivated successfully. worker1 # [ 587.274465] systemd[1]: session-118.scope: Deactivated successfully. worker1 # [ 587.279031] systemd-logind[539]: Session 118 logged out. Waiting for processes to exit. worker1 # [ 587.282110] systemd-logind[539]: Removed session 118. worker2 # [ 586.832707] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 586.840797] systemd[1]: Started SSH per-connection Daemon (vsock:2:63). worker2 # [ 586.940561] sshd-session[2772]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 586.949047] sshd-session[2772]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 586.959492] sshd-session[2772]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 586.976308] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 586.988499] systemd-logind[515]: New session '80' of user 'root' with class 'user' and type 'tty'. worker2 # [ 587.013312] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 587.019843] systemd[1]: Starting User Manager for UID 0... worker2 # [ 587.046152] (systemd)[2780]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 587.052136] systemd-logind[515]: New session '81' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 587.144757] systemd[2780]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 587.242996] systemd[2780]: Queued start job for default target Main User Target. worker2 # [ 587.253060] systemd[2780]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 587.257379] systemd[2780]: Created slice User Application Slice. worker2 # [ 587.258420] systemd[2780]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 587.259605] systemd[2780]: Reached target Paths. worker2 # [ 587.263221] systemd[2780]: Reached target Timers. worker2 # [ 587.265465] systemd[2780]: Starting D-Bus User Message Bus Socket... worker2 # [ 587.266438] systemd[2780]: Starting Create User Files and Directories... worker2 # [ 587.307117] systemd[2780]: Finished Create User Files and Directories. worker2 # [ 587.311490] systemd[2780]: Listening on D-Bus User Message Bus Socket. worker2 # [ 587.316392] systemd[2780]: Reached target Sockets. worker2 # [ 587.317238] systemd[2780]: Reached target Basic System. worker2 # [ 587.318019] systemd[2780]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 587.319492] systemd[2780]: Reached target Main User Target. worker2 # [ 587.320861] systemd[2780]: Startup finished in 245ms. worker2 # [ 587.321696] systemd[1]: Started User Manager for UID 0. worker2 # [ 587.328949] systemd[1]: Started Session 80 of User root. worker2 # [ 587.730853] sshd-session[2793]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 587.732797] sshd-session[2793]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 587.735065] sshd-session[2772]: pam_unix(sshd:session): session closed for user root worker2 # [ 587.739973] systemd[1]: sshd-vsock@63-64-6:22-2:63.service: Deactivated successfully. worker2 # [ 587.745443] systemd[1]: session-80.scope: Deactivated successfully. worker2 # [ 587.749876] systemd-logind[515]: Session 80 logged out. Waiting for processes to exit. worker2 # [ 587.752515] systemd-logind[515]: Removed session 80. worker1 # [ 592.213814] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 592.223329] systemd[1]: Started SSH per-connection Daemon (vsock:2:105). worker1 # [ 592.319778] sshd-session[3308]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 592.328296] sshd-session[3308]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 592.339195] sshd-session[3308]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 592.348534] systemd-logind[539]: New session '120' of user 'root' with class 'user' and type 'tty'. worker1 # [ 592.361597] systemd[1]: Started Session 120 of User root. worker1 # [ 592.398213] sshd-session[3314]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 592.401216] sshd-session[3314]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 592.403143] sshd-session[3308]: pam_unix(sshd:session): session closed for user root worker1 # [ 592.407756] systemd[1]: sshd-vsock@105-106-5:22-2:105.service: Deactivated successfully. worker1 # [ 592.413284] systemd[1]: session-120.scope: Deactivated successfully. worker1 # [ 592.415018] systemd[1]: session-120.scope: Consumed 29ms CPU time over 54ms wall clock time, 5.1M memory peak, 19.1K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 592.421571] systemd-logind[539]: Session 120 logged out. Waiting for processes to exit. worker1 # [ 592.422824] systemd-logind[539]: Removed session 120. worker1 # [ 593.150265] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 593.158347] systemd[1]: Started SSH per-connection Daemon (vsock:2:106). worker1 # [ 593.258852] sshd-session[3319]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 593.269092] sshd-session[3319]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 593.278821] sshd-session[3319]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 593.288130] systemd-logind[539]: New session '121' of user 'root' with class 'user' and type 'tty'. worker1 # [ 593.297728] systemd[1]: Started Session 121 of User root. worker1 # [ 593.332744] sshd-session[3325]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 593.334780] sshd-session[3325]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 593.336759] sshd-session[3319]: pam_unix(sshd:session): session closed for user root worker1 # [ 593.340893] systemd[1]: sshd-vsock@106-107-5:22-2:106.service: Deactivated successfully. worker1 # [ 593.345745] systemd[1]: session-121.scope: Deactivated successfully. worker1 # [ 593.349398] systemd[1]: session-121.scope: Consumed 28ms CPU time over 50ms wall clock time, 3.1M memory peak, 19.1K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 593.352817] systemd-logind[539]: Session 121 logged out. Waiting for processes to exit. worker1 # [ 593.354628] systemd-logind[539]: Removed session 121. worker1 # [ 594.210966] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 594.218891] systemd[1]: Started SSH per-connection Daemon (vsock:2:107). worker1 # [ 594.320540] sshd-session[3330]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 594.328811] sshd-session[3330]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 594.339815] sshd-session[3330]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 594.351644] systemd-logind[539]: New session '122' of user 'root' with class 'user' and type 'tty'. worker1 # [ 594.357062] systemd[1]: Started Session 122 of User root. worker1 # [ 594.396210] sshd-session[3336]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 594.397958] sshd-session[3336]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 594.400251] sshd-session[3330]: pam_unix(sshd:session): session closed for user root worker1 # [ 594.405011] systemd[1]: sshd-vsock@107-108-5:22-2:107.service: Deactivated successfully. worker1 # [ 594.410727] systemd[1]: session-122.scope: Deactivated successfully. worker1 # [ 594.414181] systemd[1]: session-122.scope: Consumed 30ms CPU time over 55ms wall clock time, 3.1M memory peak, 19.1K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 594.419680] systemd-logind[539]: Session 122 logged out. Waiting for processes to exit. worker1 # [ 594.421274] systemd-logind[539]: Removed session 122. client # [ 594.895429] systemd[1]: Stopping User Manager for UID 0... client # [ 594.900894] systemd[2367]: Activating special unit Exit the Session... client # [ 594.906996] systemd[2367]: Stopped target Main User Target. client # [ 594.911209] systemd[2367]: Stopped target Basic System. client # [ 594.912860] systemd[2367]: Stopped target Paths. client # [ 594.913947] systemd[2367]: Stopped target Sockets. client # [ 594.915042] systemd[2367]: Stopped target Timers. client # [ 594.916373] systemd[2367]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 594.918020] systemd[2367]: Closed D-Bus User Message Bus Socket. client # [ 594.919378] systemd[2367]: Stopped Create User Files and Directories. client # [ 594.921025] systemd[2367]: Removed slice User Application Slice. client # [ 594.922390] systemd[2367]: Reached target Shutdown. client # [ 594.923518] systemd[2367]: Finished Exit the Session. client # [ 594.925370] systemd[2367]: Reached target Exit the Session. client # [ 594.949876] systemd-logind[427]: Removed session 92. client # [ 594.957026] systemd[1]: user@0.service: Deactivated successfully. client # [ 594.962316] systemd[1]: Stopped User Manager for UID 0. client # [ 595.021969] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 595.060443] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 595.065851] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 595.069836] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 594.137633] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 594.145626] systemd[1]: Started SSH per-connection Daemon (vsock:2:64). worker2 # [ 594.242910] sshd-session[2807]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 594.252904] sshd-session[2807]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 594.262536] sshd-session[2807]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 594.272509] systemd-logind[515]: New session '82' of user 'root' with class 'user' and type 'tty'. worker2 # [ 594.285599] systemd[1]: Started Session 82 of User root. worker2 # [ 594.323920] sshd-session[2813]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 594.327008] sshd-session[2813]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 594.328644] sshd-session[2807]: pam_unix(sshd:session): session closed for user root worker2 # [ 594.333479] systemd[1]: sshd-vsock@64-65-6:22-2:64.service: Deactivated successfully. worker2 # [ 594.338556] systemd[1]: session-82.scope: Deactivated successfully. worker2 # [ 594.340484] systemd[1]: session-82.scope: Consumed 30ms CPU time over 55ms wall clock time, 4.8M memory peak, 13.1K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 594.345867] systemd-logind[515]: Session 82 logged out. Waiting for processes to exit. worker2 # [ 594.348339] systemd-logind[515]: Removed session 82. worker2 # [ 595.009935] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 595.017803] systemd[1]: Started SSH per-connection Daemon (vsock:2:65). worker2 # [ 595.116594] sshd-session[2818]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 595.126323] sshd-session[2818]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 595.135860] sshd-session[2818]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 595.147491] systemd-logind[515]: New session '83' of user 'root' with class 'user' and type 'tty'. worker2 # [ 595.152913] systemd[1]: Started Session 83 of User root. worker2 # [ 595.189877] sshd-session[2824]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 595.192631] sshd-session[2824]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 595.194032] sshd-session[2818]: pam_unix(sshd:session): session closed for user root worker2 # [ 595.198771] systemd[1]: sshd-vsock@65-66-6:22-2:65.service: Deactivated successfully. worker2 # [ 595.203894] systemd[1]: session-83.scope: Deactivated successfully. worker2 # [ 595.207514] systemd[1]: session-83.scope: Consumed 28ms CPU time over 52ms wall clock time, 4.8M memory peak, 13.1K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 595.212195] systemd-logind[515]: Session 83 logged out. Waiting for processes to exit. worker2 # [ 595.213388] systemd-logind[515]: Removed session 83. worker2 # [ 595.977173] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 595.985810] systemd[1]: Started SSH per-connection Daemon (vsock:2:66). worker2 # [ 596.083517] sshd-session[2829]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 596.092325] sshd-session[2829]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 596.103020] sshd-session[2829]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 596.111827] systemd-logind[515]: New session '84' of user 'root' with class 'user' and type 'tty'. worker2 # [ 596.118105] systemd[1]: Started Session 84 of User root. worker2 # [ 596.151297] sshd-session[2835]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 596.154019] sshd-session[2835]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 596.156089] sshd-session[2829]: pam_unix(sshd:session): session closed for user root worker2 # [ 596.160521] systemd[1]: sshd-vsock@66-67-6:22-2:66.service: Deactivated successfully. worker2 # [ 596.165574] systemd[1]: session-84.scope: Deactivated successfully. worker2 # [ 596.169287] systemd[1]: session-84.scope: Consumed 27ms CPU time over 50ms wall clock time, 3.1M memory peak, 13.1K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 596.173525] systemd-logind[515]: Session 84 logged out. Waiting for processes to exit. worker2 # [ 596.174775] systemd-logind[515]: Removed session 84. client # [ 599.160144] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 599.165796] systemd[1]: Started SSH per-connection Daemon (vsock:2:78). client # [ 599.262874] sshd-session[2417]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 599.272308] sshd-session[2417]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 599.281125] sshd-session[2417]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 599.312701] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 599.347483] systemd-logind[427]: New session '94' of user 'root' with class 'user' and type 'tty'. client # [ 599.359190] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 599.366028] systemd[1]: Starting User Manager for UID 0... client # [ 599.393125] (systemd)[2426]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 599.399268] systemd-logind[427]: New session '95' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 599.489364] systemd[2426]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 599.587722] systemd[2426]: Queued start job for default target Main User Target. client # [ 599.597038] systemd[2426]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 599.600262] systemd[2426]: Created slice User Application Slice. client # [ 599.601379] systemd[2426]: Started Daily Cleanup of User's Temporary Directories. client # [ 599.602440] systemd[2426]: Reached target Paths. client # [ 599.603115] systemd[2426]: Reached target Timers. client # [ 599.606756] systemd[2426]: Starting D-Bus User Message Bus Socket... client # [ 599.608660] systemd[2426]: Starting Create User Files and Directories... client # [ 599.646626] systemd[2426]: Finished Create User Files and Directories. client # [ 599.651158] systemd[2426]: Listening on D-Bus User Message Bus Socket. client # [ 599.653664] systemd[2426]: Reached target Sockets. client # [ 599.654534] systemd[2426]: Reached target Basic System. client # [ 599.655392] systemd[2426]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 599.659920] systemd[2426]: Reached target Main User Target. client # [ 599.661033] systemd[2426]: Startup finished in 239ms. client # [ 599.661826] systemd[1]: Started User Manager for UID 0. client # [ 599.666818] systemd[1]: Started Session 94 of User root. worker1 # [ 599.838473] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 601.144533] garage[898]: 2026-11-12T09:28:22.902685Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/9rr6p15riahlmkgcbf3kdjbdzf2ij8rl.narinfo lb # [ 601.153532] garage[898]: 2026-11-12T09:28:22.912424Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) GET /farm/9rr6p15riahlmkgcbf3kdjbdzf2ij8rl.narinfo worker1 # [ 599.864819] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44014 worker1 # [ 599.873910] nix-grpc-daemon[2487]: time=2026-11-12T09:28:23.667Z level=INFO msg="All 2 paths already cached" client # [ 599.895046] sshd-session[2439]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 599.897219] sshd-session[2439]: Disconnected from user root UNKNOWN port 65535 client # [ 599.899264] sshd-session[2417]: pam_unix(sshd:session): session closed for user root client # [ 599.905341] systemd[1]: sshd-vsock@78-79-3:22-2:78.service: Deactivated successfully. client # [ 599.909468] systemd[1]: session-94.scope: Deactivated successfully. client # [ 599.913649] systemd[1]: session-94.scope: Consumed 163ms CPU time over 246ms wall clock time, 30M memory peak, 5.7K incoming IP traffic, 4.2K outgoing IP traffic. client # [ 599.915942] systemd-logind[427]: Session 94 logged out. Waiting for processes to exit. client # [ 599.919120] systemd-logind[427]: Removed session 94. client # [ 600.413152] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 600.417133] systemd[1]: Started SSH per-connection Daemon (vsock:2:79). client # [ 600.517849] sshd-session[2453]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 600.528326] sshd-session[2453]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 600.537768] sshd-session[2453]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 600.550671] systemd-logind[427]: New session '96' of user 'root' with class 'user' and type 'tty'. client # [ 600.557772] systemd[1]: Started Session 96 of User root. client # [ 600.699371] sshd-session[2459]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 600.702295] sshd-session[2459]: Disconnected from user root UNKNOWN port 65535 client # [ 600.704104] sshd-session[2453]: pam_unix(sshd:session): session closed for user root client # [ 600.707992] systemd[1]: sshd-vsock@79-80-3:22-2:79.service: Deactivated successfully. client # [ 600.714005] systemd[1]: session-96.scope: Deactivated successfully. client # [ 600.718525] systemd-logind[427]: Session 96 logged out. Waiting for processes to exit. client # [ 600.721391] systemd-logind[427]: Removed session 96. worker1 # [ 602.321564] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 602.330362] systemd[1]: Started SSH per-connection Daemon (vsock:2:108). worker1 # [ 602.432769] sshd-session[3341]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 602.442612] sshd-session[3341]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 602.451803] sshd-session[3341]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 602.461983] systemd-logind[539]: New session '123' of user 'root' with class 'user' and type 'tty'. worker1 # [ 602.472592] systemd[1]: Started Session 123 of User root. worker1 # [ 602.493151] sshd-session[3347]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 602.494815] sshd-session[3347]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 602.496609] sshd-session[3341]: pam_unix(sshd:session): session closed for user root worker1 # [ 602.501346] systemd[1]: sshd-vsock@108-109-5:22-2:108.service: Deactivated successfully. worker1 # [ 602.506957] systemd[1]: session-123.scope: Deactivated successfully. worker1 # [ 602.511470] systemd-logind[539]: Session 123 logged out. Waiting for processes to exit. worker1 # [ 602.515124] systemd-logind[539]: Removed session 123. worker2 # [ 603.293537] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 603.303117] systemd[1]: Started SSH per-connection Daemon (vsock:2:67). worker2 # [ 603.402246] sshd-session[2840]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 603.410139] sshd-session[2840]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 603.421288] sshd-session[2840]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 603.431654] systemd-logind[515]: New session '85' of user 'root' with class 'user' and type 'tty'. worker2 # [ 603.439305] systemd[1]: Started Session 85 of User root. worker2 # [ 603.455144] sshd-session[2846]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 603.458070] sshd-session[2846]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 603.460194] sshd-session[2840]: pam_unix(sshd:session): session closed for user root worker2 # [ 603.463822] systemd[1]: sshd-vsock@67-68-6:22-2:67.service: Deactivated successfully. worker2 # [ 603.470141] systemd[1]: session-85.scope: Deactivated successfully. worker2 # [ 603.474839] systemd-logind[515]: Session 85 logged out. Waiting for processes to exit. worker2 # [ 603.477636] systemd-logind[515]: Removed session 85. lb # [ 606.332928] envoy[897]: conn peer=[2001:db8:1::1]:36516 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=658 tx=434 ms=53 worker1 # [ 606.117772] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 606.127530] systemd[1]: Started SSH per-connection Daemon (vsock:2:109). worker1 # [ 606.222244] sshd-session[3352]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 606.233076] sshd-session[3352]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 606.241892] sshd-session[3352]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 606.250799] systemd-logind[539]: New session '124' of user 'root' with class 'user' and type 'tty'. worker1 # [ 606.256556] systemd[1]: Started Session 124 of User root. worker1 # [ 606.293157] sshd-session[3358]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 606.294605] sshd-session[3358]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 606.296424] sshd-session[3352]: pam_unix(sshd:session): session closed for user root worker1 # [ 606.300645] systemd[1]: sshd-vsock@109-110-5:22-2:109.service: Deactivated successfully. worker1 # [ 606.306274] systemd[1]: session-124.scope: Deactivated successfully. worker1 # [ 606.309671] systemd[1]: session-124.scope: Consumed 27ms CPU time over 51ms wall clock time, 3.1M memory peak, 19.1K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 606.314002] systemd-logind[539]: Session 124 logged out. Waiting for processes to exit. worker1 # [ 606.315234] systemd-logind[539]: Removed session 124. worker1 # [ 607.523698] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 607.531437] systemd[1]: Started SSH per-connection Daemon (vsock:2:110). worker1 # [ 607.626792] sshd-session[3363]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 607.636448] sshd-session[3363]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 607.646370] sshd-session[3363]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 607.655994] systemd-logind[539]: New session '125' of user 'root' with class 'user' and type 'tty'. worker1 # [ 607.663207] systemd[1]: Started Session 125 of User root. worker1 # [ 607.697180] sshd-session[3369]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 607.698717] sshd-session[3369]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 607.700216] sshd-session[3363]: pam_unix(sshd:session): session closed for user root worker1 # [ 607.704928] systemd[1]: sshd-vsock@110-111-5:22-2:110.service: Deactivated successfully. worker1 # [ 607.710001] systemd[1]: session-125.scope: Deactivated successfully. worker1 # [ 607.711750] systemd[1]: session-125.scope: Consumed 27ms CPU time over 50ms wall clock time, 4.6M memory peak, 19.1K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 607.717529] systemd-logind[539]: Session 125 logged out. Waiting for processes to exit. worker1 # [ 607.719458] systemd-logind[539]: Removed session 125. [e2e] heartbeat t=510s worker1 # [ 608.420862] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 608.429467] systemd[1]: Started SSH per-connection Daemon (vsock:2:111). worker1 # [ 608.527890] sshd-session[3374]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 608.538011] sshd-session[3374]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 608.546707] sshd-session[3374]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 608.558198] systemd-logind[539]: New session '126' of user 'root' with class 'user' and type 'tty'. worker1 # [ 608.564964] systemd[1]: Started Session 126 of User root. worker1 # [ 608.609034] sshd-session[3380]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 608.611608] sshd-session[3380]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 608.614104] sshd-session[3374]: pam_unix(sshd:session): session closed for user root worker1 # [ 608.618549] systemd[1]: sshd-vsock@111-112-5:22-2:111.service: Deactivated successfully. worker1 # [ 608.623734] systemd[1]: session-126.scope: Deactivated successfully. worker1 # [ 608.627416] systemd[1]: session-126.scope: Consumed 27ms CPU time over 60ms wall clock time, 4.6M memory peak, 19.1K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 608.632689] systemd-logind[539]: Session 126 logged out. Waiting for processes to exit. worker1 # [ 608.633932] systemd-logind[539]: Removed session 126. worker2 # [ 608.717801] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 608.728312] systemd[1]: Started SSH per-connection Daemon (vsock:2:68). worker2 # [ 608.826310] sshd-session[2851]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 608.835931] sshd-session[2851]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 608.844717] sshd-session[2851]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 608.855401] systemd-logind[515]: New session '86' of user 'root' with class 'user' and type 'tty'. worker2 # [ 608.860527] systemd[1]: Started Session 86 of User root. worker2 # [ 608.895807] sshd-session[2857]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 608.897746] sshd-session[2857]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 608.899131] sshd-session[2851]: pam_unix(sshd:session): session closed for user root worker2 # [ 608.903420] systemd[1]: sshd-vsock@68-69-6:22-2:68.service: Deactivated successfully. worker2 # [ 608.909053] systemd[1]: session-86.scope: Deactivated successfully. worker2 # [ 608.912739] systemd[1]: session-86.scope: Consumed 27ms CPU time over 49ms wall clock time, 4.6M memory peak, 13.1K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 608.917328] systemd-logind[515]: Session 86 logged out. Waiting for processes to exit. worker2 # [ 608.918770] systemd-logind[515]: Removed session 86. client # [ 610.894801] systemd[1]: Stopping User Manager for UID 0... client # [ 610.902014] systemd[2426]: Activating special unit Exit the Session... client # [ 610.906923] systemd[2426]: Stopped target Main User Target. client # [ 610.912718] systemd[2426]: Stopped target Basic System. client # [ 610.914054] systemd[2426]: Stopped target Paths. client # [ 610.915160] systemd[2426]: Stopped target Sockets. client # [ 610.916672] systemd[2426]: Stopped target Timers. client # [ 610.917796] systemd[2426]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 610.919422] systemd[2426]: Closed D-Bus User Message Bus Socket. client # [ 610.921075] systemd[2426]: Stopped Create User Files and Directories. client # [ 610.922581] systemd[2426]: Removed slice User Application Slice. client # [ 610.923975] systemd[2426]: Reached target Shutdown. client # [ 610.926107] systemd[2426]: Finished Exit the Session. client # [ 610.927370] systemd[2426]: Reached target Exit the Session. client # [ 610.953939] systemd-logind[427]: Removed session 95. client # [ 610.961242] systemd[1]: user@0.service: Deactivated successfully. client # [ 610.966370] systemd[1]: Stopped User Manager for UID 0. client # [ 611.030727] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 611.064192] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 611.069221] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 611.075397] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 609.919560] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 609.928203] systemd[1]: Started SSH per-connection Daemon (vsock:2:69). worker2 # [ 610.027302] sshd-session[2862]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 610.035592] sshd-session[2862]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 610.046613] sshd-session[2862]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 610.055476] systemd-logind[515]: New session '87' of user 'root' with class 'user' and type 'tty'. worker2 # [ 610.060536] systemd[1]: Started Session 87 of User root. worker2 # [ 610.093276] sshd-session[2868]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 610.095863] sshd-session[2868]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 610.097386] sshd-session[2862]: pam_unix(sshd:session): session closed for user root worker2 # [ 610.101893] systemd[1]: sshd-vsock@69-70-6:22-2:69.service: Deactivated successfully. worker2 # [ 610.106627] systemd[1]: session-87.scope: Deactivated successfully. worker2 # [ 610.109924] systemd[1]: session-87.scope: Consumed 26ms CPU time over 47ms wall clock time, 4.8M memory peak, 13.1K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 610.115063] systemd-logind[515]: Session 87 logged out. Waiting for processes to exit. worker2 # [ 610.116408] systemd-logind[515]: Removed session 87. worker2 # [ 612.681584] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 612.688206] systemd[1]: Started SSH per-connection Daemon (vsock:2:70). worker2 # [ 612.787322] sshd-session[2873]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 612.798252] sshd-session[2873]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 612.807886] sshd-session[2873]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 612.820598] systemd-logind[515]: New session '88' of user 'root' with class 'user' and type 'tty'. worker2 # [ 612.824678] systemd[1]: Started Session 88 of User root. worker2 # [ 612.861673] sshd-session[2879]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 612.863371] sshd-session[2879]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 612.865225] sshd-session[2873]: pam_unix(sshd:session): session closed for user root worker2 # [ 612.870096] systemd[1]: sshd-vsock@70-71-6:22-2:70.service: Deactivated successfully. ok test farm::serial::required_system_features_are_placed_or_refused ... worker2 # [ 612.875061] systemd[1]: session-88.scope: Deactivated successfully. worker2 # [ 612.877160] systemd[1]: session-88.scope: Consumed 28ms CPU time over 52ms wall clock time, 3.1M memory peak, 13.1K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 612.883313] systemd-logind[515]: Session 88 logged out. Waiting for processes to exit. worker2 # [ 612.885885] systemd-logind[515]: Removed session 88. worker1 # [ 616.490983] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 616.499480] systemd[1]: Started SSH per-connection Daemon (vsock:2:112). worker1 # [ 616.594322] sshd-session[3385]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 616.602507] sshd-session[3385]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 616.613443] sshd-session[3385]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 616.624630] systemd-logind[539]: New session '127' of user 'root' with class 'user' and type 'tty'. worker1 # [ 616.633176] systemd[1]: Started Session 127 of User root. worker1 # [ 616.667169] sshd-session[3391]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 616.670847] sshd-session[3391]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 616.671937] sshd-session[3385]: pam_unix(sshd:session): session closed for user root worker1 # [ 616.675861] systemd[1]: sshd-vsock@112-113-5:22-2:112.service: Deactivated successfully. worker1 # [ 616.681583] systemd[1]: session-127.scope: Deactivated successfully. worker1 # [ 616.685815] systemd-logind[539]: Session 127 logged out. Waiting for processes to exit. worker1 # [ 616.687981] systemd-logind[539]: Removed session 127. worker2 # [ 616.191801] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 616.203641] systemd[1]: Started SSH per-connection Daemon (vsock:2:71). worker2 # [ 616.299250] sshd-session[2885]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 616.307863] sshd-session[2885]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 616.319307] sshd-session[2885]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 616.331835] systemd-logind[515]: New session '89' of user 'root' with class 'user' and type 'tty'. worker2 # [ 616.336622] systemd[1]: Started Session 89 of User root. worker2 # [ 616.370741] sshd-session[2891]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 616.373755] sshd-session[2891]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 616.375266] sshd-session[2885]: pam_unix(sshd:session): session closed for user root worker2 # [ 616.379567] systemd[1]: sshd-vsock@71-72-6:22-2:71.service: Deactivated successfully. worker2 # [ 616.385361] systemd[1]: session-89.scope: Deactivated successfully. worker2 # [ 616.389778] systemd-logind[515]: Session 89 logged out. Waiting for processes to exit. worker2 # [ 616.392300] systemd-logind[515]: Removed session 89. lb # [ 619.400577] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 619.409046] systemd[1]: Started SSH per-connection Daemon (vsock:2:50). lb # [ 619.510020] sshd-session[2107]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 619.517798] sshd-session[2107]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 619.528003] sshd-session[2107]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 619.559400] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 619.595710] systemd-logind[499]: New session '68' of user 'root' with class 'user' and type 'tty'. lb # [ 619.608806] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 619.614287] systemd[1]: Starting User Manager for UID 0... lb # [ 619.643797] (systemd)[2116]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 619.650258] systemd-logind[499]: New session '69' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 619.742486] systemd[2116]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 619.844055] systemd[2116]: Queued start job for default target Main User Target. lb # [ 619.853106] systemd[2116]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 619.856209] systemd[2116]: Created slice User Application Slice. lb # [ 619.858837] systemd[2116]: Started Daily Cleanup of User's Temporary Directories. lb # [ 619.860431] systemd[2116]: Reached target Paths. lb # [ 619.861692] systemd[2116]: Reached target Timers. lb # [ 619.863701] systemd[2116]: Starting D-Bus User Message Bus Socket... lb # [ 619.866363] systemd[2116]: Starting Create User Files and Directories... lb # [ 619.909228] systemd[2116]: Finished Create User Files and Directories. lb # [ 619.914874] systemd[2116]: Listening on D-Bus User Message Bus Socket. lb # [ 619.919613] systemd[2116]: Reached target Sockets. lb # [ 619.920780] systemd[2116]: Reached target Basic System. lb # [ 619.921544] systemd[2116]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 619.922950] systemd[2116]: Reached target Main User Target. lb # [ 619.923764] systemd[2116]: Startup finished in 249ms. lb # [ 619.928288] systemd[1]: Started User Manager for UID 0. lb # [ 619.929129] systemd[1]: Started Session 68 of User root. lb # [ 619.959667] sshd-session[2129]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 619.961655] sshd-session[2129]: Disconnected from user root UNKNOWN port 65535 lb # [ 619.963422] sshd-session[2107]: pam_unix(sshd:session): session closed for user root lb # [ 619.967493] systemd[1]: sshd-vsock@50-51-4:22-2:50.service: Deactivated successfully. lb # [ 619.972598] systemd[1]: session-68.scope: Deactivated successfully. lb # [ 619.974274] systemd[1]: session-68.scope: Consumed 25ms CPU time over 48ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 619.979453] systemd-logind[499]: Session 68 logged out. Waiting for processes to exit. lb # [ 619.981845] systemd-logind[499]: Removed session 68. worker1 # [ 618.867052] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 618.876848] systemd[1]: Started SSH per-connection Daemon (vsock:2:113). worker1 # [ 618.969999] sshd-session[3398]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 618.979827] sshd-session[3398]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 618.989144] sshd-session[3398]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 618.998304] systemd-logind[539]: New session '128' of user 'root' with class 'user' and type 'tty'. worker1 # [ 619.004572] systemd[1]: Started Session 128 of User root. worker1 # [ 619.040571] sshd-session[3404]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 619.043247] sshd-session[3404]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 619.044648] sshd-session[3398]: pam_unix(sshd:session): session closed for user root worker1 # [ 619.049116] systemd[1]: sshd-vsock@113-114-5:22-2:113.service: Deactivated successfully. worker1 # [ 619.054285] systemd[1]: session-128.scope: Deactivated successfully. worker1 # [ 619.056142] systemd[1]: session-128.scope: Consumed 28ms CPU time over 51ms wall clock time, 3.1M memory peak, 19.1K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 619.062413] systemd-logind[539]: Session 128 logged out. Waiting for processes to exit. worker1 # [ 619.063684] systemd-logind[539]: Removed session 128. client # [ 621.031677] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 621.036781] systemd[1]: Started SSH per-connection Daemon (vsock:2:80). client # [ 621.135043] sshd-session[2472]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 621.144426] sshd-session[2472]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 621.154531] sshd-session[2472]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 621.171359] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 621.185036] systemd-logind[427]: New session '97' of user 'root' with class 'user' and type 'tty'. client # [ 621.219264] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 621.232763] systemd[1]: Starting User Manager for UID 0... client # [ 621.271663] (systemd)[2480]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 621.279426] systemd-logind[427]: New session '98' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 621.369440] systemd[2480]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 621.471417] systemd[2480]: Queued start job for default target Main User Target. client # [ 621.481163] systemd[2480]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 621.484320] systemd[2480]: Created slice User Application Slice. client # [ 621.487060] systemd[2480]: Started Daily Cleanup of User's Temporary Directories. client # [ 621.490638] systemd[2480]: Reached target Paths. client # [ 621.491480] systemd[2480]: Reached target Timers. client # [ 621.493316] systemd[2480]: Starting D-Bus User Message Bus Socket... client # [ 621.495796] systemd[2480]: Starting Create User Files and Directories... client # [ 621.541967] systemd[2480]: Finished Create User Files and Directories. client # [ 621.547132] systemd[2480]: Listening on D-Bus User Message Bus Socket. client # [ 621.550019] systemd[2480]: Reached target Sockets. client # [ 621.550907] systemd[2480]: Reached target Basic System. client # [ 621.551775] systemd[2480]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 621.556845] systemd[2480]: Reached target Main User Target. client # [ 621.557768] systemd[2480]: Startup finished in 252ms. client # [ 621.558551] systemd[1]: Started User Manager for UID 0. client # [ 621.561505] systemd[1]: Started Session 97 of User root. worker1 # [ 621.741855] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44014 worker2 # [ 620.197317] nix-grpc-daemon[1487]: ts=2026-11-12T09:28:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 623.058581] garage[898]: 2026-11-12T09:28:44.816397Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo lb # [ 623.058922] garage[898]: 2026-11-12T09:28:44.816860Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.070408] garage[898]: 2026-11-12T09:28:44.827268Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo lb # [ 623.083756] garage[898]: 2026-11-12T09:28:44.827941Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.088176] garage[898]: 2026-11-12T09:28:44.830105Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo lb # [ 623.093529] garage[898]: 2026-11-12T09:28:44.836492Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 620.240768] nix-grpc-daemon[1487]: ts=2026-11-12T09:28:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 623.097027] garage[898]: 2026-11-12T09:28:44.836688Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo lb # [ 623.101786] garage[898]: 2026-11-12T09:28:44.836918Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.109363] garage[898]: 2026-11-12T09:28:44.836997Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo lb # [ 623.116389] garage[898]: 2026-11-12T09:28:44.837173Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.120793] garage[898]: 2026-11-12T09:28:44.837964Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo lb # [ 623.126132] garage[898]: 2026-11-12T09:28:44.838204Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 620.273269] nix-grpc-daemon[1487]: ts=2026-11-12T09:28:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 623.129582] garage[898]: 2026-11-12T09:28:44.838297Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo lb # [ 623.136068] garage[898]: 2026-11-12T09:28:44.838468Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.140703] garage[898]: 2026-11-12T09:28:44.838537Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo lb # [ 623.146686] garage[898]: 2026-11-12T09:28:44.838727Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.150505] garage[898]: 2026-11-12T09:28:44.839701Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo lb # [ 623.155183] garage[898]: 2026-11-12T09:28:44.840070Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 621.857910] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 623.160123] garage[898]: 2026-11-12T09:28:44.866848Z INFO garage_api_common::generic_server: 127.0.0.1:37714 (key GK0123456789abcdef01234567) HEAD /farm/d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo lb # [ 623.163956] garage[898]: 2026-11-12T09:28:44.867319Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.166981] garage[898]: 2026-11-12T09:28:44.867859Z INFO garage_api_common::generic_server: 127.0.0.1:37706 (key GK0123456789abcdef01234567) HEAD /farm/vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo lb # [ 623.171166] garage[898]: 2026-11-12T09:28:44.868355Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.175201] garage[898]: 2026-11-12T09:28:44.868478Z INFO garage_api_common::generic_server: 127.0.0.1:37708 (key GK0123456789abcdef01234567) HEAD /farm/iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo lb # [ 623.180475] garage[898]: 2026-11-12T09:28:44.868648Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.183517] garage[898]: 2026-11-12T09:28:44.874646Z INFO garage_api_common::generic_server: 127.0.0.1:37714 (key GK0123456789abcdef01234567) HEAD /farm/d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo lb # [ 623.187173] garage[898]: 2026-11-12T09:28:44.874995Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.190269] garage[898]: 2026-11-12T09:28:44.875124Z INFO garage_api_common::generic_server: 127.0.0.1:37706 (key GK0123456789abcdef01234567) HEAD /farm/vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo lb # [ 623.194397] garage[898]: 2026-11-12T09:28:44.875304Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 621.895471] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 623.196889] garage[898]: 2026-11-12T09:28:44.875379Z INFO garage_api_common::generic_server: 127.0.0.1:37708 (key GK0123456789abcdef01234567) HEAD /farm/iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo lb # [ 623.199849] garage[898]: 2026-11-12T09:28:44.875547Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.206105] garage[898]: 2026-11-12T09:28:44.894618Z INFO garage_api_common::generic_server: 127.0.0.1:37714 (key GK0123456789abcdef01234567) HEAD /farm/p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo lb # [ 623.212707] garage[898]: 2026-11-12T09:28:44.895036Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.215430] garage[898]: 2026-11-12T09:28:44.899299Z INFO garage_api_common::generic_server: 127.0.0.1:37708 (key GK0123456789abcdef01234567) HEAD /farm/hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo lb # [ 623.219208] garage[898]: 2026-11-12T09:28:44.899654Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 620.367022] nix-grpc-daemon[1487]: ts=2026-11-12T09:28:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 623.221505] garage[898]: 2026-11-12T09:28:44.899794Z INFO garage_api_common::generic_server: 127.0.0.1:37706 (key GK0123456789abcdef01234567) HEAD /farm/nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo lb # [ 623.224689] garage[898]: 2026-11-12T09:28:44.900123Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.226847] garage[898]: 2026-11-12T09:28:44.905476Z INFO garage_api_common::generic_server: 127.0.0.1:37714 (key GK0123456789abcdef01234567) HEAD /farm/hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo lb # [ 623.229632] garage[898]: 2026-11-12T09:28:44.905793Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.231706] garage[898]: 2026-11-12T09:28:44.905885Z INFO garage_api_common::generic_server: 127.0.0.1:37708 (key GK0123456789abcdef01234567) HEAD /farm/p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker2 # [ 620.380454] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 623.234596] garage[898]: 2026-11-12T09:28:44.906036Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.236678] garage[898]: 2026-11-12T09:28:44.906096Z INFO garage_api_common::generic_server: 127.0.0.1:37706 (key GK0123456789abcdef01234567) HEAD /farm/nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo lb # [ 623.239274] garage[898]: 2026-11-12T09:28:44.906235Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.241455] garage[898]: 2026-11-12T09:28:44.918952Z INFO garage_api_common::generic_server: 127.0.0.1:37708 (key GK0123456789abcdef01234567) HEAD /farm/dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo lb # [ 623.244045] garage[898]: 2026-11-12T09:28:44.919327Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.246204] garage[898]: 2026-11-12T09:28:44.919417Z INFO garage_api_common::generic_server: 127.0.0.1:37714 (key GK0123456789abcdef01234567) HEAD /farm/fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo lb # [ 623.248973] garage[898]: 2026-11-12T09:28:44.919556Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.250957] garage[898]: 2026-11-12T09:28:44.934400Z INFO garage_api_common::generic_server: 127.0.0.1:37708 (key GK0123456789abcdef01234567) HEAD /farm/g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo lb # [ 623.253914] garage[898]: 2026-11-12T09:28:44.934748Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.255910] garage[898]: 2026-11-12T09:28:44.939629Z INFO garage_api_common::generic_server: 127.0.0.1:37706 (key GK0123456789abcdef01234567) HEAD /farm/dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo lb # [ 623.258828] garage[898]: 2026-11-12T09:28:44.939937Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.260902] garage[898]: 2026-11-12T09:28:44.940060Z INFO garage_api_common::generic_server: 127.0.0.1:37708 (key GK0123456789abcdef01234567) HEAD /farm/g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker2 # [ 620.408505] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 623.263525] garage[898]: 2026-11-12T09:28:44.940228Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.265697] garage[898]: 2026-11-12T09:28:44.940286Z INFO garage_api_common::generic_server: 127.0.0.1:37714 (key GK0123456789abcdef01234567) HEAD /farm/fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo lb # [ 623.268316] garage[898]: 2026-11-12T09:28:44.940408Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.270294] garage[898]: 2026-11-12T09:28:44.964457Z INFO garage_api_common::generic_server: 127.0.0.1:37714 (key GK0123456789abcdef01234567) HEAD /farm/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo lb # [ 623.273001] garage[898]: 2026-11-12T09:28:44.964800Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.274965] garage[898]: 2026-11-12T09:28:44.964872Z INFO garage_api_common::generic_server: 127.0.0.1:37706 (key GK0123456789abcdef01234567) HEAD /farm/pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo lb # [ 623.278919] garage[898]: 2026-11-12T09:28:44.964993Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.281306] garage[898]: 2026-11-12T09:28:44.965040Z INFO garage_api_common::generic_server: 127.0.0.1:37708 (key GK0123456789abcdef01234567) HEAD /farm/7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo lb # [ 623.283895] garage[898]: 2026-11-12T09:28:44.965149Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.286104] garage[898]: 2026-11-12T09:28:44.965995Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo lb # [ 623.288830] garage[898]: 2026-11-12T09:28:44.970754Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.290806] garage[898]: 2026-11-12T09:28:44.970885Z INFO garage_api_common::generic_server: 127.0.0.1:37728 (key GK0123456789abcdef01234567) HEAD /farm/cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo lb # [ 623.293580] garage[898]: 2026-11-12T09:28:44.971027Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.295570] garage[898]: 2026-11-12T09:28:44.971088Z INFO garage_api_common::generic_server: 127.0.0.1:37742 (key GK0123456789abcdef01234567) HEAD /farm/sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo lb # [ 623.298458] garage[898]: 2026-11-12T09:28:44.971198Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.300494] garage[898]: 2026-11-12T09:28:44.971267Z INFO garage_api_common::generic_server: 127.0.0.1:37706 (key GK0123456789abcdef01234567) HEAD /farm/3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo lb # [ 623.303096] garage[898]: 2026-11-12T09:28:44.971404Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.305315] garage[898]: 2026-11-12T09:28:44.971450Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo lb # [ 623.309117] garage[898]: 2026-11-12T09:28:44.971558Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 623.311252] garage[898]: 2026-11-12T09:28:44.971612Z INFO garage_api_common::generic_server: 127.0.0.1:37714 (key GK0123456789abcdef01234567) HEAD /farm/cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo lb # [ 623.314239] garage[898]: 2026-11-12T09:28:44.971716Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 620.551350] nix-daemon[976]: accepted connection from pid 2905, user nix-grpc-daemon (trusted) lb # [ 623.431588] niks3-server[1454]: 2026/11/12 09:28:45 INFO Received push request method=POST path=/api/pushes worker2 # [ 620.581207] nix-daemon[976]: reaped child process 2908, status = succeeded worker2 # [ 620.592506] nix-grpc-daemon[1723]: time=2026-11-12T09:28:45.861Z level=INFO msg="Uploading 9 paths to lb (0 already cached)" worker2 # [ 620.594245] nix-grpc-daemon[1723]: time=2026-11-12T09:28:45.861Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" worker2 # [ 620.599490] nix-grpc-daemon[1723]: time=2026-11-12T09:28:45.861Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" worker2 # [ 620.603770] nix-grpc-daemon[1723]: time=2026-11-12T09:28:45.861Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" worker2 # [ 620.605774] nix-grpc-daemon[1723]: time=2026-11-12T09:28:45.861Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" worker2 # [ 620.607528] nix-grpc-daemon[1723]: time=2026-11-12T09:28:45.861Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" worker2 # [ 620.610877] nix-grpc-daemon[1723]: time=2026-11-12T09:28:45.861Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" worker2 # [ 620.615826] nix-grpc-daemon[1723]: time=2026-11-12T09:28:45.861Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" worker2 # [ 620.618106] nix-grpc-daemon[1723]: time=2026-11-12T09:28:45.862Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 623.444669] garage[898]: 2026-11-12T09:28:45.203819Z INFO garage_api_common::generic_server: 192.168.1.4:35728 PUT /farm/nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d6f3a801724aaaf733af44a207ee981deae9ef04dc24a2ca50b1e707336bca42 worker2 # [ 620.619939] nix-grpc-daemon[1723]: time=2026-11-12T09:28:45.862Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 623.474671] garage[898]: 2026-11-12T09:28:45.214993Z INFO garage_api_common::generic_server: 192.168.1.4:48928 PUT /farm/nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b85ac3cd68006f0e16ee49a7c0cc5670f112a56712ba052a33b1923885196b8 worker2 # [ 620.651403] nix-grpc-daemon[1723]: time=2026-11-12T09:28:45.922Z level=INFO msg="Uploading 9 narinfos" lb # [ 623.522286] garage[898]: 2026-11-12T09:28:45.215489Z INFO garage_api_common::generic_server: 192.168.1.4:54250 PUT /farm/nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a8130b7d3f830fd3d49fbb6e220e2cc8885caebd614dd9c896e79a031da1f8c7 lb # [ 623.538828] garage[898]: 2026-11-12T09:28:45.216597Z INFO garage_api_common::generic_server: 192.168.1.4:38998 PUT /farm/nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=706b8a635b7d9204d3ec26f5454b2aa315a3b8fb576f79d2634acc5982c3c8cf worker2 # [ 620.701593] nix-grpc-daemon[1723]: time=2026-11-12T09:28:45.974Z level=INFO msg="Upload complete. (280ms)" lb # [ 623.559381] garage[898]: 2026-11-12T09:28:45.217293Z INFO garage_api_common::generic_server: 192.168.1.4:35738 PUT /farm/nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=db4fd9e349e03348fdfd1d9bc1d0ba4df364d343d86bdb1b92357c7b7a59d6e7 lb # [ 623.566348] garage[898]: 2026-11-12T09:28:45.217569Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d08203e44979205703d202e79fb06a75a907b85048031489996816ffd3f842f8 worker2 # [ 620.712552] nix-grpc-daemon[1487]: ts=2026-11-12T09:28:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 paths=9 nar_bytes_in=5664 lb # [ 623.573305] garage[898]: 2026-11-12T09:28:45.217817Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f59aa95d75df84c85b0645d49e75ca6e73fee0f7deb9f406ffc207ce755bcf38 worker2 # [ 620.725171] nix-daemon[976]: reaped child process 2901, status = succeeded lb # [ 623.579710] garage[898]: 2026-11-12T09:28:45.218075Z INFO garage_api_common::generic_server: 192.168.1.4:48916 PUT /farm/nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=81cd40c4a75eeefc901559b25d961d4c42fdf9412c98afd37ab5ebd2b1c1aea6 lb # [ 623.586485] garage[898]: 2026-11-12T09:28:45.218816Z INFO garage_api_common::generic_server: 192.168.1.4:41144 PUT /farm/qx10pa00pilyp5xdzd48l88d5jz143mr.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=605128823c0faa7300f828cb36c83e7a44e5c89ced48d94b727aa6216364f114 lb # [ 623.593241] niks3-server[1454]: 2026/11/12 09:28:45 INFO Received sign narinfos request method=POST path=/api/pushes/65/sign lb # [ 623.595296] niks3-server[1454]: 2026/11/12 09:28:45 INFO Signed narinfos id=65 count=9 worker1 # [ 622.294513] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:46Z level=debug event=want client=8 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 lb # [ 623.596552] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 623.598226] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst lb # [ 623.600904] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst worker1 # [ 622.299086] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:46Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 lb # [ 623.603689] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst lb # [ 623.605811] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst lb # [ 623.607775] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst lb # [ 623.609848] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 623.611401] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst worker1 # [ 622.310709] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:46Z level=debug event=want client=8 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 lb # [ 623.613404] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst lb # [ 623.615283] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 623.617027] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls worker1 # [ 622.316384] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:46Z level=debug event=want client=8 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 lb # [ 623.618611] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 623.620212] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst lb # [ 623.622077] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 623.623634] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst lb # [ 623.625644] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls worker1 # [ 622.324958] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 worker1 # [ 622.330878] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 623.627248] garage[898]: 2026-11-12T09:28:45.219595Z INFO garage_api_common::generic_server: 192.168.1.4:41062 PUT /farm/pplpzcnjfn295nm16cg0iihpfc9iffry.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6d4c1304ad1f2026601a98a5ca5bc4c1a16c289551c9015675e10075ee335686 worker1 # [ 622.337177] nix-grpc-daemon[2296]: copying path '/nix/store/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv' from 'http://lb:5751'... lb # [ 623.634878] garage[898]: 2026-11-12T09:28:45.220063Z INFO garage_api_common::generic_server: 192.168.1.4:41074 PUT /farm/7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9f64d35e162c096bb683d638ddbd07ef39df1f15fc830670297fce26c3533a31 lb # [ 623.640854] garage[898]: 2026-11-12T09:28:45.220682Z INFO garage_api_common::generic_server: 192.168.1.4:41084 PUT /farm/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=973502f36464a7bd5654ce19ba252e42b9704369042e85059dfe992f9e865847 lb # [ 623.648415] garage[898]: 2026-11-12T09:28:45.221036Z INFO garage_api_common::generic_server: 192.168.1.4:41092 PUT /farm/sy43wp9v52pni1wms6q0p3qybpc2pwad.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f0113e1572ccdfc538f0a22514b0f5105ce9efa095ca54bc30515a9ac558395f lb # [ 623.654317] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 623.656107] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 623.657676] niks3-server[1454]: 2026/11/12 09:28:45 INFO Received complete push request method=POST path=/api/pushes/65/complete worker1 # [ 622.358388] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 623.659339] niks3-server[1454]: 2026/11/12 09:28:45 INFO Completed push id=65 objects=27 duration=9.192ms lb # [ 623.660743] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo lb # [ 623.662316] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo lb # [ 623.663931] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo lb # [ 623.665655] niks3-server[1454]: 2026/11/12 09:28:45 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo lb # [ 623.667297] garage[898]: 2026-11-12T09:28:45.221647Z INFO garage_api_common::generic_server: 192.168.1.4:41104 PUT /farm/cnf7j5vjqyj799isbg26wgjnrlk208gi.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7085241b72a460dbd44b72b8162dca29e4aaac7d2ec986834fcb04a45937d75e worker1 # [ 622.372375] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 623.673250] garage[898]: 2026-11-12T09:28:45.222208Z INFO garage_api_common::generic_server: 192.168.1.4:41118 PUT /farm/cgwyij19i3fl7sqlyz54vzfr4zajg077.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=63f2586ca770051e1cf6cbb88d8db1b81d6d64aafee80c1584711873075826cb lb # [ 623.678966] garage[898]: 2026-11-12T09:28:45.222654Z INFO garage_api_common::generic_server: 192.168.1.4:41122 PUT /farm/dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cfc0eee66476d73bf67fce3801e52ae84d47dad1c989d1a5e57cbb1232a0a7df lb # [ 623.684914] garage[898]: 2026-11-12T09:28:45.223126Z INFO garage_api_common::generic_server: 192.168.1.4:41128 PUT /farm/3223c4sl4ncpldbvw558vqwddijwzfpd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2bf5c1cc008c2c57fcbdb3acdc573f54f3cf97e458bea0fb330005860e396025 lb # [ 623.690441] garage[898]: 2026-11-12T09:28:45.223678Z INFO garage_api_common::generic_server: 192.168.1.4:41142 PUT /farm/nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ac2fba941d9922e68e70300aead9f1a4916f3b0843e6cfc52e61904ea734059b lb # [ 623.696465] garage[898]: 2026-11-12T09:28:45.252574Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 623.699016] garage[898]: 2026-11-12T09:28:45.253143Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst lb # [ 623.702012] garage[898]: 2026-11-12T09:28:45.253429Z INFO garage_api_common::generic_server: 127.0.0.1:37728 (key GK0123456789abcdef01234567) HEAD /farm/nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst lb # [ 623.705023] garage[898]: 2026-11-12T09:28:45.253674Z INFO garage_api_common::generic_server: 127.0.0.1:37742 (key GK0123456789abcdef01234567) HEAD /farm/nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst lb # [ 623.707842] garage[898]: 2026-11-12T09:28:45.253902Z INFO garage_api_common::generic_server: 127.0.0.1:37706 (key GK0123456789abcdef01234567) HEAD /farm/nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst lb # [ 623.710925] garage[898]: 2026-11-12T09:28:45.254126Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst lb # [ 623.714150] garage[898]: 2026-11-12T09:28:45.254348Z INFO garage_api_common::generic_server: 127.0.0.1:37714 (key GK0123456789abcdef01234567) HEAD /farm/nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst lb # [ 623.718293] garage[898]: 2026-11-12T09:28:45.254561Z INFO garage_api_common::generic_server: 127.0.0.1:37708 (key GK0123456789abcdef01234567) HEAD /farm/pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 623.720981] garage[898]: 2026-11-12T09:28:45.259922Z INFO garage_api_common::generic_server: 127.0.0.1:37728 (key GK0123456789abcdef01234567) HEAD /farm/cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 623.723729] garage[898]: 2026-11-12T09:28:45.260730Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 623.726453] garage[898]: 2026-11-12T09:28:45.260962Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 623.729153] garage[898]: 2026-11-12T09:28:45.261168Z INFO garage_api_common::generic_server: 127.0.0.1:37708 (key GK0123456789abcdef01234567) HEAD /farm/nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst lb # [ 623.733638] garage[898]: 2026-11-12T09:28:45.261385Z INFO garage_api_common::generic_server: 127.0.0.1:37714 (key GK0123456789abcdef01234567) HEAD /farm/nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst lb # [ 623.740320] garage[898]: 2026-11-12T09:28:45.261573Z INFO garage_api_common::generic_server: 127.0.0.1:44972 (key GK0123456789abcdef01234567) HEAD /farm/7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 623.742924] garage[898]: 2026-11-12T09:28:45.261756Z INFO garage_api_common::generic_server: 127.0.0.1:37706 (key GK0123456789abcdef01234567) HEAD /farm/3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 623.747571] garage[898]: 2026-11-12T09:28:45.261940Z INFO garage_api_common::generic_server: 127.0.0.1:37742 (key GK0123456789abcdef01234567) HEAD /farm/sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 623.750470] garage[898]: 2026-11-12T09:28:45.262162Z INFO garage_api_common::generic_server: 127.0.0.1:37770 (key GK0123456789abcdef01234567) HEAD /farm/nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst lb # [ 623.753556] garage[898]: 2026-11-12T09:28:45.269357Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 623.756144] garage[898]: 2026-11-12T09:28:45.277105Z INFO garage_api_common::generic_server: 192.168.1.4:41142 PUT /farm/dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2240bda531827018748e2b1b5a141d45d24360ae3d5cdbc6965b9debae485152 lb # [ 623.761624] garage[898]: 2026-11-12T09:28:45.278802Z INFO garage_api_common::generic_server: 192.168.1.4:41122 PUT /farm/qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=049135aa5d2585e4609252863814d8927ee0049524f157b04c8d89130cb0f244 lb # [ 623.767076] garage[898]: 2026-11-12T09:28:45.289224Z INFO garage_api_common::generic_server: 192.168.1.4:41128 PUT /farm/sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0823b10b14b108cd3d4976b7a23863506b34de4a31eea46cb2ba0e789d4312cc lb # [ 623.772680] garage[898]: 2026-11-12T09:28:45.289839Z INFO garage_api_common::generic_server: 192.168.1.4:41104 PUT /farm/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cf3ff5e8c22491f344ca701b6d6810a7ebeed7e9ab1e936eadf5e560a19f3f85 lb # [ 623.778124] garage[898]: 2026-11-12T09:28:45.291690Z INFO garage_api_common::generic_server: 192.168.1.4:41092 PUT /farm/pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=016c4ecce3510a77bec409d0e463234b98d15281a6845ae1861442dafac70dfe lb # [ 623.783569] garage[898]: 2026-11-12T09:28:45.292762Z INFO garage_api_common::generic_server: 192.168.1.4:41118 PUT /farm/cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae65cc4e51418595d46681a08596e975d9610bf50af551e8111f44268f5d00a5 lb # [ 623.789310] garage[898]: 2026-11-12T09:28:45.293777Z INFO garage_api_common::generic_server: 192.168.1.4:41084 PUT /farm/3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=40d0fb39d81bd2cc77bd99b5dc11995661bea0a15f1b0e7b146b376b06247d02 lb # [ 623.795001] garage[898]: 2026-11-12T09:28:45.294524Z INFO garage_api_common::generic_server: 192.168.1.4:35716 PUT /farm/7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aacbfc6184ef1ec5924361b8c175325306a34bac4e2cf686922fbb15ce0e6b15 lb # [ 623.801021] garage[898]: 2026-11-12T09:28:45.294745Z INFO garage_api_common::generic_server: 192.168.1.4:35722 PUT /farm/cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092845Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=41a7eed4edfc5333d6bff46dbf8c2810f0766e85fc3073fc273412d5c27c63db lb # [ 623.806675] garage[898]: 2026-11-12T09:28:45.311297Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo lb # [ 623.809470] garage[898]: 2026-11-12T09:28:45.311742Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo lb # [ 623.812875] garage[898]: 2026-11-12T09:28:45.313786Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo lb # [ 623.815465] garage[898]: 2026-11-12T09:28:45.317806Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo lb # [ 623.818344] garage[898]: 2026-11-12T09:28:45.393611Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo lb # [ 623.821102] garage[898]: 2026-11-12T09:28:45.394306Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) GET /farm/pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo lb # [ 623.823680] garage[898]: 2026-11-12T09:28:45.407031Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst lb # [ 623.826792] garage[898]: 2026-11-12T09:28:45.407632Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) GET /farm/nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst lb # [ 624.241200] postgres[809]: [809] LOG: checkpoint starting: time lb # [ 624.661221] garage[898]: 2026-11-12T09:28:46.419369Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo lb # [ 624.665769] garage[898]: 2026-11-12T09:28:46.419835Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 623.822425] nix-daemon[1059]: reaped child process 3419, status = succeeded worker1 # [ 623.955500] nix-daemon[1059]: accepted connection from pid 3435, user nix-grpc-daemon (trusted) lb # [ 625.276846] niks3-server[1454]: 2026/11/12 09:28:47 INFO Received push request method=POST path=/api/pushes worker1 # [ 623.982260] nix-daemon[1059]: reaped child process 3438, status = succeeded worker1 # [ 623.985888] nix-grpc-daemon[2487]: time=2026-11-12T09:28:47.777Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 623.987542] nix-grpc-daemon[2487]: time=2026-11-12T09:28:47.777Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 625.285547] garage[898]: 2026-11-12T09:28:47.044974Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092847Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=37c554409469ac172874d9c4fc5af4b560a24c048c082539caa6fd905f4e64f7 worker1 # [ 624.001963] nix-grpc-daemon[2487]: time=2026-11-12T09:28:47.795Z level=INFO msg="Uploading 1 narinfos" lb # [ 625.313061] garage[898]: 2026-11-12T09:28:47.055375Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092847Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9463f85d589e418af0744696b2cd86c7ed091f2eec3b494256272d5bc4f48894 lb # [ 625.324888] garage[898]: 2026-11-12T09:28:47.056300Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092847Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9267ed2f7c39e58b83ff2ac04ecbb3436e1473468d298674b83937bf109e999e worker1 # [ 624.035204] nix-grpc-daemon[2487]: time=2026-11-12T09:28:47.829Z level=INFO msg="Upload complete. (247ms)" lb # [ 625.334128] garage[898]: 2026-11-12T09:28:47.060185Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 625.340071] garage[898]: 2026-11-12T09:28:47.061801Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker1 # [ 624.044918] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=19 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 625.346048] garage[898]: 2026-11-12T09:28:47.062218Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092847Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=148e1dfe2096e09a97d69ae61c79b5878241292b0a0556eb6cf93b030c5bd64f worker1 # [ 624.057655] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:47Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 lb # [ 625.357567] garage[898]: 2026-11-12T09:28:47.065385Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 625.363074] niks3-server[1454]: 2026/11/12 09:28:47 INFO Received sign narinfos request method=POST path=/api/pushes/66/sign worker1 # [ 624.064990] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 625.365730] niks3-server[1454]: 2026/11/12 09:28:47 INFO Signed narinfos id=66 count=1 lb # [ 625.367353] niks3-server[1454]: 2026/11/12 09:28:47 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls worker1 # [ 624.067479] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:47Z level=debug event=want client=8 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 lb # [ 625.369775] niks3-server[1454]: 2026/11/12 09:28:47 INFO Received complete push request method=POST path=/api/pushes/66/complete worker1 # [ 624.071489] nix-daemon[1059]: reaped child process 3417, status = succeeded lb # [ 625.374266] niks3-server[1454]: 2026/11/12 09:28:47 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 625.377279] niks3-server[1454]: 2026/11/12 09:28:47 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst worker1 # [ 624.078807] nix-grpc-daemon[2296]: copying path '/nix/store/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv' from 'http://lb:5751'... lb # [ 625.380276] niks3-server[1454]: 2026/11/12 09:28:47 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo lb # [ 625.384693] niks3-server[1454]: 2026/11/12 09:28:47 INFO Completed push id=66 objects=4 duration=26.75946ms lb # [ 625.387058] garage[898]: 2026-11-12T09:28:47.069644Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker1 # [ 624.090506] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 625.390808] garage[898]: 2026-11-12T09:28:47.132779Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo lb # [ 625.394665] garage[898]: 2026-11-12T09:28:47.133655Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) GET /farm/3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo lb # [ 625.398194] garage[898]: 2026-11-12T09:28:47.143173Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst worker1 # [ 624.104092] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 625.402413] garage[898]: 2026-11-12T09:28:47.143907Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) GET /farm/nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst lb # [ 626.288549] garage[898]: 2026-11-12T09:28:48.046782Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo lb # [ 626.292991] garage[898]: 2026-11-12T09:28:48.047245Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 625.390015] nix-daemon[1059]: reaped child process 3446, status = succeeded lb # [ 626.732127] garage[898]: 2026-11-12T09:28:48.490585Z INFO garage_table::sync: bucket_v2: Adding full sync for ack layout version 1 lb # [ 626.735318] garage[898]: 2026-11-12T09:28:48.490674Z INFO garage_table::sync: bucket_alias: Adding full sync for ack layout version 1 lb # [ 626.744162] garage[898]: 2026-11-12T09:28:48.490698Z INFO garage_table::sync: key: Adding full sync for ack layout version 1 lb # [ 626.748004] garage[898]: 2026-11-12T09:28:48.490862Z INFO garage_table::sync: object: Adding full sync for ack layout version 1 lb # [ 626.750979] garage[898]: 2026-11-12T09:28:48.491015Z INFO garage_table::sync: bucket_object_counter: Adding full sync for ack layout version 1 worker1 # [ 625.453630] nix-daemon[1059]: accepted connection from pid 3462, user nix-grpc-daemon (trusted) lb # [ 626.754326] garage[898]: 2026-11-12T09:28:48.491179Z INFO garage_table::sync: multipart_upload: Adding full sync for ack layout version 1 lb # [ 626.757567] garage[898]: 2026-11-12T09:28:48.491241Z INFO garage_table::sync: bucket_v2: Completed full sync for ack layout version 1 lb # [ 626.760749] garage[898]: 2026-11-12T09:28:48.491280Z INFO garage_table::sync: bucket_alias: Completed full sync for ack layout version 1 lb # [ 626.763814] garage[898]: 2026-11-12T09:28:48.491310Z INFO garage_table::sync: key: Completed full sync for ack layout version 1 lb # [ 626.767001] garage[898]: 2026-11-12T09:28:48.500200Z INFO garage_table::sync: object: Completed full sync for ack layout version 1 lb # [ 626.770284] garage[898]: 2026-11-12T09:28:48.500247Z INFO garage_table::sync: bucket_object_counter: Completed full sync for ack layout version 1 lb # [ 626.773918] garage[898]: 2026-11-12T09:28:48.500263Z INFO garage_table::sync: multipart_upload: Completed full sync for ack layout version 1 worker1 # [ 625.478115] nix-daemon[1059]: reaped child process 3465, status = succeeded lb # [ 626.778049] garage[898]: 2026-11-12T09:28:48.500370Z INFO garage_table::sync: bucket_mpu_counter: Adding full sync for ack layout version 1 lb # [ 626.781362] garage[898]: 2026-11-12T09:28:48.500445Z INFO garage_table::sync: version: Adding full sync for ack layout version 1 lb # [ 626.784787] garage[898]: 2026-11-12T09:28:48.500520Z INFO garage_table::sync: block_ref: Adding full sync for ack layout version 1 lb # [ 626.787840] garage[898]: 2026-11-12T09:28:48.500688Z INFO garage_table::sync: k2v_item: Adding full sync for ack layout version 1 lb # [ 626.793226] garage[898]: 2026-11-12T09:28:48.500854Z INFO garage_table::sync: k2v_index_counter_v2: Adding full sync for ack layout version 1 worker1 # [ 625.499925] nix-grpc-daemon[2487]: time=2026-11-12T09:28:49.292Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" lb # [ 626.798426] garage[898]: 2026-11-12T09:28:48.507792Z INFO garage_table::sync: bucket_mpu_counter: Completed full sync for ack layout version 1 worker1 # [ 625.501930] nix-grpc-daemon[2487]: time=2026-11-12T09:28:49.292Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" worker1 # [ 625.515155] nix-grpc-daemon[2487]: time=2026-11-12T09:28:49.308Z level=INFO msg="Uploading 1 narinfos" lb # [ 626.806563] garage[898]: 2026-11-12T09:28:48.507832Z INFO garage_table::sync: version: Completed full sync for ack layout version 1 worker1 # [ 625.523645] nix-grpc-daemon[2487]: time=2026-11-12T09:28:49.317Z level=INFO msg="Upload complete. (207ms)" lb # [ 626.823368] garage[898]: 2026-11-12T09:28:48.507849Z INFO garage_table::sync: block_ref: Completed full sync for ack layout version 1 lb # [ 626.826219] garage[898]: 2026-11-12T09:28:48.507864Z INFO garage_table::sync: k2v_item: Completed full sync for ack layout version 1 lb # [ 626.829769] garage[898]: 2026-11-12T09:28:48.507880Z INFO garage_table::sync: k2v_index_counter_v2: Completed full sync for ack layout version 1 worker1 # [ 625.531277] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=20 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 626.833426] garage[898]: 2026-11-12T09:28:48.562244Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092848Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=af52092cf9976c4ffa3cc2a56753fb51d0e1870f06929d30557126e553b89928 worker1 # [ 625.545769] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:49Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 lb # [ 626.841467] garage[898]: 2026-11-12T09:28:48.562862Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092848Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7ea56f238c5ea7f572e5643a0e3dfe4abafbab1df68c49a696a05986cb2196dd worker1 # [ 625.548484] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 worker1 # [ 625.552403] nix-daemon[1059]: reaped child process 3444, status = succeeded lb # [ 626.849585] garage[898]: 2026-11-12T09:28:48.563200Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092848Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e41dfd494aa734692fa87f97e0163a3790542792aec8577e9c6740ab61ae133f lb # [ 626.857635] garage[898]: 2026-11-12T09:28:48.571163Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls worker1 # [ 625.563800] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:49Z level=debug event=want client=8 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 lb # [ 626.863773] garage[898]: 2026-11-12T09:28:48.571747Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst worker1 # [ 625.567915] nix-grpc-daemon[2296]: copying path '/nix/store/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv' from 'http://lb:5751'... lb # [ 626.868595] niks3-server[1454]: 2026/11/12 09:28:48 INFO Received push request method=POST path=/api/pushes lb # [ 626.870292] niks3-server[1454]: 2026/11/12 09:28:48 INFO Received sign narinfos request method=POST path=/api/pushes/67/sign lb # [ 626.873184] niks3-server[1454]: 2026/11/12 09:28:48 INFO Signed narinfos id=67 count=1 lb # [ 626.875497] niks3-server[1454]: 2026/11/12 09:28:48 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 626.878392] niks3-server[1454]: 2026/11/12 09:28:48 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 626.880322] niks3-server[1454]: 2026/11/12 09:28:48 INFO Received complete push request method=POST path=/api/pushes/67/complete lb # [ 626.882126] niks3-server[1454]: 2026/11/12 09:28:48 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker1 # [ 625.583489] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 626.883967] niks3-server[1454]: 2026/11/12 09:28:48 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo lb # [ 626.885963] niks3-server[1454]: 2026/11/12 09:28:48 INFO Completed push id=67 objects=4 duration=3.4034ms lb # [ 626.887369] garage[898]: 2026-11-12T09:28:48.575096Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092848Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dd27c2d803b294916b7b668efaab7cfa82bfc952866cb782b2f7d72e2e7740ef worker1 # [ 625.593917] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 626.893994] garage[898]: 2026-11-12T09:28:48.575549Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 626.896893] garage[898]: 2026-11-12T09:28:48.581845Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo lb # [ 626.899548] garage[898]: 2026-11-12T09:28:48.622297Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo lb # [ 626.902359] garage[898]: 2026-11-12T09:28:48.623199Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) GET /farm/sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo lb # [ 626.905154] garage[898]: 2026-11-12T09:28:48.632602Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst lb # [ 626.908020] garage[898]: 2026-11-12T09:28:48.634886Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) GET /farm/nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst lb # [ 628.156915] garage[898]: 2026-11-12T09:28:49.915203Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo lb # [ 628.161392] garage[898]: 2026-11-12T09:28:49.915677Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 627.256944] nix-daemon[1059]: reaped child process 3473, status = succeeded worker1 # [ 627.362017] nix-daemon[1059]: accepted connection from pid 3489, user nix-grpc-daemon (trusted) worker1 # [ 627.387077] nix-daemon[1059]: reaped child process 3492, status = succeeded lb # [ 628.688545] niks3-server[1454]: 2026/11/12 09:28:50 INFO Received push request method=POST path=/api/pushes worker1 # [ 627.399924] nix-grpc-daemon[2487]: time=2026-11-12T09:28:51.190Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 627.401846] nix-grpc-daemon[2487]: time=2026-11-12T09:28:51.190Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 628.699757] garage[898]: 2026-11-12T09:28:50.459194Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092850Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8657fa36902dfbc6c9af2806cc56d8a56ea3854ac6d45a3394673b92dc9f26cd worker1 # [ 627.418990] nix-grpc-daemon[2487]: time=2026-11-12T09:28:51.212Z level=INFO msg="Uploading 1 narinfos" lb # [ 628.726296] garage[898]: 2026-11-12T09:28:50.470336Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/g5laypvfk2469p8binw3mksk2hv7zhnh.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092850Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5df0ae0ebeec9252519e741e31a6f8576e1861dc864aa293d5da47a2236b7987 lb # [ 628.735078] garage[898]: 2026-11-12T09:28:50.470830Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092850Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b44edf0c22a700ad4fc6a101afefa01c5a2632f57dd892c35d5b29ed208da824 worker1 # [ 627.446246] nix-grpc-daemon[2487]: time=2026-11-12T09:28:51.240Z level=INFO msg="Upload complete. (239ms)" lb # [ 628.745820] garage[898]: 2026-11-12T09:28:50.474040Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 628.752275] garage[898]: 2026-11-12T09:28:50.477003Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst worker1 # [ 627.456874] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=21 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 628.757698] garage[898]: 2026-11-12T09:28:50.477451Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 628.763045] garage[898]: 2026-11-12T09:28:50.480247Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092850Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5533dcd777a92c372ab8b4262d6ff7a4e21f223c0c15bf16bbb3265af2757469 lb # [ 628.772869] niks3-server[1454]: 2026/11/12 09:28:50 INFO Received sign narinfos request method=POST path=/api/pushes/68/sign worker1 # [ 627.472283] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:51Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 lb # [ 628.775181] niks3-server[1454]: 2026/11/12 09:28:50 INFO Signed narinfos id=68 count=1 worker1 # [ 627.477828] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 628.778593] niks3-server[1454]: 2026/11/12 09:28:50 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker1 # [ 627.482212] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:51Z level=debug event=want client=8 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 627.485197] nix-daemon[1059]: reaped child process 3471, status = succeeded lb # [ 628.782089] niks3-server[1454]: 2026/11/12 09:28:50 INFO Received complete push request method=POST path=/api/pushes/68/complete lb # [ 628.787191] niks3-server[1454]: 2026/11/12 09:28:50 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst worker1 # [ 627.488546] nix-grpc-daemon[2296]: copying path '/nix/store/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv' from 'http://lb:5751'... lb # [ 628.790460] niks3-server[1454]: 2026/11/12 09:28:50 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 628.795125] niks3-server[1454]: 2026/11/12 09:28:50 INFO Completed push id=68 objects=4 duration=22.46498ms lb # [ 628.797364] niks3-server[1454]: 2026/11/12 09:28:50 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker1 # [ 627.501050] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 628.799663] garage[898]: 2026-11-12T09:28:50.484485Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo lb # [ 628.803817] garage[898]: 2026-11-12T09:28:50.545230Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo lb # [ 628.807603] garage[898]: 2026-11-12T09:28:50.546107Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) GET /farm/7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo lb # [ 628.811269] garage[898]: 2026-11-12T09:28:50.553641Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst worker1 # [ 627.514649] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 628.815978] garage[898]: 2026-11-12T09:28:50.554448Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) GET /farm/nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst lb # [ 629.400108] postgres[809]: [809] LOG: checkpoint complete: wrote 51 buffers (0.3%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=5.135 s, sync=0.011 s, total=5.159 s; sync files=27, longest=0.004 s, average=0.001 s; distance=488 kB, estimate=4796 kB; lsn=0/1D167D8, redo lsn=0/1D07320 worker2 # [ 626.582906] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 626.591240] systemd[2780]: Activating special unit Exit the Session... worker2 # [ 626.597240] systemd[2780]: Stopped target Main User Target. worker2 # [ 626.599644] systemd[2780]: Stopped target Basic System. worker2 # [ 626.602677] systemd[2780]: Stopped target Paths. worker2 # [ 626.603860] systemd[2780]: Stopped target Sockets. worker2 # [ 626.607449] systemd[2780]: Stopped target Timers. worker2 # [ 626.608806] systemd[2780]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 626.610528] systemd[2780]: Closed D-Bus User Message Bus Socket. worker2 # [ 626.611945] systemd[2780]: Stopped Create User Files and Directories. worker2 # [ 626.613668] systemd[2780]: Removed slice User Application Slice. worker2 # [ 626.615134] systemd[2780]: Reached target Shutdown. worker2 # [ 626.616553] systemd[2780]: Finished Exit the Session. worker2 # [ 626.617727] systemd[2780]: Reached target Exit the Session. worker2 # [ 626.625899] systemd-logind[515]: Removed session 81. worker2 # [ 626.634063] systemd[1]: user@0.service: Deactivated successfully. lb # [ 629.488192] garage[898]: 2026-11-12T09:28:51.246630Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker2 # [ 626.639420] systemd[1]: Stopped User Manager for UID 0. lb # [ 629.492972] garage[898]: 2026-11-12T09:28:51.247080Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 626.654804] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 626.692859] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 626.698392] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 626.704205] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 628.576809] nix-daemon[1059]: reaped child process 3500, status = succeeded worker1 # [ 628.675245] nix-daemon[1059]: accepted connection from pid 3516, user nix-grpc-daemon (trusted) lb # [ 630.002316] niks3-server[1454]: 2026/11/12 09:28:51 INFO Received push request method=POST path=/api/pushes worker1 # [ 628.705429] nix-daemon[1059]: reaped child process 3519, status = succeeded worker1 # [ 628.712587] nix-grpc-daemon[2487]: time=2026-11-12T09:28:52.504Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 628.714317] nix-grpc-daemon[2487]: time=2026-11-12T09:28:52.505Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" worker1 # [ 628.731400] nix-grpc-daemon[2487]: time=2026-11-12T09:28:52.525Z level=INFO msg="Uploading 1 narinfos" lb # [ 630.019008] garage[898]: 2026-11-12T09:28:51.778395Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092851Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f192e720dfab0d6fa3f2207543ff81dd70259772c1c12a061c1d079d2b42f333 lb # [ 630.043053] garage[898]: 2026-11-12T09:28:51.788028Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092851Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=20a3d2b0f023d060758415b21de22f2c7fc9173597cba2aef226013f8c88ea49 worker1 # [ 628.751698] nix-grpc-daemon[2487]: time=2026-11-12T09:28:52.545Z level=INFO msg="Upload complete. (225ms)" lb # [ 630.051208] garage[898]: 2026-11-12T09:28:51.788453Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092851Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=32b164b12a5817747b0a455439a69617b4446165e64b4fb7142b2104279561c1 lb # [ 630.058323] garage[898]: 2026-11-12T09:28:51.791671Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst worker1 # [ 628.760868] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=22 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 628.771767] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:52Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 628.777974] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 630.073975] garage[898]: 2026-11-12T09:28:51.792231Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092851Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=112d23a0e119d544cfbb84d0ce79d7c2e8dc2e7da3d6cdd81532eb11aad279e3 worker1 # [ 628.781872] nix-daemon[1059]: reaped child process 3498, status = succeeded worker1 # [ 628.784716] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:52Z level=debug event=want client=8 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 628.789276] nix-grpc-daemon[2296]: copying path '/nix/store/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv' from 'http://lb:5751'... lb # [ 630.087598] garage[898]: 2026-11-12T09:28:51.792591Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 630.095111] garage[898]: 2026-11-12T09:28:51.797375Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo lb # [ 630.099023] niks3-server[1454]: 2026/11/12 09:28:51 INFO Received sign narinfos request method=POST path=/api/pushes/69/sign lb # [ 630.101066] niks3-server[1454]: 2026/11/12 09:28:51 INFO Signed narinfos id=69 count=1 lb # [ 630.102197] niks3-server[1454]: 2026/11/12 09:28:51 INFO Received complete push request method=POST path=/api/pushes/69/complete worker1 # [ 628.802984] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 630.103769] niks3-server[1454]: 2026/11/12 09:28:51 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 630.105487] niks3-server[1454]: 2026/11/12 09:28:51 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 630.107362] niks3-server[1454]: 2026/11/12 09:28:51 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 630.109335] niks3-server[1454]: 2026/11/12 09:28:51 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo lb # [ 630.111692] niks3-server[1454]: 2026/11/12 09:28:51 INFO Completed push id=69 objects=8 duration=15.87892ms worker1 # [ 628.812717] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 630.113822] systemd[1]: Stopping User Manager for UID 0... lb # [ 630.114726] garage[898]: 2026-11-12T09:28:51.797835Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 630.119799] garage[898]: 2026-11-12T09:28:51.844194Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo lb # [ 630.122847] garage[898]: 2026-11-12T09:28:51.846271Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) GET /farm/cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo lb # [ 630.125792] garage[898]: 2026-11-12T09:28:51.852810Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst lb # [ 630.129066] garage[898]: 2026-11-12T09:28:51.853763Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) GET /farm/nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst lb # [ 630.132410] systemd[2116]: Activating special unit Exit the Session... lb # [ 630.133378] systemd[2116]: Stopped target Main User Target. lb # [ 630.134190] systemd[2116]: Stopped target Basic System. lb # [ 630.134945] systemd[2116]: Stopped target Paths. lb # [ 630.135613] systemd[2116]: Stopped target Sockets. lb # [ 630.143549] systemd[2116]: Stopped target Timers. lb # [ 630.146558] systemd[2116]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 630.147677] systemd[2116]: Closed D-Bus User Message Bus Socket. lb # [ 630.152335] systemd[2116]: Stopped Create User Files and Directories. lb # [ 630.153350] systemd[2116]: Removed slice User Application Slice. lb # [ 630.154235] systemd[2116]: Reached target Shutdown. lb # [ 630.154962] systemd[2116]: Finished Exit the Session. lb # [ 630.157858] systemd[2116]: Reached target Exit the Session. lb # [ 630.159011] systemd-logind[499]: Removed session 69. lb # [ 630.159762] systemd[1]: user@0.service: Deactivated successfully. lb # [ 630.160859] systemd[1]: Stopped User Manager for UID 0. lb # [ 630.202473] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 630.239672] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 630.243427] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 630.245874] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 629.288956] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 629.294722] systemd[3280]: Activating special unit Exit the Session... worker1 # [ 629.298354] systemd[3280]: Stopped target Main User Target. worker1 # [ 629.299486] systemd[3280]: Stopped target Basic System. worker1 # [ 629.303559] systemd[3280]: Stopped target Paths. worker1 # [ 629.304907] systemd[3280]: Stopped target Sockets. worker1 # [ 629.305714] systemd[3280]: Stopped target Timers. worker1 # [ 629.306472] systemd[3280]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 629.307548] systemd[3280]: Closed D-Bus User Message Bus Socket. worker1 # [ 629.309360] systemd[3280]: Stopped Create User Files and Directories. worker1 # [ 629.310415] systemd[3280]: Removed slice User Application Slice. worker1 # [ 629.311357] systemd[3280]: Reached target Shutdown. worker1 # [ 629.312429] systemd[3280]: Finished Exit the Session. worker1 # [ 629.313270] systemd[3280]: Reached target Exit the Session. worker1 # [ 629.334300] systemd-logind[539]: Removed session 119. worker1 # [ 629.350442] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 629.355657] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 629.366982] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 629.409334] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 629.412796] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 629.418969] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 630.804893] garage[898]: 2026-11-12T09:28:52.563179Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo lb # [ 630.809599] garage[898]: 2026-11-12T09:28:52.563648Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 629.846450] nix-daemon[1059]: reaped child process 3527, status = succeeded worker1 # [ 629.992873] nix-daemon[1059]: accepted connection from pid 3548, user nix-grpc-daemon (trusted) lb # [ 631.316865] niks3-server[1454]: 2026/11/12 09:28:53 INFO Received push request method=POST path=/api/pushes worker1 # [ 630.021058] nix-daemon[1059]: reaped child process 3551, status = succeeded worker1 # [ 630.024675] nix-grpc-daemon[2487]: time=2026-11-12T09:28:53.818Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 630.030098] nix-grpc-daemon[2487]: time=2026-11-12T09:28:53.820Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" worker1 # [ 630.049718] nix-grpc-daemon[2487]: time=2026-11-12T09:28:53.843Z level=INFO msg="Uploading 1 narinfos" lb # [ 631.329458] garage[898]: 2026-11-12T09:28:53.088913Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092853Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8a930da6c915201e776e7bff8c2030e5e0af824aef6daa1dd771c07cb7a8af50 lb # [ 631.353719] garage[898]: 2026-11-12T09:28:53.100217Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092853Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7d11ee974298e2da6bf6bfc810c2f85f238e037d939ee998fbeb1738bfd24189 lb # [ 631.368521] garage[898]: 2026-11-12T09:28:53.100698Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092853Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=528fe49adcb052d6fbfb5854d5d1619e036865106e9fe17a48cdc784e0e2771c lb # [ 631.378600] garage[898]: 2026-11-12T09:28:53.103400Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst worker1 # [ 630.079061] nix-grpc-daemon[2487]: time=2026-11-12T09:28:53.872Z level=INFO msg="Upload complete. (254ms)" lb # [ 631.384724] garage[898]: 2026-11-12T09:28:53.104758Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker1 # [ 630.088823] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=23 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 631.389721] garage[898]: 2026-11-12T09:28:53.107221Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 631.396335] garage[898]: 2026-11-12T09:28:53.109752Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092853Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aaf7429fc73ca085927a05b2f07a245386f6e4233cf161390009aa8650d92eb2 worker1 # [ 630.100867] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:53Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 lb # [ 631.402879] niks3-server[1454]: 2026/11/12 09:28:53 INFO Received sign narinfos request method=POST path=/api/pushes/70/sign worker1 # [ 630.103637] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 631.404935] niks3-server[1454]: 2026/11/12 09:28:53 INFO Signed narinfos id=70 count=1 worker1 # [ 630.107481] nix-daemon[1059]: reaped child process 3525, status = succeeded worker1 # [ 630.110245] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:53Z level=debug event=want client=8 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 lb # [ 631.409703] niks3-server[1454]: 2026/11/12 09:28:53 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst lb # [ 631.412206] niks3-server[1454]: 2026/11/12 09:28:53 INFO Received complete push request method=POST path=/api/pushes/70/complete worker1 # [ 630.112917] nix-grpc-daemon[2296]: copying path '/nix/store/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv' from 'http://lb:5751'... lb # [ 631.413873] niks3-server[1454]: 2026/11/12 09:28:53 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 631.417740] niks3-server[1454]: 2026/11/12 09:28:53 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 631.419516] niks3-server[1454]: 2026/11/12 09:28:53 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo lb # [ 631.421536] niks3-server[1454]: 2026/11/12 09:28:53 INFO Completed push id=70 objects=8 duration=26.12354ms worker1 # [ 630.122209] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 631.422992] garage[898]: 2026-11-12T09:28:53.124735Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo lb # [ 631.426103] garage[898]: 2026-11-12T09:28:53.167491Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo lb # [ 631.428978] garage[898]: 2026-11-12T09:28:53.168461Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) GET /farm/cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 630.133179] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 631.432400] garage[898]: 2026-11-12T09:28:53.176391Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst lb # [ 631.435584] garage[898]: 2026-11-12T09:28:53.177080Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) GET /farm/nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst lb # [ 632.238295] garage[898]: 2026-11-12T09:28:53.996877Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker1 # [ 631.384358] nix-daemon[1059]: reaped child process 3559, status = succeeded worker1 # [ 631.499329] nix-daemon[1059]: accepted connection from pid 3575, user nix-grpc-daemon (trusted) worker1 # [ 631.524998] nix-daemon[1059]: reaped child process 3578, status = succeeded lb # [ 632.243703] garage[898]: 2026-11-12T09:28:53.997333Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 632.826085] niks3-server[1454]: 2026/11/12 09:28:54 INFO Received push request method=POST path=/api/pushes worker1 # [ 631.541481] nix-grpc-daemon[2487]: time=2026-11-12T09:28:55.334Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 631.546486] nix-grpc-daemon[2487]: time=2026-11-12T09:28:55.337Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 632.846735] garage[898]: 2026-11-12T09:28:54.606130Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092854Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c55c7d2ef137d4d64e29f90ccb7241c145c15d71723705c55f34359c87651115 worker1 # [ 631.564558] nix-grpc-daemon[2487]: time=2026-11-12T09:28:55.358Z level=INFO msg="Uploading 1 narinfos" lb # [ 632.871020] garage[898]: 2026-11-12T09:28:54.616907Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092854Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b3024ba3d5f7728f696c3a7a44de9cb6c4827c01593e9fcc65bef6879162f051 lb # [ 632.882287] garage[898]: 2026-11-12T09:28:54.617367Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092854Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eac1e8f492814c14ebaf4cd049a9bca845abf55e97c8cc02578218fd899be646 lb # [ 632.891947] garage[898]: 2026-11-12T09:28:54.620340Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 632.897971] garage[898]: 2026-11-12T09:28:54.622189Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls worker1 # [ 631.604683] nix-grpc-daemon[2487]: time=2026-11-12T09:28:55.398Z level=INFO msg="Upload complete. (259ms)" lb # [ 632.903886] garage[898]: 2026-11-12T09:28:54.625180Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092854Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=08876b70d9d7df6f54efbbceda1f333f6cbfd4f764c8aea3c3f26fc7ec5d2e0d worker1 # [ 631.613023] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=24 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 632.914085] garage[898]: 2026-11-12T09:28:54.625629Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 632.919142] niks3-server[1454]: 2026/11/12 09:28:54 INFO Received sign narinfos request method=POST path=/api/pushes/71/sign lb # [ 632.921647] niks3-server[1454]: 2026/11/12 09:28:54 INFO Signed narinfos id=71 count=1 lb # [ 632.923264] niks3-server[1454]: 2026/11/12 09:28:54 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 632.926465] niks3-server[1454]: 2026/11/12 09:28:54 INFO Received complete push request method=POST path=/api/pushes/71/complete lb # [ 632.929671] niks3-server[1454]: 2026/11/12 09:28:54 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 632.931825] niks3-server[1454]: 2026/11/12 09:28:54 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo lb # [ 632.934462] niks3-server[1454]: 2026/11/12 09:28:54 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst worker1 # [ 631.633531] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:55Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 lb # [ 632.937009] niks3-server[1454]: 2026/11/12 09:28:54 INFO Completed push id=71 objects=8 duration=35.00588ms worker1 # [ 631.641942] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 632.942203] garage[898]: 2026-11-12T09:28:54.629085Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo lb # [ 632.946202] garage[898]: 2026-11-12T09:28:54.700653Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 631.649177] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:55Z level=debug event=want client=8 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 631.654901] nix-grpc-daemon[2296]: copying path '/nix/store/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv' from 'http://lb:5751'... lb # [ 632.954978] garage[898]: 2026-11-12T09:28:54.701522Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) GET /farm/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo lb # [ 632.958813] garage[898]: 2026-11-12T09:28:54.710579Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst worker1 # [ 631.661422] nix-daemon[1059]: reaped child process 3557, status = succeeded lb # [ 632.962611] garage[898]: 2026-11-12T09:28:54.711351Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) GET /farm/nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst worker1 # [ 631.666813] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) worker1 # [ 631.680915] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 634.056964] garage[898]: 2026-11-12T09:28:55.815136Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo lb # [ 634.061408] garage[898]: 2026-11-12T09:28:55.815661Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 633.136848] nix-daemon[1059]: reaped child process 3586, status = succeeded worker1 # [ 633.248988] nix-daemon[1059]: accepted connection from pid 3602, user nix-grpc-daemon (trusted) worker1 # [ 633.272844] nix-daemon[1059]: reaped child process 3605, status = succeeded lb # [ 634.579932] niks3-server[1454]: 2026/11/12 09:28:56 INFO Received push request method=POST path=/api/pushes worker1 # [ 633.290912] nix-grpc-daemon[2487]: time=2026-11-12T09:28:57.081Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 633.292955] nix-grpc-daemon[2487]: time=2026-11-12T09:28:57.081Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 634.590071] garage[898]: 2026-11-12T09:28:56.349459Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092856Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8e5411678097472a04ae6d2128adfd9c4e879db3d71bbddc9e9934d270efe591 worker1 # [ 633.309015] nix-grpc-daemon[2487]: time=2026-11-12T09:28:57.102Z level=INFO msg="Uploading 1 narinfos" lb # [ 634.617051] garage[898]: 2026-11-12T09:28:56.360336Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092856Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2bf8424ff738944884c456e91e50012c0a50acaca46e52946b35216561456494 lb # [ 634.625885] garage[898]: 2026-11-12T09:28:56.360812Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092856Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=21e0e9014a53cd8632368e27047b74123296ce80bf126bbdb5ccc790d584c731 worker1 # [ 633.336341] nix-grpc-daemon[2487]: time=2026-11-12T09:28:57.130Z level=INFO msg="Upload complete. (244ms)" lb # [ 634.636626] garage[898]: 2026-11-12T09:28:56.363756Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 634.642429] garage[898]: 2026-11-12T09:28:56.365641Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker1 # [ 633.344709] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=25 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 634.647725] garage[898]: 2026-11-12T09:28:56.368209Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 634.653824] garage[898]: 2026-11-12T09:28:56.369609Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092856Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c5eed6733c546edb71c2c88e0311f7c4133ae05e7f1b68d3a3483aa9457d2c1c worker1 # [ 633.361457] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:57Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 633.364494] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 634.665333] niks3-server[1454]: 2026/11/12 09:28:56 INFO Received sign narinfos request method=POST path=/api/pushes/72/sign lb # [ 634.667837] niks3-server[1454]: 2026/11/12 09:28:56 INFO Signed narinfos id=72 count=1 worker1 # [ 633.368895] nix-grpc-daemon[2296]: copying path '/nix/store/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv' from 'http://lb:5751'... lb # [ 634.669515] niks3-server[1454]: 2026/11/12 09:28:56 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls worker1 # [ 633.371893] nix-daemon[1059]: reaped child process 3584, status = succeeded lb # [ 634.671742] niks3-server[1454]: 2026/11/12 09:28:56 INFO Received complete push request method=POST path=/api/pushes/72/complete lb # [ 634.674098] niks3-server[1454]: 2026/11/12 09:28:56 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv lb # [ 634.678680] niks3-server[1454]: 2026/11/12 09:28:56 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 634.681475] niks3-server[1454]: 2026/11/12 09:28:56 INFO Completed push id=72 objects=12 duration=23.61512ms lb # [ 634.683290] niks3-server[1454]: 2026/11/12 09:28:56 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker1 # [ 633.385050] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 634.685756] garage[898]: 2026-11-12T09:28:56.374582Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo lb # [ 634.689337] garage[898]: 2026-11-12T09:28:56.423580Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo lb # [ 634.692963] garage[898]: 2026-11-12T09:28:56.424538Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) GET /farm/dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 633.395828] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 634.697135] garage[898]: 2026-11-12T09:28:56.434769Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst lb # [ 634.701253] garage[898]: 2026-11-12T09:28:56.435520Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) GET /farm/nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst lb # [ 635.381488] garage[898]: 2026-11-12T09:28:57.139961Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker1 # [ 634.489563] nix-daemon[1059]: reaped child process 3611, status = succeeded worker1 # [ 634.560421] nix-daemon[1059]: accepted connection from pid 3627, user nix-grpc-daemon (trusted) worker1 # [ 634.587869] nix-daemon[1059]: reaped child process 3630, status = succeeded lb # [ 635.386155] garage[898]: 2026-11-12T09:28:57.140449Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 635.892335] niks3-server[1454]: 2026/11/12 09:28:57 INFO Received push request method=POST path=/api/pushes worker1 # [ 634.606204] nix-grpc-daemon[2487]: time=2026-11-12T09:28:58.398Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 634.608217] nix-grpc-daemon[2487]: time=2026-11-12T09:28:58.398Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 635.906444] garage[898]: 2026-11-12T09:28:57.665759Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a33ac6a7398d1151610efdde4129b2816b51cac1b5e56cf79f722292f83d2ff0 worker1 # [ 634.625474] nix-grpc-daemon[2487]: time=2026-11-12T09:28:58.418Z level=INFO msg="Uploading 1 narinfos" lb # [ 635.931220] garage[898]: 2026-11-12T09:28:57.677000Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ee36076a1c7de57bc9a2471e7cfd282c71bf91ed6de65ab863a47b00d4b758cb lb # [ 635.940520] garage[898]: 2026-11-12T09:28:57.677445Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0fbec086ac5116058d119743ecb5440071123960e3bd38e7b02beba5f015486e lb # [ 635.951084] garage[898]: 2026-11-12T09:28:57.681116Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls worker1 # [ 634.659147] nix-grpc-daemon[2487]: time=2026-11-12T09:28:58.452Z level=INFO msg="Upload complete. (249ms)" lb # [ 635.959282] garage[898]: 2026-11-12T09:28:57.681586Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 635.966135] garage[898]: 2026-11-12T09:28:57.685334Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst worker1 # [ 634.668950] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=26 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 635.971500] garage[898]: 2026-11-12T09:28:57.685845Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f895a614bffa7c1a7ec8d81a1055bbaf85f6d384470cb9ba7d7b182d411275c0 lb # [ 635.982057] niks3-server[1454]: 2026/11/12 09:28:57 INFO Received sign narinfos request method=POST path=/api/pushes/73/sign lb # [ 635.984364] niks3-server[1454]: 2026/11/12 09:28:57 INFO Signed narinfos id=73 count=1 worker1 # [ 634.684432] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:58Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 lb # [ 635.985897] niks3-server[1454]: 2026/11/12 09:28:57 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker1 # [ 634.687602] nix-grpc-daemon[2296]: ts=2026-11-12T09:28:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 635.988312] niks3-server[1454]: 2026/11/12 09:28:57 INFO Received complete push request method=POST path=/api/pushes/73/complete lb # [ 635.990200] niks3-server[1454]: 2026/11/12 09:28:57 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls worker1 # [ 634.692609] nix-grpc-daemon[2296]: copying path '/nix/store/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv' from 'http://lb:5751'... lb # [ 635.992314] niks3-server[1454]: 2026/11/12 09:28:57 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst lb # [ 635.994611] niks3-server[1454]: 2026/11/12 09:28:57 INFO Completed push id=73 objects=12 duration=29.73272ms worker1 # [ 634.697072] nix-daemon[1059]: reaped child process 3609, status = succeeded lb # [ 635.998781] niks3-server[1454]: 2026/11/12 09:28:57 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo lb # [ 636.001216] garage[898]: 2026-11-12T09:28:57.689186Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo lb # [ 636.004653] garage[898]: 2026-11-12T09:28:57.740310Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 634.707363] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 636.007836] garage[898]: 2026-11-12T09:28:57.741213Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) GET /farm/qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo lb # [ 636.011399] garage[898]: 2026-11-12T09:28:57.757108Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst lb # [ 636.015002] garage[898]: 2026-11-12T09:28:57.757850Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) GET /farm/nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 634.718606] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) lb # [ 637.172283] garage[898]: 2026-11-12T09:28:58.930809Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo lb # [ 637.177267] garage[898]: 2026-11-12T09:28:58.931267Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 636.159763] nix-daemon[1059]: reaped child process 3636, status = succeeded worker1 # [ 636.277322] nix-daemon[1059]: accepted connection from pid 3652, user nix-grpc-daemon (trusted) lb # [ 637.605092] niks3-server[1454]: 2026/11/12 09:28:59 INFO Received push request method=POST path=/api/pushes worker1 # [ 636.308697] nix-daemon[1059]: reaped child process 3655, status = succeeded worker1 # [ 636.316840] nix-grpc-daemon[2487]: time=2026-11-12T09:29:00.108Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 636.318540] nix-grpc-daemon[2487]: time=2026-11-12T09:29:00.108Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 637.616495] garage[898]: 2026-11-12T09:28:59.375928Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092859Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=52fbf4f1a330818d81988ebf232dca45dcf397590ea7ee1df183d99c678f7a48 worker1 # [ 636.335654] nix-grpc-daemon[2487]: time=2026-11-12T09:29:00.129Z level=INFO msg="Uploading 1 narinfos" lb # [ 637.640958] garage[898]: 2026-11-12T09:28:59.386667Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092859Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cef47fb0b4035269c50a1d0a4798093bc7de6db9dd472d9723ebaf2020015b26 lb # [ 637.651133] garage[898]: 2026-11-12T09:28:59.387112Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/iagwbb072hnm79qb9wsrjp5907zc7aa2.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092859Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f9c522695c84ca471419899e2316cb64ec9aba62c9222b5e3ccf3434247bc1e4 lb # [ 637.661620] garage[898]: 2026-11-12T09:28:59.389844Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 637.666037] garage[898]: 2026-11-12T09:28:59.390921Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 637.671885] garage[898]: 2026-11-12T09:28:59.393204Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst lb # [ 637.677596] garage[898]: 2026-11-12T09:28:59.395602Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092859Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=79845d201e549c44213243296f65c58fc33f5c04b6621f4fe7c06f6870437902 worker1 # [ 636.387671] nix-grpc-daemon[2487]: time=2026-11-12T09:29:00.181Z level=INFO msg="Upload complete. (256ms)" lb # [ 637.687365] niks3-server[1454]: 2026/11/12 09:28:59 INFO Received sign narinfos request method=POST path=/api/pushes/74/sign lb # [ 637.689856] niks3-server[1454]: 2026/11/12 09:28:59 INFO Signed narinfos id=74 count=1 lb # [ 637.692093] niks3-server[1454]: 2026/11/12 09:28:59 INFO Received complete push request method=POST path=/api/pushes/74/complete lb # [ 637.695001] niks3-server[1454]: 2026/11/12 09:28:59 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 637.697937] niks3-server[1454]: 2026/11/12 09:28:59 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst worker1 # [ 636.396947] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=27 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 637.700775] niks3-server[1454]: 2026/11/12 09:28:59 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo lb # [ 637.703191] niks3-server[1454]: 2026/11/12 09:28:59 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 637.706200] niks3-server[1454]: 2026/11/12 09:28:59 INFO Completed push id=74 objects=12 duration=49.24196ms lb # [ 637.708203] garage[898]: 2026-11-12T09:28:59.399682Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 636.413560] nix-daemon[1059]: reaped child process 3634, status = succeeded client # [ 636.426129] sshd-session[2494]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 636.426478] sshd-session[2494]: Disconnected from user root UNKNOWN port 65535 client # [ 636.431223] sshd-session[2472]: pam_unix(sshd:session): session closed for user root client # [ 636.437955] systemd[1]: sshd-vsock@80-81-3:22-2:80.service: Deactivated successfully. client # [ 636.445628] systemd[1]: session-97.scope: Deactivated successfully. client # [ 636.448455] systemd[1]: session-97.scope: Consumed 252ms CPU time over 14.886s wall clock time, 48.7M memory peak, 23.7K incoming IP traffic, 26.9K outgoing IP traffic. client # [ 636.458103] systemd-logind[427]: Session 97 logged out. Waiting for processes to exit. client # [ 636.459879] systemd-logind[427]: Removed session 97. [e2e] heartbeat t=540s worker1 # [ 638.285659] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 638.295456] systemd[1]: Started SSH per-connection Daemon (vsock:2:114). worker1 # [ 638.401282] sshd-session[3657]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 638.411128] sshd-session[3657]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 638.420639] sshd-session[3657]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 638.441486] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 638.450432] systemd-logind[539]: New session '129' of user 'root' with class 'user' and type 'tty'. worker1 # [ 638.482147] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 638.488927] systemd[1]: Starting User Manager for UID 0... worker1 # [ 638.519098] (systemd)[3665]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 638.525336] systemd-logind[539]: New session '130' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 638.616204] systemd[3665]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 638.718827] systemd[3665]: Queued start job for default target Main User Target. worker1 # [ 638.725089] systemd[3665]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 638.729606] systemd[3665]: Created slice User Application Slice. worker1 # [ 638.730644] systemd[3665]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 638.731694] systemd[3665]: Reached target Paths. worker1 # [ 638.735215] systemd[3665]: Reached target Timers. worker1 # [ 638.735999] systemd[3665]: Starting D-Bus User Message Bus Socket... worker1 # [ 638.740403] systemd[3665]: Starting Create User Files and Directories... worker1 # [ 638.786669] systemd[3665]: Listening on D-Bus User Message Bus Socket. worker1 # [ 638.789065] systemd[3665]: Finished Create User Files and Directories. worker1 # [ 638.790129] systemd[3665]: Reached target Sockets. worker1 # [ 638.790878] systemd[3665]: Reached target Basic System. worker1 # [ 638.791659] systemd[3665]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 638.797411] systemd[3665]: Reached target Main User Target. worker1 # [ 638.798313] systemd[3665]: Startup finished in 246ms. worker1 # [ 638.799064] systemd[1]: Started User Manager for UID 0. worker1 # [ 638.807051] systemd[1]: Started Session 129 of User root. worker1 # [ 638.839784] sshd-session[3678]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 638.842635] sshd-session[3678]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 638.844188] sshd-session[3657]: pam_unix(sshd:session): session closed for user root worker1 # [ 638.848157] systemd[1]: sshd-vsock@114-115-5:22-2:114.service: Deactivated successfully. worker1 # [ 638.854047] systemd[1]: session-129.scope: Deactivated successfully. worker1 # [ 638.857432] systemd[1]: session-129.scope: Consumed 26ms CPU time over 50ms wall clock time, 3M memory peak, 19.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 638.861484] systemd-logind[539]: Session 129 logged out. Waiting for processes to exit. worker1 # [ 638.864659] systemd-logind[539]: Removed session 129. client # [ 641.325683] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 641.334554] systemd[1]: Started SSH per-connection Daemon (vsock:2:81). client # [ 641.439063] sshd-session[2518]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 641.449846] sshd-session[2518]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 641.458842] sshd-session[2518]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 641.471163] systemd-logind[427]: New session '99' of user 'root' with class 'user' and type 'tty'. client # [ 641.476654] systemd[1]: Started Session 99 of User root. client # [ 641.509868] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.pem&client-key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/2zk3qv1skksv9a9hghi3729fwn8rlq2g-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # [ 641.528430] sshd-session[2524]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 641.530041] sshd-session[2524]: Disconnected from user root UNKNOWN port 65535 client # [ 641.531101] sshd-session[2518]: pam_unix(sshd:session): session closed for user root client # [ 641.536968] systemd[1]: sshd-vsock@81-82-3:22-2:81.service: Deactivated successfully. client # [ 641.545227] systemd[1]: session-99.scope: Deactivated successfully. client # [ 641.551760] systemd-logind[427]: Session 99 logged out. Waiting for processes to exit. client # [ 641.556413] systemd-logind[427]: Removed session 99. client # [ 641.724158] nix[2527]: don't know how to build these paths: client # [ 641.725394] nix[2527]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv worker1 # [ 641.727333] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44014 worker1 # [ 641.732997] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 643.039370] garage[898]: 2026-11-12T09:29:04.797910Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/ipni94a5h3jc2w60paa9lsqiw3ayqpz3.narinfo worker1 # [ 641.752063] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 643.046484] garage[898]: 2026-11-12T09:29:04.799980Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 643.046663] garage[898]: 2026-11-12T09:29:04.805267Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/dkcjw7h7g8iyw1jh974kya4926cf9qwq.narinfo lb # [ 643.046719] garage[898]: 2026-11-12T09:29:04.805683Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 643.046780] garage[898]: 2026-11-12T09:29:04.805838Z INFO garage_api_common::generic_server: 127.0.0.1:37728 (key GK0123456789abcdef01234567) HEAD /farm/xw58x4psw447dqjwvykry3hr6mwsfk6g.narinfo lb # [ 643.047620] garage[898]: 2026-11-12T09:29:04.807249Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 643.057332] garage[898]: 2026-11-12T09:29:04.816822Z INFO garage_api_common::generic_server: 127.0.0.1:37728 (key GK0123456789abcdef01234567) HEAD /farm/dkcjw7h7g8iyw1jh974kya4926cf9qwq.narinfo lb # [ 643.080225] garage[898]: 2026-11-12T09:29:04.817245Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 643.085080] garage[898]: 2026-11-12T09:29:04.844183Z INFO garage_api_common::generic_server: 127.0.0.1:37728 (key GK0123456789abcdef01234567) HEAD /farm/dkcjw7h7g8iyw1jh974kya4926cf9qwq.narinfo lb # [ 643.089617] garage[898]: 2026-11-12T09:29:04.844574Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 640.245264] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 643.103795] garage[898]: 2026-11-12T09:29:04.863165Z INFO garage_api_common::generic_server: 127.0.0.1:37728 (key GK0123456789abcdef01234567) HEAD /farm/xw58x4psw447dqjwvykry3hr6mwsfk6g.narinfo lb # [ 643.109124] garage[898]: 2026-11-12T09:29:04.863619Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 643.114422] garage[898]: 2026-11-12T09:29:04.873376Z INFO garage_api_common::generic_server: 127.0.0.1:37728 (key GK0123456789abcdef01234567) HEAD /farm/xw58x4psw447dqjwvykry3hr6mwsfk6g.narinfo lb # [ 643.120276] garage[898]: 2026-11-12T09:29:04.873851Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 641.826085] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 643.131364] garage[898]: 2026-11-12T09:29:04.890798Z INFO garage_api_common::generic_server: 127.0.0.1:37728 (key GK0123456789abcdef01234567) HEAD /farm/ipni94a5h3jc2w60paa9lsqiw3ayqpz3.narinfo lb # [ 643.137201] garage[898]: 2026-11-12T09:29:04.891248Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 643.142191] garage[898]: 2026-11-12T09:29:04.901236Z INFO garage_api_common::generic_server: 127.0.0.1:37728 (key GK0123456789abcdef01234567) HEAD /farm/ipni94a5h3jc2w60paa9lsqiw3ayqpz3.narinfo lb # [ 643.147592] garage[898]: 2026-11-12T09:29:04.901664Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 640.300061] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 643.159551] garage[898]: 2026-11-12T09:29:04.918696Z INFO garage_api_common::generic_server: 127.0.0.1:37728 (key GK0123456789abcdef01234567) HEAD /farm/1jn0w6x679ijjxwcfb2gxc6lw2fxim2k.narinfo lb # [ 643.166734] garage[898]: 2026-11-12T09:29:04.919146Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 641.868353] nix[2527]: copying 3 paths to 'lb:50051'... lb # [ 643.171536] garage[898]: 2026-11-12T09:29:04.924211Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/bryy928wsl4vzss08v7g88isa7zilsd1.narinfo client # [ 641.872129] nix[2527]: copying path '/nix/store/1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' to 'lb:50051'... lb # [ 643.176964] garage[898]: 2026-11-12T09:29:04.924557Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 641.874852] nix[2527]: copying path '/nix/store/bryy928wsl4vzss08v7g88isa7zilsd1-farm-b.drv' to 'lb:50051'... worker1 # [ 641.878377] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44014 lb # [ 643.180182] garage[898]: 2026-11-12T09:29:04.925892Z INFO garage_api_common::generic_server: 127.0.0.1:37728 (key GK0123456789abcdef01234567) HEAD /farm/3i1nziwpdqq19lzpqy4rywzxnm8dlps6.narinfo client # [ 641.878150] nix[2527]: copying path '/nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv' to 'lb:50051'... lb # [ 643.184734] garage[898]: 2026-11-12T09:29:04.926249Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 641.893695] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) worker1 # [ 641.913189] nix-daemon[1059]: accepted connection from pid 2296, user nix-grpc-daemon (trusted) worker1 # [ 642.054721] nix-daemon[1059]: accepted connection from pid 3687, user nix-grpc-daemon (trusted) lb # [ 643.378092] niks3-server[1454]: 2026/11/12 09:29:05 INFO Received push request method=POST path=/api/pushes worker1 # [ 642.084069] nix-daemon[1059]: reaped child process 3690, status = succeeded worker1 # [ 642.088651] nix-grpc-daemon[2487]: time=2026-11-12T09:29:05.880Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker1 # [ 642.090343] nix-grpc-daemon[2487]: time=2026-11-12T09:29:05.880Z level=INFO msg="Uploading 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv (512B)" worker1 # [ 642.092441] nix-grpc-daemon[2487]: time=2026-11-12T09:29:05.880Z level=INFO msg="Uploading 3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv (752B)" worker1 # [ 642.094211] nix-grpc-daemon[2487]: time=2026-11-12T09:29:05.880Z level=INFO msg="Uploading bryy928wsl4vzss08v7g88isa7zilsd1-farm-b.drv (624B)" worker1 # [ 642.108506] nix-grpc-daemon[2487]: time=2026-11-12T09:29:05.901Z level=INFO msg="Uploading 3 narinfos" lb # [ 643.387955] garage[898]: 2026-11-12T09:29:05.147235Z INFO garage_api_common::generic_server: 192.168.1.3:38732 PUT /farm/nar/1vhsny5g5d5bsxa5s31i6fi9963mbqmvx0dc91v2bc4y9hn0gczf.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092905Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=93a5636c7ee2904a1b3055222f62653f2c90c01907c033ee89367cb52bf6928e lb # [ 643.414984] garage[898]: 2026-11-12T09:29:05.158645Z INFO garage_api_common::generic_server: 192.168.1.3:34162 PUT /farm/bryy928wsl4vzss08v7g88isa7zilsd1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092905Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0fb4ec26ca87b94c91468a66166473a04d5d3011b96eff7b84df2756943cf0bb lb # [ 643.430071] garage[898]: 2026-11-12T09:29:05.159087Z INFO garage_api_common::generic_server: 192.168.1.3:38762 PUT /farm/nar/0c9rwaxba35d72kqvv60qllnsjdjacscg3f3d4dg1l339ddzvc54.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092905Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7b5c307a0aae24a5c443f6ed90c7da1e211650b05c8fa1db02941756ef7ffa80 worker1 # [ 642.148507] nix-grpc-daemon[2487]: time=2026-11-12T09:29:05.942Z level=INFO msg="Upload complete. (222ms)" lb # [ 643.449983] garage[898]: 2026-11-12T09:29:05.159347Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/nar/0386jci5ygi6n0kqf0cn838r8f1bs8796s8aal460nawp89z9ag3.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092905Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=27d04912cd7d9dc7705a928f77592651b80a70ab89b340e97e3e2feba13dbd5a worker1 # [ 642.156372] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44014 duration_s=0 paths=3 nar_bytes_in=1888 lb # [ 643.459133] garage[898]: 2026-11-12T09:29:05.159576Z INFO garage_api_common::generic_server: 192.168.1.3:34158 PUT /farm/1jn0w6x679ijjxwcfb2gxc6lw2fxim2k.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092905Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb6483650a07d4e0aea5a61e5bfc07a5759eeb45b718fbbfa2d961b83eb02eb5 lb # [ 643.467474] niks3-server[1454]: 2026/11/12 09:29:05 INFO Received sign narinfos request method=POST path=/api/pushes/75/sign lb # [ 643.470104] niks3-server[1454]: 2026/11/12 09:29:05 INFO Signed narinfos id=75 count=3 worker1 # [ 642.172751] nix-daemon[1059]: reaped child process 3683, status = succeeded lb # [ 643.471734] niks3-server[1454]: 2026/11/12 09:29:05 INFO Registered completed upload object_key=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k.ls lb # [ 643.475317] niks3-server[1454]: 2026/11/12 09:29:05 INFO Registered completed upload object_key=nar/1vhsny5g5d5bsxa5s31i6fi9963mbqmvx0dc91v2bc4y9hn0gczf.nar.zst worker1 # [ 642.176494] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:05Z level=debug event=want client=9 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 lb # [ 643.478277] niks3-server[1454]: 2026/11/12 09:29:05 INFO Received complete push request method=POST path=/api/pushes/75/complete lb # [ 643.480939] niks3-server[1454]: 2026/11/12 09:29:05 INFO Registered completed upload object_key=nar/0c9rwaxba35d72kqvv60qllnsjdjacscg3f3d4dg1l339ddzvc54.nar.zst lb # [ 643.483397] niks3-server[1454]: 2026/11/12 09:29:05 INFO Registered completed upload object_key=nar/0386jci5ygi6n0kqf0cn838r8f1bs8796s8aal460nawp89z9ag3.nar.zst client # [ 642.177786] nix[2527]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip,w2}, waiting up to 30s for a worker lb # [ 643.486019] niks3-server[1454]: 2026/11/12 09:29:05 INFO Registered completed upload object_key=3i1nziwpdqq19lzpqy4rywzxnm8dlps6.ls lb # [ 643.488157] niks3-server[1454]: 2026/11/12 09:29:05 INFO Registered completed upload object_key=bryy928wsl4vzss08v7g88isa7zilsd1.ls lb # [ 643.490368] niks3-server[1454]: 2026/11/12 09:29:05 INFO Completed push id=75 objects=9 duration=20.26484ms lb # [ 643.492306] niks3-server[1454]: 2026/11/12 09:29:05 INFO Registered completed upload object_key=bryy928wsl4vzss08v7g88isa7zilsd1.narinfo lb # [ 643.494318] niks3-server[1454]: 2026/11/12 09:29:05 INFO Registered completed upload object_key=3i1nziwpdqq19lzpqy4rywzxnm8dlps6.narinfo lb # [ 643.496378] niks3-server[1454]: 2026/11/12 09:29:05 INFO Registered completed upload object_key=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k.narinfo lb # [ 643.498438] garage[898]: 2026-11-12T09:29:05.159881Z INFO garage_api_common::generic_server: 192.168.1.3:34146 PUT /farm/3i1nziwpdqq19lzpqy4rywzxnm8dlps6.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092905Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0209ded676a436b19f669c7acdade53a5a9d909ecb0cb68463c5a3d5964b83d1 lb # [ 643.505633] garage[898]: 2026-11-12T09:29:05.164221Z INFO garage_api_common::generic_server: 127.0.0.1:37728 (key GK0123456789abcdef01234567) HEAD /farm/1jn0w6x679ijjxwcfb2gxc6lw2fxim2k.ls lb # [ 643.509888] garage[898]: 2026-11-12T09:29:05.168759Z INFO garage_api_common::generic_server: 192.168.1.3:38748 PUT /farm/3i1nziwpdqq19lzpqy4rywzxnm8dlps6.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092905Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9a478cca89dfaaf20defb2b860092aa65e6856dc146eb8210fe44ee077951f58 lb # [ 643.516443] garage[898]: 2026-11-12T09:29:05.169326Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/bryy928wsl4vzss08v7g88isa7zilsd1.ls lb # [ 643.519336] garage[898]: 2026-11-12T09:29:05.169679Z INFO garage_api_common::generic_server: 127.0.0.1:37728 (key GK0123456789abcdef01234567) HEAD /farm/nar/0c9rwaxba35d72kqvv60qllnsjdjacscg3f3d4dg1l339ddzvc54.nar.zst lb # [ 643.522715] garage[898]: 2026-11-12T09:29:05.169919Z INFO garage_api_common::generic_server: 127.0.0.1:37746 (key GK0123456789abcdef01234567) HEAD /farm/nar/1vhsny5g5d5bsxa5s31i6fi9963mbqmvx0dc91v2bc4y9hn0gczf.nar.zst lb # [ 643.526328] garage[898]: 2026-11-12T09:29:05.170161Z INFO garage_api_common::generic_server: 127.0.0.1:44994 (key GK0123456789abcdef01234567) HEAD /farm/nar/0386jci5ygi6n0kqf0cn838r8f1bs8796s8aal460nawp89z9ag3.nar.zst lb # [ 643.529585] garage[898]: 2026-11-12T09:29:05.170400Z INFO garage_api_common::generic_server: 127.0.0.1:44982 (key GK0123456789abcdef01234567) HEAD /farm/3i1nziwpdqq19lzpqy4rywzxnm8dlps6.ls lb # [ 643.532392] garage[898]: 2026-11-12T09:29:05.170638Z INFO garage_api_common::generic_server: 192.168.1.3:34146 PUT /farm/bryy928wsl4vzss08v7g88isa7zilsd1.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092905Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae0cda71ed1842a32b30df6386ccc6d1c3fddaedaecaaf658752963e1ddaef28 lb # [ 643.538126] garage[898]: 2026-11-12T09:29:05.172721Z INFO garage_api_common::generic_server: 192.168.1.3:34158 PUT /farm/1jn0w6x679ijjxwcfb2gxc6lw2fxim2k.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T092905Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=99dd372b36527eb83026068f7f20f1c095420a6911bdc4bda10a8d6cc68cf63f lb # [ 643.543752] garage[898]: 2026-11-12T09:29:05.200571Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/1jn0w6x679ijjxwcfb2gxc6lw2fxim2k.narinfo lb # [ 643.546608] garage[898]: 2026-11-12T09:29:05.202728Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/3i1nziwpdqq19lzpqy4rywzxnm8dlps6.narinfo lb # [ 643.549404] garage[898]: 2026-11-12T09:29:05.206925Z INFO garage_api_common::generic_server: 127.0.0.1:37778 (key GK0123456789abcdef01234567) HEAD /farm/bryy928wsl4vzss08v7g88isa7zilsd1.narinfo lb # [ 645.987420] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 645.995645] systemd[1]: Started SSH per-connection Daemon (vsock:2:51). lb # [ 646.090767] sshd-session[2153]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 646.100353] sshd-session[2153]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 646.108872] sshd-session[2153]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 646.133968] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 646.166297] systemd-logind[499]: New session '70' of user 'root' with class 'user' and type 'tty'. lb # [ 646.177539] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 646.183730] systemd[1]: Starting User Manager for UID 0... lb # [ 646.205850] (systemd)[2162]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 646.212562] systemd-logind[499]: New session '71' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 646.303104] systemd[2162]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 646.328667] envoy[897]: conn peer=[2001:db8:1::1]:51700 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=15482 tx=10802 ms=14691 lb # [ 646.405038] systemd[2162]: Queued start job for default target Main User Target. lb # [ 646.413025] systemd[2162]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 646.415885] systemd[2162]: Created slice User Application Slice. lb # [ 646.418462] systemd[2162]: Started Daily Cleanup of User's Temporary Directories. lb # [ 646.419606] systemd[2162]: Reached target Paths. lb # [ 646.422184] systemd[2162]: Reached target Timers. lb # [ 646.422959] systemd[2162]: Starting D-Bus User Message Bus Socket... lb # [ 646.425309] systemd[2162]: Starting Create User Files and Directories... lb # [ 646.467850] systemd[2162]: Finished Create User Files and Directories. lb # [ 646.473164] systemd[2162]: Listening on D-Bus User Message Bus Socket. lb # [ 646.474267] systemd[2162]: Reached target Sockets. lb # [ 646.475009] systemd[2162]: Reached target Basic System. lb # [ 646.475828] systemd[2162]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 646.481014] systemd[2162]: Reached target Main User Target. lb # [ 646.481962] systemd[2162]: Startup finished in 245ms. lb # [ 646.482724] systemd[1]: Started User Manager for UID 0. lb # [ 646.491356] systemd[1]: Started Session 70 of User root. lb # [ 646.522871] sshd-session[2175]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 646.524647] sshd-session[2175]: Disconnected from user root UNKNOWN port 65535 lb # [ 646.525993] sshd-session[2153]: pam_unix(sshd:session): session closed for user root lb # [ 646.530561] systemd[1]: sshd-vsock@51-52-4:22-2:51.service: Deactivated successfully. lb # [ 646.535385] systemd[1]: session-70.scope: Deactivated successfully. lb # [ 646.537121] systemd[1]: session-70.scope: Consumed 26ms CPU time over 48ms wall clock time, 4.8M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 646.542108] systemd-logind[499]: Session 70 logged out. Waiting for processes to exit. lb # [ 646.544573] systemd-logind[499]: Removed session 70. worker1 # [ 646.809511] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 646.818203] systemd[1]: Started SSH per-connection Daemon (vsock:2:115). worker1 # [ 646.917266] sshd-session[3694]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 646.924768] sshd-session[3694]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 646.935885] sshd-session[3694]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 646.946974] systemd-logind[539]: New session '131' of user 'root' with class 'user' and type 'tty'. worker1 # [ 646.952498] systemd[1]: Started Session 131 of User root. worker1 # [ 646.987673] sshd-session[3700]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 646.989660] sshd-session[3700]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 646.991082] sshd-session[3694]: pam_unix(sshd:session): session closed for user root worker1 # [ 646.995265] systemd[1]: sshd-vsock@115-116-5:22-2:115.service: Deactivated successfully. worker1 # [ 647.001105] systemd[1]: session-131.scope: Deactivated successfully. worker1 # [ 647.002852] systemd[1]: session-131.scope: Consumed 27ms CPU time over 49ms wall clock time, 7.1M memory peak, 19.6K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 647.009196] systemd-logind[539]: Session 131 logged out. Waiting for processes to exit. worker1 # [ 647.010392] systemd-logind[539]: Removed session 131. client # [ 648.463399] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 648.473366] systemd[1]: Started SSH per-connection Daemon (vsock:2:82). client # [ 648.569573] sshd-session[2542]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 648.578397] sshd-session[2542]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 648.586782] sshd-session[2542]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 648.598357] systemd-logind[427]: New session '100' of user 'root' with class 'user' and type 'tty'. client # [ 648.605552] systemd[1]: Started Session 100 of User root. client # [ 648.636958] sshd-session[2548]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 648.639654] sshd-session[2548]: Disconnected from user root UNKNOWN port 65535 client # [ 648.641404] sshd-session[2542]: pam_unix(sshd:session): session closed for user root client # [ 648.645669] systemd[1]: sshd-vsock@82-83-3:22-2:82.service: Deactivated successfully. client # [ 648.650809] systemd[1]: session-100.scope: Deactivated successfully. client # [ 648.655557] systemd-logind[427]: Session 100 logged out. Waiting for processes to exit. client # [ 648.658493] systemd-logind[427]: Removed session 100. client # [ 650.329531] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 650.338773] systemd[1]: Started SSH per-connection Daemon (vsock:2:83). client # [ 650.429092] sshd-session[2553]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 650.438297] sshd-session[2553]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 650.446303] sshd-session[2553]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 650.455133] systemd-logind[427]: New session '101' of user 'root' with class 'user' and type 'tty'. client # [ 650.460534] systemd[1]: Started Session 101 of User root. client # [ 650.488814] sshd-session[2559]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 650.491336] sshd-session[2559]: Disconnected from user root UNKNOWN port 65535 client # [ 650.493017] sshd-session[2553]: pam_unix(sshd:session): session closed for user root client # [ 650.497007] systemd[1]: sshd-vsock@83-84-3:22-2:83.service: Deactivated successfully. client # [ 650.502506] systemd[1]: session-101.scope: Deactivated successfully. client # [ 650.506685] systemd-logind[427]: Session 101 logged out. Waiting for processes to exit. client # [ 650.509617] systemd-logind[427]: Removed session 101. client # [ 651.432646] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 651.440215] systemd[1]: Started SSH per-connection Daemon (vsock:2:84). client # [ 651.539542] sshd-session[2564]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 651.550076] sshd-session[2564]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 651.559012] sshd-session[2564]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 651.568535] systemd-logind[427]: New session '102' of user 'root' with class 'user' and type 'tty'. client # [ 651.582284] systemd[1]: Started Session 102 of User root. client # [ 651.614153] sshd-session[2570]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 651.617289] sshd-session[2570]: Disconnected from user root UNKNOWN port 65535 client # [ 651.619383] sshd-session[2564]: pam_unix(sshd:session): session closed for user root client # [ 651.623727] systemd[1]: sshd-vsock@84-85-3:22-2:84.service: Deactivated successfully. client # [ 651.630118] systemd[1]: session-102.scope: Deactivated successfully. client # [ 651.635046] systemd-logind[427]: Session 102 logged out. Waiting for processes to exit. client # [ 651.637845] systemd-logind[427]: Removed session 102. client # [ 653.630606] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 653.638337] systemd[1]: Started SSH per-connection Daemon (vsock:2:85). client # [ 653.739862] sshd-session[2575]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 653.750333] sshd-session[2575]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 653.759197] sshd-session[2575]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 653.771078] systemd-logind[427]: New session '103' of user 'root' with class 'user' and type 'tty'. client # [ 653.776596] systemd[1]: Started Session 103 of User root. client # [ 653.807989] sshd-session[2581]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 653.810598] sshd-session[2581]: Disconnected from user root UNKNOWN port 65535 client # [ 653.812446] sshd-session[2575]: pam_unix(sshd:session): session closed for user root client # [ 653.817344] systemd[1]: sshd-vsock@85-86-3:22-2:85.service: Deactivated successfully. client # [ 653.822774] systemd[1]: session-103.scope: Deactivated successfully. client # [ 653.827618] systemd-logind[427]: Session 103 logged out. Waiting for processes to exit. client # [ 653.830590] systemd-logind[427]: Removed session 103. lb # [ 656.556420] systemd[1]: Stopping User Manager for UID 0... lb # [ 656.563727] systemd[2162]: Activating special unit Exit the Session... lb # [ 656.570955] systemd[2162]: Stopped target Main User Target. lb # [ 656.575489] systemd[2162]: Stopped target Basic System. lb # [ 656.577389] systemd[2162]: Stopped target Paths. lb # [ 656.578511] systemd[2162]: Stopped target Sockets. lb # [ 656.579667] systemd[2162]: Stopped target Timers. lb # [ 656.581196] systemd[2162]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 656.582916] systemd[2162]: Closed D-Bus User Message Bus Socket. lb # [ 656.584373] systemd[2162]: Stopped Create User Files and Directories. lb # [ 656.585807] systemd[2162]: Removed slice User Application Slice. lb # [ 656.587310] systemd[2162]: Reached target Shutdown. lb # [ 656.588747] systemd[2162]: Finished Exit the Session. lb # [ 656.589926] systemd[2162]: Reached target Exit the Session. lb # [ 656.614410] systemd-logind[499]: Removed session 71. lb # [ 656.623932] systemd[1]: user@0.service: Deactivated successfully. lb # [ 656.628649] systemd[1]: Stopped User Manager for UID 0. lb # [ 656.691185] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 655.417244] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 656.728312] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 655.425326] systemd[1]: Started SSH per-connection Daemon (vsock:2:86). lb # [ 656.732754] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 656.736676] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 655.524909] sshd-session[2586]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 655.535288] sshd-session[2586]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 655.544898] sshd-session[2586]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 655.554216] systemd-logind[427]: New session '104' of user 'root' with class 'user' and type 'tty'. client # [ 655.562762] systemd[1]: Started Session 104 of User root. client # [ 655.591092] sshd-session[2592]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 655.593970] sshd-session[2592]: Disconnected from user root UNKNOWN port 65535 client # [ 655.595997] sshd-session[2586]: pam_unix(sshd:session): session closed for user root client # [ 655.600198] systemd[1]: sshd-vsock@86-87-3:22-2:86.service: Deactivated successfully. client # [ 655.605784] systemd[1]: session-104.scope: Deactivated successfully. client # [ 655.610415] systemd-logind[427]: Session 104 logged out. Waiting for processes to exit. client # [ 655.613018] systemd-logind[427]: Removed session 104. worker1 # [ 657.039957] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 657.046673] systemd[3665]: Activating special unit Exit the Session... worker1 # [ 657.051640] systemd[3665]: Stopped target Main User Target. worker1 # [ 657.056826] systemd[3665]: Stopped target Basic System. worker1 # [ 657.058121] systemd[3665]: Stopped target Paths. worker1 # [ 657.059231] systemd[3665]: Stopped target Sockets. worker1 # [ 657.061550] systemd[3665]: Stopped target Timers. worker1 # [ 657.062682] systemd[3665]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 657.064427] systemd[3665]: Closed D-Bus User Message Bus Socket. worker1 # [ 657.065798] systemd[3665]: Stopped Create User Files and Directories. worker1 # [ 657.067240] systemd[3665]: Removed slice User Application Slice. worker1 # [ 657.069786] systemd[3665]: Reached target Shutdown. worker1 # [ 657.070965] systemd[3665]: Finished Exit the Session. worker1 # [ 657.072696] systemd[3665]: Reached target Exit the Session. worker1 # [ 657.093212] systemd-logind[539]: Removed session 130. worker1 # [ 657.102791] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 657.106057] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 657.129283] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 657.166701] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 657.170906] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 657.176741] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 658.437166] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 658.446321] systemd[1]: Started SSH per-connection Daemon (vsock:2:87). client # [ 658.550035] sshd-session[2597]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 658.560621] sshd-session[2597]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 658.569731] sshd-session[2597]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 658.581447] systemd-logind[427]: New session '105' of user 'root' with class 'user' and type 'tty'. client # [ 658.593636] systemd[1]: Started Session 105 of User root. client # [ 658.626633] sshd-session[2603]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 658.629866] sshd-session[2603]: Disconnected from user root UNKNOWN port 65535 client # [ 658.632230] sshd-session[2597]: pam_unix(sshd:session): session closed for user root client # [ 658.637088] systemd[1]: sshd-vsock@87-88-3:22-2:87.service: Deactivated successfully. client # [ 658.642914] systemd[1]: session-105.scope: Deactivated successfully. client # [ 658.648677] systemd-logind[427]: Session 105 logged out. Waiting for processes to exit. client # [ 658.651720] systemd-logind[427]: Removed session 105. client # [ 661.876233] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 661.879932] systemd[1]: Started SSH per-connection Daemon (vsock:2:88). client # [ 661.974570] sshd-session[2608]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 661.984572] sshd-session[2608]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 661.993058] sshd-session[2608]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 662.004764] systemd-logind[427]: New session '106' of user 'root' with class 'user' and type 'tty'. client # [ 662.008975] systemd[1]: Started Session 106 of User root. client # [ 662.038836] sshd-session[2614]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 662.042129] sshd-session[2614]: Disconnected from user root UNKNOWN port 65535 client # [ 662.043574] sshd-session[2608]: pam_unix(sshd:session): session closed for user root client # [ 662.047813] systemd[1]: sshd-vsock@88-89-3:22-2:88.service: Deactivated successfully. client # [ 662.053339] systemd[1]: session-106.scope: Deactivated successfully. client # [ 662.057526] systemd-logind[427]: Session 106 logged out. Waiting for processes to exit. client # [ 662.059705] systemd-logind[427]: Removed session 106. client # [ 664.935598] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 664.942681] systemd[1]: Started SSH per-connection Daemon (vsock:2:89). client # [ 665.038037] sshd-session[2619]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 665.048157] sshd-session[2619]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 665.056888] sshd-session[2619]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 665.065853] systemd-logind[427]: New session '107' of user 'root' with class 'user' and type 'tty'. client # [ 665.072510] systemd[1]: Started Session 107 of User root. client # [ 665.101462] sshd-session[2625]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 665.104476] sshd-session[2625]: Disconnected from user root UNKNOWN port 65535 client # [ 665.105724] sshd-session[2619]: pam_unix(sshd:session): session closed for user root client # [ 665.110077] systemd[1]: sshd-vsock@89-90-3:22-2:89.service: Deactivated successfully. client # [ 665.115573] systemd[1]: session-107.scope: Deactivated successfully. client # [ 665.120422] systemd-logind[427]: Session 107 logged out. Waiting for processes to exit. client # [ 665.122463] systemd-logind[427]: Removed session 107. client # [ 666.054231] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 666.059736] systemd[1]: Started SSH per-connection Daemon (vsock:2:90). client # [ 666.156494] sshd-session[2630]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 666.164896] sshd-session[2630]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 666.172317] sshd-session[2630]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 666.181123] systemd-logind[427]: New session '108' of user 'root' with class 'user' and type 'tty'. client # [ 666.192548] systemd[1]: Started Session 108 of User root. client # [ 666.223414] sshd-session[2636]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 666.226216] sshd-session[2636]: Disconnected from user root UNKNOWN port 65535 client # [ 666.227604] sshd-session[2630]: pam_unix(sshd:session): session closed for user root client # [ 666.232003] systemd[1]: sshd-vsock@90-91-3:22-2:90.service: Deactivated successfully. client # [ 666.237673] systemd[1]: session-108.scope: Deactivated successfully. client # [ 666.242294] systemd-logind[427]: Session 108 logged out. Waiting for processes to exit. client # [ 666.244870] systemd-logind[427]: Removed session 108. [e2e] heartbeat t=570s client # [ 668.395918] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 668.404131] systemd[1]: Started SSH per-connection Daemon (vsock:2:91). client # [ 668.506449] sshd-session[2641]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 668.517901] sshd-session[2641]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 668.527680] sshd-session[2641]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 668.538105] systemd-logind[427]: New session '109' of user 'root' with class 'user' and type 'tty'. client # [ 668.544546] systemd[1]: Started Session 109 of User root. client # [ 668.575281] sshd-session[2647]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 668.578218] sshd-session[2647]: Disconnected from user root UNKNOWN port 65535 client # [ 668.580373] sshd-session[2641]: pam_unix(sshd:session): session closed for user root client # [ 668.584220] systemd[1]: sshd-vsock@91-92-3:22-2:91.service: Deactivated successfully. client # [ 668.589660] systemd[1]: session-109.scope: Deactivated successfully. client # [ 668.593916] systemd-logind[427]: Session 109 logged out. Waiting for processes to exit. client # [ 668.596774] systemd-logind[427]: Removed session 109. client # [ 669.372940] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 669.380710] systemd[1]: Started SSH per-connection Daemon (vsock:2:92). client # [ 669.481360] sshd-session[2652]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 669.491598] sshd-session[2652]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 669.500928] sshd-session[2652]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 669.511795] systemd-logind[427]: New session '110' of user 'root' with class 'user' and type 'tty'. client # [ 669.516846] systemd[1]: Started Session 110 of User root. client # [ 669.546195] sshd-session[2658]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 669.549154] sshd-session[2658]: Disconnected from user root UNKNOWN port 65535 client # [ 669.551043] sshd-session[2652]: pam_unix(sshd:session): session closed for user root client # [ 669.554959] systemd[1]: sshd-vsock@92-93-3:22-2:92.service: Deactivated successfully. client # [ 669.560735] systemd[1]: session-110.scope: Deactivated successfully. client # [ 669.565443] systemd-logind[427]: Session 110 logged out. Waiting for processes to exit. client # [ 669.567836] systemd-logind[427]: Removed session 110. client # [ 671.243449] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 671.251318] systemd[1]: Started SSH per-connection Daemon (vsock:2:93). client # [ 671.351442] sshd-session[2663]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 671.361283] sshd-session[2663]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 671.369801] sshd-session[2663]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 671.378735] systemd-logind[427]: New session '111' of user 'root' with class 'user' and type 'tty'. client # [ 671.384570] systemd[1]: Started Session 111 of User root. client # [ 671.413773] sshd-session[2669]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 671.416554] sshd-session[2669]: Disconnected from user root UNKNOWN port 65535 client # [ 671.417996] sshd-session[2663]: pam_unix(sshd:session): session closed for user root client # [ 671.422079] systemd[1]: sshd-vsock@93-94-3:22-2:93.service: Deactivated successfully. client # [ 671.427726] systemd[1]: session-111.scope: Deactivated successfully. client # [ 671.432584] systemd-logind[427]: Session 111 logged out. Waiting for processes to exit. client # [ 671.434896] systemd-logind[427]: Removed session 111. client # [ 672.184848] nix[2527]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip,w2} client # [ 672.192416] nix[2527]: error: cancelled: another build failed client # [ 672.221728] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 672.227248] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 672.230491] systemd[1]: gpu.service: Consumed 202ms CPU time over 30.715s wall clock time, 37M memory peak, 8K incoming IP traffic, 8.3K outgoing IP traffic. client # [ 672.608447] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 672.612487] systemd[1]: Started SSH per-connection Daemon (vsock:2:94). client # [ 672.716739] sshd-session[2676]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 672.726955] sshd-session[2676]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 672.735915] sshd-session[2676]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 672.745400] systemd-logind[427]: New session '112' of user 'root' with class 'user' and type 'tty'. client # [ 672.752582] systemd[1]: Started Session 112 of User root. client # [ 672.781963] sshd-session[2682]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 672.784866] sshd-session[2682]: Disconnected from user root UNKNOWN port 65535 client # [ 672.786797] sshd-session[2676]: pam_unix(sshd:session): session closed for user root client # [ 672.790694] systemd[1]: sshd-vsock@94-95-3:22-2:94.service: Deactivated successfully. client # [ 672.796335] systemd[1]: session-112.scope: Deactivated successfully. client # [ 672.800519] systemd-logind[427]: Session 112 logged out. Waiting for processes to exit. client # [ 672.802667] systemd-logind[427]: Removed session 112. client # [ 673.470937] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 673.479745] systemd[1]: Started SSH per-connection Daemon (vsock:2:95). client # [ 673.574149] sshd-session[2687]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 673.583447] sshd-session[2687]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 673.592321] sshd-session[2687]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 673.603319] systemd-logind[427]: New session '113' of user 'root' with class 'user' and type 'tty'. client # [ 673.609738] systemd[1]: Started Session 113 of User root. client # [ 673.634629] sshd-session[2693]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 673.637717] sshd-session[2693]: Disconnected from user root UNKNOWN port 65535 client # [ 673.639098] sshd-session[2687]: pam_unix(sshd:session): session closed for user root client # [ 673.644308] systemd[1]: sshd-vsock@95-96-3:22-2:95.service: Deactivated successfully. client # [ 673.649447] systemd[1]: session-113.scope: Deactivated successfully. client # [ 673.654075] systemd-logind[427]: Session 113 logged out. Waiting for processes to exit. client # [ 673.656599] systemd-logind[427]: Removed session 113. lb # [ 676.333077] envoy[897]: conn peer=[2001:db8:1::1]:55538 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2854 tx=861 ms=30482 lb # [ 678.325833] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 678.333781] systemd[1]: Started SSH per-connection Daemon (vsock:2:52). lb # [ 678.431927] sshd-session[2186]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 678.441982] sshd-session[2186]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 678.450683] sshd-session[2186]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 678.480518] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 678.510444] systemd-logind[499]: New session '72' of user 'root' with class 'user' and type 'tty'. lb # [ 678.521522] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 678.527633] systemd[1]: Starting User Manager for UID 0... lb # [ 678.553926] (systemd)[2195]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 678.560226] systemd-logind[499]: New session '73' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 678.650592] systemd[2195]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 678.751911] systemd[2195]: Queued start job for default target Main User Target. lb # [ 678.761048] systemd[2195]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 678.763808] systemd[2195]: Created slice User Application Slice. lb # [ 678.766331] systemd[2195]: Started Daily Cleanup of User's Temporary Directories. lb # [ 678.767434] systemd[2195]: Reached target Paths. lb # [ 678.770170] systemd[2195]: Reached target Timers. lb # [ 678.770998] systemd[2195]: Starting D-Bus User Message Bus Socket... lb # [ 678.774292] systemd[2195]: Starting Create User Files and Directories... lb # [ 678.818005] systemd[2195]: Finished Create User Files and Directories. lb # [ 678.820708] systemd[2195]: Listening on D-Bus User Message Bus Socket. lb # [ 678.821760] systemd[2195]: Reached target Sockets. lb # [ 678.822491] systemd[2195]: Reached target Basic System. lb # [ 678.823285] systemd[2195]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 678.827415] systemd[2195]: Reached target Main User Target. lb # [ 678.829335] systemd[2195]: Startup finished in 245ms. lb # [ 678.830139] systemd[1]: Started User Manager for UID 0. lb # [ 678.834617] systemd[1]: Started Session 72 of User root. lb # [ 678.866272] sshd-session[2208]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 678.868951] sshd-session[2208]: Disconnected from user root UNKNOWN port 65535 lb # [ 678.870738] sshd-session[2186]: pam_unix(sshd:session): session closed for user root lb # [ 678.874781] systemd[1]: sshd-vsock@52-53-4:22-2:52.service: Deactivated successfully. lb # [ 678.879531] systemd[1]: session-72.scope: Deactivated successfully. lb # [ 678.881291] systemd[1]: session-72.scope: Consumed 26ms CPU time over 48ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 678.886541] systemd-logind[499]: Session 72 logged out. Waiting for processes to exit. lb # [ 678.889169] systemd-logind[499]: Removed session 72. worker1 # [ 677.713813] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 677.723574] systemd[1]: Started SSH per-connection Daemon (vsock:2:116). worker1 # [ 677.820584] sshd-session[3709]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 677.830753] sshd-session[3709]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 677.839840] sshd-session[3709]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 677.856315] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 677.870426] systemd-logind[539]: New session '132' of user 'root' with class 'user' and type 'tty'. worker1 # [ 677.893119] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 677.901312] systemd[1]: Starting User Manager for UID 0... worker1 # [ 677.930172] (systemd)[3717]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 677.936405] systemd-logind[539]: New session '133' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 678.022849] systemd[3717]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 678.126889] systemd[3717]: Queued start job for default target Main User Target. worker1 # [ 678.137019] systemd[3717]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 678.141305] systemd[3717]: Created slice User Application Slice. worker1 # [ 678.142338] systemd[3717]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 678.143392] systemd[3717]: Reached target Paths. worker1 # [ 678.146780] systemd[3717]: Reached target Timers. worker1 # [ 678.149070] systemd[3717]: Starting D-Bus User Message Bus Socket... worker1 # [ 678.150076] systemd[3717]: Starting Create User Files and Directories... worker1 # [ 678.183450] systemd[3717]: Listening on D-Bus User Message Bus Socket. worker1 # [ 678.185590] systemd[3717]: Reached target Sockets. worker1 # [ 678.194571] systemd[3717]: Finished Create User Files and Directories. worker1 # [ 678.195828] systemd[3717]: Reached target Basic System. worker1 # [ 678.200524] systemd[1]: Started User Manager for UID 0. worker1 # [ 678.201397] systemd[3717]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 678.202899] systemd[3717]: Reached target Main User Target. worker1 # [ 678.203854] systemd[3717]: Startup finished in 246ms. worker1 # [ 678.208745] systemd[1]: Started Session 132 of User root. worker1 # [ 678.238491] sshd-session[3730]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 678.241074] sshd-session[3730]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 678.243014] sshd-session[3709]: pam_unix(sshd:session): session closed for user root worker1 # [ 678.247088] systemd[1]: sshd-vsock@116-117-5:22-2:116.service: Deactivated successfully. worker1 # [ 678.252094] systemd[1]: session-132.scope: Deactivated successfully. worker1 # [ 678.253737] systemd[1]: session-132.scope: Consumed 25ms CPU time over 48ms wall clock time, 3.1M memory peak, 19.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 678.259403] systemd-logind[539]: Session 132 logged out. Waiting for processes to exit. worker1 # [ 678.262125] systemd-logind[539]: Removed session 132. ok test farm::serial::scheduler_down_the_other_node_takes_the_lock_and_keeps_it ... worker1 # [ 678.375659] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 678.386600] systemd[1]: Started SSH per-connection Daemon (vsock:2:117). worker1 # [ 678.481937] sshd-session[3735]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 678.489977] sshd-session[3735]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 678.500687] sshd-session[3735]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 678.509427] systemd-logind[539]: New session '134' of user 'root' with class 'user' and type 'tty'. worker1 # [ 678.520756] systemd[1]: Started Session 134 of User root. worker1 # [ 678.554336] sshd-session[3741]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 678.557335] sshd-session[3741]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 678.558734] sshd-session[3735]: pam_unix(sshd:session): session closed for user root worker1 # [ 678.562900] systemd[1]: sshd-vsock@117-118-5:22-2:117.service: Deactivated successfully. worker1 # [ 678.568968] systemd[1]: session-134.scope: Deactivated successfully. worker1 # [ 678.573094] systemd-logind[539]: Session 134 logged out. Waiting for processes to exit. worker1 # [ 678.575892] systemd-logind[539]: Removed session 134. worker2 # [ 677.195056] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 677.203719] systemd[1]: Started SSH per-connection Daemon (vsock:2:72). worker2 # [ 677.315741] sshd-session[2914]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 677.324952] sshd-session[2914]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 677.332961] sshd-session[2914]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 677.352465] systemd-logind[515]: New session '90' of user 'root' with class 'user' and type 'tty'. worker2 # [ 677.359387] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 677.393959] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 677.400682] systemd[1]: Starting User Manager for UID 0... worker2 # [ 677.429556] (systemd)[2922]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 677.435963] systemd-logind[515]: New session '91' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 677.527333] systemd[2922]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 677.626847] systemd[2922]: Queued start job for default target Main User Target. worker2 # [ 677.637021] systemd[2922]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 677.640241] systemd[2922]: Created slice User Application Slice. worker2 # [ 677.642838] systemd[2922]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 677.644412] systemd[2922]: Reached target Paths. worker2 # [ 677.645159] systemd[2922]: Reached target Timers. worker2 # [ 677.647686] systemd[2922]: Starting D-Bus User Message Bus Socket... worker2 # [ 677.649910] systemd[2922]: Starting Create User Files and Directories... worker2 # [ 677.698322] systemd[2922]: Finished Create User Files and Directories. worker2 # [ 677.701254] systemd[2922]: Listening on D-Bus User Message Bus Socket. worker2 # [ 677.702497] systemd[2922]: Reached target Sockets. worker2 # [ 677.704975] systemd[2922]: Reached target Basic System. worker2 # [ 677.705912] systemd[2922]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 677.707396] systemd[2922]: Reached target Main User Target. worker2 # [ 677.710749] systemd[2922]: Startup finished in 252ms. worker2 # [ 677.711607] systemd[1]: Started User Manager for UID 0. worker2 # [ 677.716389] systemd[1]: Started Session 90 of User root. worker2 # [ 677.749511] sshd-session[2935]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 677.752729] sshd-session[2935]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 677.755476] sshd-session[2914]: pam_unix(sshd:session): session closed for user root worker2 # [ 677.759394] systemd[1]: sshd-vsock@72-73-6:22-2:72.service: Deactivated successfully. worker2 # [ 677.766055] systemd[1]: session-90.scope: Deactivated successfully. worker2 # [ 677.771134] systemd-logind[515]: Session 90 logged out. Waiting for processes to exit. worker2 # [ 677.774254] systemd-logind[515]: Removed session 90. lb # [ 684.757505] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 684.766307] systemd[1]: Started SSH per-connection Daemon (vsock:2:53). lb # [ 684.864774] sshd-session[2214]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 684.874810] sshd-session[2214]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 684.883796] sshd-session[2214]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 684.893626] systemd-logind[499]: New session '74' of user 'root' with class 'user' and type 'tty'. lb # [ 684.901309] systemd[1]: Started Session 74 of User root. lb # [ 684.941160] sshd-session[2220]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 684.942671] sshd-session[2220]: Disconnected from user root UNKNOWN port 65535 lb # [ 684.944419] sshd-session[2214]: pam_unix(sshd:session): session closed for user root lb # [ 684.949317] systemd[1]: sshd-vsock@53-54-4:22-2:53.service: Deactivated successfully. lb # [ 684.954764] systemd[1]: session-74.scope: Deactivated successfully. lb # [ 684.956721] systemd[1]: session-74.scope: Consumed 30ms CPU time over 55ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 684.962131] systemd-logind[499]: Session 74 logged out. Waiting for processes to exit. lb # [ 684.964560] systemd-logind[499]: Removed session 74. worker1 # [ 683.681566] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 683.689639] systemd[1]: Started SSH per-connection Daemon (vsock:2:118). worker1 # [ 683.792518] sshd-session[3747]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 683.800321] sshd-session[3747]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 683.810789] sshd-session[3747]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 683.820424] systemd-logind[539]: New session '135' of user 'root' with class 'user' and type 'tty'. worker1 # [ 683.832632] systemd[1]: Started Session 135 of User root. worker1 # [ 683.871848] sshd-session[3753]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 683.873765] sshd-session[3753]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 683.875041] sshd-session[3747]: pam_unix(sshd:session): session closed for user root worker1 # [ 683.879737] systemd[1]: sshd-vsock@118-119-5:22-2:118.service: Deactivated successfully. worker1 # [ 683.885148] systemd[1]: session-135.scope: Deactivated successfully. worker1 # [ 683.886817] systemd[1]: session-135.scope: Consumed 29ms CPU time over 53ms wall clock time, 3.1M memory peak, 19.2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 683.893219] systemd-logind[539]: Session 135 logged out. Waiting for processes to exit. worker1 # [ 683.894441] systemd-logind[539]: Removed session 135. client # [ 683.893217] systemd[1]: Stopping User Manager for UID 0... client # [ 683.901652] systemd[2480]: Activating special unit Exit the Session... client # [ 683.907693] systemd[2480]: Stopped target Main User Target. client # [ 683.911250] systemd[2480]: Stopped target Basic System. client # [ 683.913064] systemd[2480]: Stopped target Paths. client # [ 683.914233] systemd[2480]: Stopped target Sockets. client # [ 683.915363] systemd[2480]: Stopped target Timers. client # [ 683.916686] systemd[2480]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 683.918385] systemd[2480]: Closed D-Bus User Message Bus Socket. client # [ 683.919743] systemd[2480]: Stopped Create User Files and Directories. client # [ 683.921951] systemd[2480]: Removed slice User Application Slice. client # [ 683.923324] systemd[2480]: Reached target Shutdown. client # [ 683.925300] systemd[2480]: Finished Exit the Session. client # [ 683.927176] systemd[2480]: Reached target Exit the Session. client # [ 683.950315] systemd-logind[427]: Removed session 98. client # [ 683.957456] systemd[1]: user@0.service: Deactivated successfully. client # [ 683.960505] systemd[1]: Stopped User Manager for UID 0. client # [ 684.024819] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 684.064684] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 684.070277] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 684.076494] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 685.986634] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 685.995010] systemd[1]: Started SSH per-connection Daemon (vsock:2:54). lb # [ 686.095691] sshd-session[2228]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 686.105863] sshd-session[2228]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 686.114974] sshd-session[2228]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 686.124442] systemd-logind[499]: New session '75' of user 'root' with class 'user' and type 'tty'. lb # [ 686.137106] systemd[1]: Started Session 75 of User root. lb # [ 686.177081] sshd-session[2234]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 686.178656] sshd-session[2234]: Disconnected from user root UNKNOWN port 65535 lb # [ 686.180907] sshd-session[2228]: pam_unix(sshd:session): session closed for user root lb # [ 686.185297] systemd[1]: sshd-vsock@54-55-4:22-2:54.service: Deactivated successfully. lb # [ 686.190260] systemd[1]: session-75.scope: Deactivated successfully. lb # [ 686.191998] systemd[1]: session-75.scope: Consumed 29ms CPU time over 55ms wall clock time, 4.8M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 686.197350] systemd-logind[499]: Session 75 logged out. Waiting for processes to exit. lb # [ 686.199529] systemd-logind[499]: Removed session 75. lb # [ 688.832662] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 688.840558] systemd[1]: Started SSH per-connection Daemon (vsock:2:55). lb # [ 688.936831] sshd-session[2239]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 688.945781] sshd-session[2239]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 688.954764] sshd-session[2239]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 688.965222] systemd-logind[499]: New session '76' of user 'root' with class 'user' and type 'tty'. lb # [ 688.979591] systemd[1]: Started Session 76 of User root. lb # [ 689.024258] sshd-session[2245]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 689.025766] sshd-session[2245]: Disconnected from user root UNKNOWN port 65535 lb # [ 689.027755] sshd-session[2239]: pam_unix(sshd:session): session closed for user root lb # [ 689.031449] systemd[1]: sshd-vsock@55-56-4:22-2:55.service: Deactivated successfully. lb # [ 689.036988] systemd[1]: session-76.scope: Deactivated successfully. lb # [ 689.040365] systemd[1]: session-76.scope: Consumed 27ms CPU time over 61ms wall clock time, 5.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 689.045289] systemd-logind[499]: Session 76 logged out. Waiting for processes to exit. lb # [ 689.046602] systemd-logind[499]: Removed session 76. worker2 # [ 686.425142] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 686.434157] systemd[1]: Started SSH per-connection Daemon (vsock:2:73). worker2 # [ 686.531846] sshd-session[2941]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 686.540315] sshd-session[2941]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 686.551389] sshd-session[2941]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 686.563942] systemd-logind[515]: New session '92' of user 'root' with class 'user' and type 'tty'. worker2 # [ 686.569635] systemd[1]: Started Session 92 of User root. worker2 # [ 686.599651] sshd-session[2947]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 686.602764] sshd-session[2947]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 686.604332] sshd-session[2941]: pam_unix(sshd:session): session closed for user root worker2 # [ 686.609487] systemd[1]: sshd-vsock@73-74-6:22-2:73.service: Deactivated successfully. worker2 # [ 686.615035] systemd[1]: session-92.scope: Deactivated successfully. worker2 # [ 686.619751] systemd-logind[515]: Session 92 logged out. Waiting for processes to exit. worker2 # [ 686.622773] systemd-logind[515]: Removed session 92. worker1 # [ 691.298720] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 691.307908] systemd[1]: Started SSH per-connection Daemon (vsock:2:119). worker1 # [ 691.401691] sshd-session[3758]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 691.410375] sshd-session[3758]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 691.419733] sshd-session[3758]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 691.429015] systemd-logind[539]: New session '136' of user 'root' with class 'user' and type 'tty'. worker1 # [ 691.440601] systemd[1]: Started Session 136 of User root. worker1 # [ 691.469013] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 692.088182] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:55Z level=info event=draining worker1 # [ 692.093916] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:55Z level=info event=signal_exit lb # [ 694.249777] niks3-server[1454]: 2026/11/12 09:29:56 INFO lead: released remote=192.168.1.3:55118 worker1 # [ 693.946252] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:57Z level=info event=scheduler_restarting lb # [ 695.246266] envoy[897]: [2026-11-12 09:29:57.005][897][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker1 # [ 693.952830] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:57Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 692.399806] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:57Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 695.251964] envoy[897]: [2026-11-12 09:29:57.011][897][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker1 # [ 693.959411] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:57Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50824 worker1 # [ 693.968359] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:57Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 693.970591] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:57Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50824 worker1 # [ 693.976755] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:57Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 694.035794] nix-daemon[1059]: reaped child process 2459, status = succeeded worker1 # [ 694.037388] nix-daemon[1059]: reaped child process 3413, status = succeeded worker1 # [ 694.038849] nix-daemon[1059]: reaped child process 3685, status = succeeded worker1 # [ 694.040458] nix-daemon[1059]: reaped child process 2461, status = succeeded worker1 # [ 694.041494] nix-daemon[1059]: reaped child process 2719, status = succeeded worker1 # [ 694.042542] nix-daemon[1059]: reaped child process 3033, status = succeeded lb # [ 695.364096] niks3-server[1454]: 2026/11/12 09:29:57 INFO lead: acquired remote=192.168.1.4:54848 worker2 # [ 692.600475] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 692.604052] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 694.177659] nix-grpc-daemon[2296]: ts=2026-11-12T09:29:57Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 692.804957] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 692.808383] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 693.009459] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 693.013007] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 693.213934] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 693.217280] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 693.419407] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 693.421950] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 696.334865] envoy[897]: conn peer=[2001:db8:1::3]:49718 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=11602 tx=3958 ms=320184 worker2 # [ 693.620611] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 693.624156] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 693.825914] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 693.829458] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 694.030534] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 694.033985] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 694.234973] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 694.238432] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 695.901617] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 695.902682] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 695.904501] systemd[1]: nix-grpc-daemon.service: Consumed 4.381s CPU time over 5min 22.125s wall clock time, 70.1M memory peak, 1011.7K incoming IP traffic, 972.3K outgoing IP traffic. worker1 # [ 695.922156] sshd-session[3764]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 695.926048] sshd-session[3764]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 695.929320] sshd-session[3758]: pam_unix(sshd:session): session closed for user root worker1 # [ 695.934623] systemd[1]: sshd-vsock@119-120-5:22-2:119.service: Deactivated successfully. worker1 # [ 695.942957] systemd[1]: session-136.scope: Deactivated successfully. worker1 # [ 695.949337] systemd-logind[539]: Session 136 logged out. Waiting for processes to exit. worker1 # [ 695.953248] systemd-logind[539]: Removed session 136. worker2 # [ 694.440285] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 694.443600] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 694.644688] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 694.648243] nix-grpc-daemon[1487]: ts=2026-11-12T09:29:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 694.849249] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 694.853059] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 695.054221] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 695.057431] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 695.258757] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 695.262418] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 695.464269] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 695.467597] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 695.668643] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 695.672140] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 695.859543] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 695.871080] systemd[1]: Started SSH per-connection Daemon (vsock:2:74). worker2 # [ 695.880434] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 695.882923] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 695.973094] sshd-session[2952]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 695.980462] sshd-session[2952]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 695.991382] sshd-session[2952]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 696.003776] systemd-logind[515]: New session '93' of user 'root' with class 'user' and type 'tty'. worker2 # [ 696.008691] systemd[1]: Started Session 93 of User root. worker2 # [ 696.039250] sshd-session[2958]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 696.042040] sshd-session[2958]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 696.043482] sshd-session[2952]: pam_unix(sshd:session): session closed for user root worker2 # [ 696.048227] systemd[1]: sshd-vsock@74-75-6:22-2:74.service: Deactivated successfully. worker2 # [ 696.053414] systemd[1]: session-93.scope: Deactivated successfully. worker2 # [ 696.058370] systemd-logind[515]: Session 93 logged out. Waiting for processes to exit. worker2 # [ 696.060806] systemd-logind[515]: Removed session 93. worker2 # [ 696.075877] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 696.078593] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 699.057633] systemd[1]: Stopping User Manager for UID 0... lb # [ 699.063041] systemd[2195]: Activating special unit Exit the Session... lb # [ 699.069383] systemd[2195]: Stopped target Main User Target. lb # [ 699.070818] systemd[2195]: Stopped target Basic System. lb # [ 699.074865] systemd[2195]: Stopped target Paths. lb # [ 699.076981] systemd[2195]: Stopped target Sockets. lb # [ 699.078162] systemd[2195]: Stopped target Timers. lb # [ 699.079311] systemd[2195]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 699.081964] systemd[2195]: Closed D-Bus User Message Bus Socket. lb # [ 699.083375] systemd[2195]: Stopped Create User Files and Directories. lb # [ 699.085017] systemd[2195]: Removed slice User Application Slice. lb # [ 699.086375] systemd[2195]: Reached target Shutdown. lb # [ 699.087512] systemd[2195]: Finished Exit the Session. lb # [ 699.088850] systemd[2195]: Reached target Exit the Session. lb # [ 699.110478] systemd-logind[499]: Removed session 73. lb # [ 699.118756] systemd[1]: user@0.service: Deactivated successfully. lb # [ 699.122932] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 696.279489] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 696.283878] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 699.187270] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 699.224790] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 699.230016] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 699.235758] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 696.485877] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 696.488963] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" [e2e] heartbeat t=600s worker2 # [ 696.689992] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 696.693191] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 696.894020] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 696.897340] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 697.098346] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 697.101651] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 697.119924] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 697.128967] systemd[1]: Started SSH per-connection Daemon (vsock:2:75). worker2 # [ 697.230582] sshd-session[2963]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 697.240611] sshd-session[2963]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 697.250207] sshd-session[2963]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 697.259615] systemd-logind[515]: New session '94' of user 'root' with class 'user' and type 'tty'. worker2 # [ 697.268608] systemd[1]: Started Session 94 of User root. worker2 # [ 697.299304] sshd-session[2969]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 697.306365] sshd-session[2969]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 697.307695] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 697.309930] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 697.311960] sshd-session[2963]: pam_unix(sshd:session): session closed for user root worker2 # [ 697.314645] systemd[1]: sshd-vsock@75-76-6:22-2:75.service: Deactivated successfully. worker2 # [ 697.320246] systemd[1]: session-94.scope: Deactivated successfully. worker2 # [ 697.325045] systemd-logind[515]: Session 94 logged out. Waiting for processes to exit. worker2 # [ 697.327796] systemd-logind[515]: Removed session 94. worker2 # [ 697.508559] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 697.511417] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 697.709501] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 697.713005] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 697.913975] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 697.917547] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 698.118662] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 698.122484] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 698.323720] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 698.327211] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 698.529510] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 698.532184] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 698.603730] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 698.612182] systemd[1]: Started SSH per-connection Daemon (vsock:2:76). worker2 # [ 698.713999] sshd-session[2974]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 698.723654] sshd-session[2974]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 698.730774] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 698.736936] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 698.741998] sshd-session[2974]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 698.751344] systemd-logind[515]: New session '95' of user 'root' with class 'user' and type 'tty'. worker2 # [ 698.756945] systemd[1]: Started Session 95 of User root. worker2 # [ 698.786804] sshd-session[2980]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 698.789956] sshd-session[2980]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 698.791516] sshd-session[2974]: pam_unix(sshd:session): session closed for user root worker2 # [ 698.796296] systemd[1]: sshd-vsock@76-77-6:22-2:76.service: Deactivated successfully. worker2 # [ 698.803015] systemd[1]: session-95.scope: Deactivated successfully. worker2 # [ 698.808868] systemd-logind[515]: Session 95 logged out. Waiting for processes to exit. worker2 # [ 698.811740] systemd-logind[515]: Removed session 95. worker2 # [ 698.935161] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 698.939007] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 699.139797] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 699.143391] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 699.344392] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 699.348098] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 699.549926] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 699.553238] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 699.754435] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 699.757955] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 699.958964] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 699.962559] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 700.163538] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 700.167558] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 700.368837] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 700.372168] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 700.573992] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 700.577384] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 700.778446] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 700.781026] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 700.982318] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 700.986072] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 701.186790] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 701.190475] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 701.391374] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 701.394968] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 701.596638] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 701.599852] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 701.800932] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 701.804381] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 702.005454] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 702.009073] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 702.209851] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 702.213254] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 702.340618] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 702.346367] systemd[1]: Started SSH per-connection Daemon (vsock:2:77). worker2 # [ 702.414149] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 702.417180] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 702.451737] sshd-session[2985]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 702.460391] sshd-session[2985]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 702.471092] sshd-session[2985]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 702.483012] systemd-logind[515]: New session '96' of user 'root' with class 'user' and type 'tty'. worker2 # [ 702.488561] systemd[1]: Started Session 96 of User root. worker2 # [ 702.509235] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:07Z level=info event=scheduler_take_over worker2 # [ 702.520956] sshd-session[2991]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 702.522519] sshd-session[2991]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 702.524176] sshd-session[2985]: pam_unix(sshd:session): session closed for user root worker2 # [ 702.528766] systemd[1]: sshd-vsock@77-78-6:22-2:77.service: Deactivated successfully. worker2 # [ 702.534087] systemd[1]: session-96.scope: Deactivated successfully. worker2 # [ 702.538773] systemd-logind[515]: Session 96 logged out. Waiting for processes to exit. worker2 # [ 702.541709] systemd-logind[515]: Removed session 96. worker2 # [ 702.619045] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 702.622389] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 702.823532] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 702.827120] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 703.028084] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 703.040147] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:08Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:55080 worker2 # [ 703.043585] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux,riscv64-linux max_jobs=1 running=0 worker2 # [ 704.073403] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:09Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:55084 worker1 # [ 706.038291] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 706.043552] systemd[3717]: Activating special unit Exit the Session... worker1 # [ 706.047762] systemd[3717]: Stopped target Main User Target. worker1 # [ 706.050923] systemd[3717]: Stopped target Basic System. worker1 # [ 706.051839] systemd[3717]: Stopped target Paths. worker1 # [ 706.052858] systemd[3717]: Stopped target Sockets. worker1 # [ 706.053602] systemd[3717]: Stopped target Timers. worker1 # [ 706.054364] systemd[3717]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 706.055522] systemd[3717]: Closed D-Bus User Message Bus Socket. worker1 # [ 706.056647] systemd[3717]: Stopped Create User Files and Directories. worker1 # [ 706.057603] systemd[3717]: Removed slice User Application Slice. worker1 # [ 706.058502] systemd[3717]: Reached target Shutdown. worker1 # [ 706.059250] systemd[3717]: Finished Exit the Session. worker1 # [ 706.060849] systemd[3717]: Reached target Exit the Session. worker1 # [ 706.086390] systemd-logind[539]: Removed session 133. worker1 # [ 706.095026] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 706.100229] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 706.114258] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 706.152593] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 706.157706] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 706.163249] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 705.810787] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 705.819949] systemd[1]: Started SSH per-connection Daemon (vsock:2:78). worker2 # [ 705.918320] sshd-session[2996]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 705.928534] sshd-session[2996]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 705.937468] sshd-session[2996]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 705.946934] systemd-logind[515]: New session '97' of user 'root' with class 'user' and type 'tty'. worker2 # [ 705.956580] systemd[1]: Started Session 97 of User root. worker2 # [ 706.011948] sshd-session[3002]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 706.014241] sshd-session[3002]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 706.016471] sshd-session[2996]: pam_unix(sshd:session): session closed for user root worker2 # [ 706.022414] systemd[1]: sshd-vsock@78-79-6:22-2:78.service: Deactivated successfully. worker2 # [ 706.028695] systemd[1]: session-97.scope: Deactivated successfully. worker2 # [ 706.032645] systemd[1]: session-97.scope: Consumed 31ms CPU time over 73ms wall clock time, 3.1M memory peak, 14.6K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 706.038997] systemd-logind[515]: Session 97 logged out. Waiting for processes to exit. worker2 # [ 706.040739] systemd-logind[515]: Removed session 97. worker2 # [ 706.552962] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:11Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:55084 client # [ 712.889377] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 712.897708] systemd[1]: Started SSH per-connection Daemon (vsock:2:96). client # [ 712.994370] sshd-session[2703]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 713.002983] sshd-session[2703]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 713.014202] sshd-session[2703]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 713.044560] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 713.079482] systemd-logind[427]: New session '114' of user 'root' with class 'user' and type 'tty'. client # [ 713.090838] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 713.101038] systemd[1]: Starting User Manager for UID 0... client # [ 713.126244] (systemd)[2712]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 713.132664] systemd-logind[427]: New session '115' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 713.219975] systemd[2712]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 713.318312] systemd[2712]: Queued start job for default target Main User Target. client # [ 713.325016] systemd[2712]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 713.327931] systemd[2712]: Created slice User Application Slice. client # [ 713.330504] systemd[2712]: Started Daily Cleanup of User's Temporary Directories. client # [ 713.331696] systemd[2712]: Reached target Paths. client # [ 713.334263] systemd[2712]: Reached target Timers. client # [ 713.335057] systemd[2712]: Starting D-Bus User Message Bus Socket... client # [ 713.337639] systemd[2712]: Starting Create User Files and Directories... client # [ 713.381120] systemd[2712]: Finished Create User Files and Directories. client # [ 713.382251] systemd[2712]: Listening on D-Bus User Message Bus Socket. client # [ 713.383203] systemd[2712]: Reached target Sockets. client # [ 713.383928] systemd[2712]: Reached target Basic System. client # [ 713.389408] systemd[2712]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 713.390956] systemd[2712]: Reached target Main User Target. client # [ 713.391847] systemd[2712]: Startup finished in 233ms. client # [ 713.397098] systemd[1]: Started User Manager for UID 0. client # [ 713.397991] systemd[1]: Started Session 114 of User root. worker2 # [ 712.018488] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48140 worker2 # [ 712.026155] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 714.889586] garage[898]: 2026-11-12T09:30:16.648909Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker2 # [ 712.048405] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 714.896841] garage[898]: 2026-11-12T09:30:16.650173Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 714.896947] garage[898]: 2026-11-12T09:30:16.655474Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo lb # [ 714.897036] garage[898]: 2026-11-12T09:30:16.655857Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 714.897099] garage[898]: 2026-11-12T09:30:16.656008Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo lb # [ 714.897169] garage[898]: 2026-11-12T09:30:16.656246Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 714.907108] garage[898]: 2026-11-12T09:30:16.666522Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo lb # [ 714.930867] garage[898]: 2026-11-12T09:30:16.666960Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 714.936981] garage[898]: 2026-11-12T09:30:16.695833Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo lb # [ 714.942240] garage[898]: 2026-11-12T09:30:16.696269Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 712.094311] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 714.952509] garage[898]: 2026-11-12T09:30:16.711930Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo lb # [ 714.957466] garage[898]: 2026-11-12T09:30:16.712409Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 714.962476] garage[898]: 2026-11-12T09:30:16.721597Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo lb # [ 714.968002] garage[898]: 2026-11-12T09:30:16.721980Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 712.119860] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 714.978259] garage[898]: 2026-11-12T09:30:16.737731Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo lb # [ 714.983938] garage[898]: 2026-11-12T09:30:16.738165Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 714.989158] garage[898]: 2026-11-12T09:30:16.748254Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo lb # [ 714.994405] garage[898]: 2026-11-12T09:30:16.748659Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 712.146366] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 715.004943] garage[898]: 2026-11-12T09:30:16.764436Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo lb # [ 715.012079] garage[898]: 2026-11-12T09:30:16.764859Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 715.016210] garage[898]: 2026-11-12T09:30:16.770447Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo lb # [ 715.021405] garage[898]: 2026-11-12T09:30:16.770877Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 712.170283] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 715.024589] garage[898]: 2026-11-12T09:30:16.771275Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo lb # [ 715.028585] garage[898]: 2026-11-12T09:30:16.771620Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 712.180804] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 712.202520] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 712.356182] nix-daemon[976]: accepted connection from pid 3011, user nix-grpc-daemon (trusted) lb # [ 715.237310] niks3-server[1454]: 2026/11/12 09:30:16 INFO Received push request method=POST path=/api/pushes worker2 # [ 712.386219] nix-daemon[976]: reaped child process 3014, status = succeeded worker2 # [ 712.392592] nix-grpc-daemon[1723]: time=2026-11-12T09:30:17.665Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker2 # [ 712.396345] nix-grpc-daemon[1723]: time=2026-11-12T09:30:17.665Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" worker2 # [ 712.400673] nix-grpc-daemon[1723]: time=2026-11-12T09:30:17.667Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" worker2 # [ 712.402559] nix-grpc-daemon[1723]: time=2026-11-12T09:30:17.667Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 715.253288] garage[898]: 2026-11-12T09:30:17.012413Z INFO garage_api_common::generic_server: 192.168.1.4:56264 PUT /farm/7s5szig4ffga53df6rls98r9lhxsrsc5.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093017Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=41a8e6c5dcfde151f8385dab32dcf10c0cd78c78807e5c8926502c14a93f392c lb # [ 715.280063] garage[898]: 2026-11-12T09:30:17.013022Z INFO garage_api_common::generic_server: 192.168.1.4:56230 PUT /farm/adj3g5w8jh83wl959p7daq6igl0gaay3.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093017Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c78eb16cc9d3ae78e7ab16cd4c54ececd7b7544cf2deeb04d8e506a691b6c87c worker2 # [ 712.437363] nix-grpc-daemon[1723]: time=2026-11-12T09:30:17.709Z level=INFO msg="Uploading 3 narinfos" lb # [ 715.315273] garage[898]: 2026-11-12T09:30:17.022480Z INFO garage_api_common::generic_server: 192.168.1.4:56234 PUT /farm/nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093017Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3f1061f56554473bd341a46143673cf99d2a357e16b06ff805d47c36b1ff1f56 lb # [ 715.334842] garage[898]: 2026-11-12T09:30:17.023013Z INFO garage_api_common::generic_server: 192.168.1.4:56240 PUT /farm/nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093017Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1eb496073f509b4b494c291ce09d6065b966a955af3cd3fdb11c31ef35d1caa4 lb # [ 715.342658] garage[898]: 2026-11-12T09:30:17.023347Z INFO garage_api_common::generic_server: 192.168.1.4:56254 PUT /farm/nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093017Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=df1036a55143bb1f4f9d0db163b38b244a03b3aa2bba5b324ff8b90b88d7f817 worker2 # [ 712.501370] nix-grpc-daemon[1723]: time=2026-11-12T09:30:17.774Z level=INFO msg="Upload complete. (285ms)" lb # [ 715.357114] garage[898]: 2026-11-12T09:30:17.023731Z INFO garage_api_common::generic_server: 192.168.1.4:56256 PUT /farm/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093017Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=98d69a702da5f67f4a9bd48bf7e5e4a47e3c182a79a888f7a311d568b38467bb lb # [ 715.365670] garage[898]: 2026-11-12T09:30:17.029259Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 715.370281] niks3-server[1454]: 2026/11/12 09:30:17 INFO Received sign narinfos request method=POST path=/api/pushes/76/sign worker2 # [ 712.508462] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 paths=3 nar_bytes_in=1928 lb # [ 715.372567] niks3-server[1454]: 2026/11/12 09:30:17 INFO Signed narinfos id=76 count=3 lb # [ 715.374128] niks3-server[1454]: 2026/11/12 09:30:17 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 715.376555] niks3-server[1454]: 2026/11/12 09:30:17 INFO Received complete push request method=POST path=/api/pushes/76/complete worker2 # [ 712.526675] nix-daemon[976]: reaped child process 3007, status = succeeded lb # [ 715.381534] niks3-server[1454]: 2026/11/12 09:30:17 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst lb # [ 715.384594] niks3-server[1454]: 2026/11/12 09:30:17 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls worker2 # [ 712.530550] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:17Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 lb # [ 715.387284] niks3-server[1454]: 2026/11/12 09:30:17 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst worker2 # [ 712.537974] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:17Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=1 lb # [ 715.390113] niks3-server[1454]: 2026/11/12 09:30:17 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 715.391914] niks3-server[1454]: 2026/11/12 09:30:17 INFO Completed push id=76 objects=9 duration=42.17722ms lb # [ 715.393501] niks3-server[1454]: 2026/11/12 09:30:17 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo lb # [ 715.395701] niks3-server[1454]: 2026/11/12 09:30:17 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo lb # [ 715.397500] niks3-server[1454]: 2026/11/12 09:30:17 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst lb # [ 715.399535] niks3-server[1454]: 2026/11/12 09:30:17 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo lb # [ 715.401358] garage[898]: 2026-11-12T09:30:17.031952Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst lb # [ 715.404310] garage[898]: 2026-11-12T09:30:17.032512Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/adj3g5w8jh83wl959p7daq6igl0gaay3.ls worker2 # [ 712.552272] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 715.407317] garage[898]: 2026-11-12T09:30:17.035738Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls worker2 # [ 712.555034] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 715.410123] garage[898]: 2026-11-12T09:30:17.055247Z INFO garage_api_common::generic_server: 192.168.1.4:56256 PUT /farm/7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093017Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=878a4515e90415ccafd082a587b740f61c02c44677441adfd08e25b598aad25f worker2 # [ 712.563673] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 715.416425] garage[898]: 2026-11-12T09:30:17.057518Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst lb # [ 715.419535] garage[898]: 2026-11-12T09:30:17.058042Z INFO garage_api_common::generic_server: 192.168.1.4:56240 PUT /farm/adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093017Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=49b731711774e2413a3a6e11134fcaacbb7afaf11f7d44fc655b12f5c01c58a9 lb # [ 715.425432] garage[898]: 2026-11-12T09:30:17.063497Z INFO garage_api_common::generic_server: 192.168.1.4:56254 PUT /farm/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093017Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=44f4a0340392a03b7b7880e9d7077cae1bb8d6b335d7c7a67771cbbf1e137fa1 lb # [ 715.431039] garage[898]: 2026-11-12T09:30:17.070418Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst lb # [ 715.434289] garage[898]: 2026-11-12T09:30:17.086604Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo lb # [ 715.437067] garage[898]: 2026-11-12T09:30:17.087195Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo lb # [ 715.439704] garage[898]: 2026-11-12T09:30:17.087408Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo lb # [ 716.141619] garage[898]: 2026-11-12T09:30:17.900188Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo lb # [ 716.146659] garage[898]: 2026-11-12T09:30:17.900645Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 713.607430] nix-daemon[976]: reaped child process 3021, status = succeeded worker2 # [ 713.718077] nix-daemon[976]: accepted connection from pid 3037, user nix-grpc-daemon (trusted) lb # [ 716.595454] niks3-server[1454]: 2026/11/12 09:30:18 INFO Received push request method=POST path=/api/pushes worker2 # [ 713.744997] nix-daemon[976]: reaped child process 3040, status = succeeded worker2 # [ 713.752486] nix-grpc-daemon[1723]: time=2026-11-12T09:30:19.023Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 713.754296] nix-grpc-daemon[1723]: time=2026-11-12T09:30:19.023Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 716.612519] garage[898]: 2026-11-12T09:30:18.370386Z INFO garage_api_common::generic_server: 192.168.1.4:56240 PUT /farm/log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093018Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=74f6d2578e860fc7954cd370d1506249064ccaccc93f260aa14999a3ffd15bf3 worker2 # [ 713.777270] nix-grpc-daemon[1723]: time=2026-11-12T09:30:19.050Z level=INFO msg="Uploading 1 narinfos" lb # [ 716.639403] garage[898]: 2026-11-12T09:30:18.371937Z INFO garage_api_common::generic_server: 192.168.1.4:56256 PUT /farm/7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093018Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=682dbe13757f045da4b00848f77dcf94b8023b191f05182afa4cc5655c157b87 lb # [ 716.648743] garage[898]: 2026-11-12T09:30:18.372309Z INFO garage_api_common::generic_server: 192.168.1.4:56254 PUT /farm/nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093018Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4c38435041001d0b1b3571d7abbb53174705147798a4785aa375646def40ede7 lb # [ 716.659931] garage[898]: 2026-11-12T09:30:18.384704Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 716.666409] garage[898]: 2026-11-12T09:30:18.385990Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls worker2 # [ 713.818143] nix-grpc-daemon[1723]: time=2026-11-12T09:30:19.091Z level=INFO msg="Upload complete. (244ms)" lb # [ 716.671619] garage[898]: 2026-11-12T09:30:18.388681Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 716.678245] garage[898]: 2026-11-12T09:30:18.391012Z INFO garage_api_common::generic_server: 192.168.1.4:56254 PUT /farm/7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093018Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=700fac20b45b6cd5a62df53859cae2a601520c8b374f573883c07a4e5734f413 lb # [ 716.687975] garage[898]: 2026-11-12T09:30:18.394426Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo lb # [ 716.692095] niks3-server[1454]: 2026/11/12 09:30:18 INFO Received sign narinfos request method=POST path=/api/pushes/77/sign lb # [ 716.694322] niks3-server[1454]: 2026/11/12 09:30:18 INFO Signed narinfos id=77 count=1 worker2 # [ 713.827380] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 716.696553] niks3-server[1454]: 2026/11/12 09:30:18 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 716.699247] niks3-server[1454]: 2026/11/12 09:30:18 INFO Received complete push request method=POST path=/api/pushes/77/complete worker2 # [ 713.848732] nix-daemon[976]: reaped child process 3019, status = succeeded lb # [ 716.704196] niks3-server[1454]: 2026/11/12 09:30:18 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls worker2 # [ 713.851941] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:19Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 lb # [ 716.707146] niks3-server[1454]: 2026/11/12 09:30:18 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker2 # [ 713.856344] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:19Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=1 lb # [ 716.710624] niks3-server[1454]: 2026/11/12 09:30:18 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 716.713551] niks3-server[1454]: 2026/11/12 09:30:18 INFO Completed push id=77 objects=4 duration=37.63486ms worker2 # [ 713.870694] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 worker2 # [ 713.876362] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 713.884187] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 717.613881] garage[898]: 2026-11-12T09:30:19.372289Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker2 # [ 715.128262] nix-daemon[976]: reaped child process 3047, status = succeeded worker2 # [ 715.249004] nix-daemon[976]: accepted connection from pid 3063, user nix-grpc-daemon (trusted) worker2 # [ 715.274542] nix-daemon[976]: reaped child process 3066, status = succeeded lb # [ 717.618606] garage[898]: 2026-11-12T09:30:19.372747Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 718.133082] niks3-server[1454]: 2026/11/12 09:30:19 INFO Received push request method=POST path=/api/pushes worker2 # [ 715.290963] nix-grpc-daemon[1723]: time=2026-11-12T09:30:20.562Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 715.292797] nix-grpc-daemon[1723]: time=2026-11-12T09:30:20.562Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" worker2 # [ 715.309296] nix-grpc-daemon[1723]: time=2026-11-12T09:30:20.582Z level=INFO msg="Uploading 1 narinfos" lb # [ 718.144636] garage[898]: 2026-11-12T09:30:19.904038Z INFO garage_api_common::generic_server: 192.168.1.4:56254 PUT /farm/log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093019Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=336db78b4aff925193af9540c53605bdc1c5bf121200fdfada7f07f11b335a46 lb # [ 718.168673] garage[898]: 2026-11-12T09:30:19.914556Z INFO garage_api_common::generic_server: 192.168.1.4:56240 PUT /farm/6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093019Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bfdb99036bc8654789cb94fd5bc39fb67e809e3f217f67ba7607d25fbddf36ae lb # [ 718.177535] garage[898]: 2026-11-12T09:30:19.915093Z INFO garage_api_common::generic_server: 192.168.1.4:56256 PUT /farm/nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093019Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cbec285b78066fbbfe7e3e4134707a8ac100fb1b12492dba4f86b5fafcc3ccd2 lb # [ 718.192559] garage[898]: 2026-11-12T09:30:19.917860Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst worker2 # [ 715.345405] nix-grpc-daemon[1723]: time=2026-11-12T09:30:20.618Z level=INFO msg="Upload complete. (249ms)" lb # [ 718.197995] garage[898]: 2026-11-12T09:30:19.919081Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 718.204290] garage[898]: 2026-11-12T09:30:19.920500Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 718.208741] garage[898]: 2026-11-12T09:30:19.922973Z INFO garage_api_common::generic_server: 192.168.1.4:56256 PUT /farm/6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093019Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=10526c5f8734189eabe19c82768756bf20db2bb7ac62d27c2a13e622972813b0 lb # [ 718.216587] niks3-server[1454]: 2026/11/12 09:30:19 INFO Received sign narinfos request method=POST path=/api/pushes/78/sign lb # [ 718.218311] niks3-server[1454]: 2026/11/12 09:30:19 INFO Signed narinfos id=78 count=1 lb # [ 718.219949] niks3-server[1454]: 2026/11/12 09:30:19 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 718.222025] niks3-server[1454]: 2026/11/12 09:30:19 INFO Received complete push request method=POST path=/api/pushes/78/complete worker2 # [ 715.352901] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 718.223862] niks3-server[1454]: 2026/11/12 09:30:19 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls worker2 # [ 715.372801] nix-daemon[976]: reaped child process 3045, status = succeeded lb # [ 718.225905] niks3-server[1454]: 2026/11/12 09:30:19 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 718.228296] niks3-server[1454]: 2026/11/12 09:30:19 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo lb # [ 718.232867] niks3-server[1454]: 2026/11/12 09:30:19 INFO Completed push id=78 objects=8 duration=32.05912ms worker2 # [ 715.379654] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:20Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 lb # [ 718.234490] garage[898]: 2026-11-12T09:30:19.948708Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker2 # [ 715.383299] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:20Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 715.390537] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 worker2 # [ 715.396475] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 715.410488] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 718.588115] garage[898]: 2026-11-12T09:30:20.347373Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo lb # [ 718.592998] garage[898]: 2026-11-12T09:30:20.347826Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 716.040696] nix-daemon[976]: reaped child process 3073, status = succeeded worker2 # [ 716.089006] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 716.113883] systemd[2922]: Activating special unit Exit the Session... worker2 # [ 716.126856] systemd[2922]: Stopped target Main User Target. worker2 # [ 716.127887] systemd[2922]: Stopped target Basic System. worker2 # [ 716.139651] systemd[2922]: Stopped target Paths. worker2 # [ 716.143768] systemd[2922]: Stopped target Sockets. worker2 # [ 716.147869] systemd[2922]: Stopped target Timers. worker2 # [ 716.150582] systemd[2922]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 716.161018] systemd[2922]: Closed D-Bus User Message Bus Socket. worker2 # [ 716.162199] systemd[2922]: Stopped Create User Files and Directories. worker2 # [ 716.163162] systemd[2922]: Removed slice User Application Slice. worker2 # [ 716.187383] systemd[2922]: Reached target Shutdown. worker2 # [ 716.208517] systemd[2922]: Finished Exit the Session. worker2 # [ 716.232166] systemd[2922]: Reached target Exit the Session. worker2 # [ 716.233255] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 716.255699] systemd-logind[515]: Removed session 91. worker2 # [ 716.257853] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 716.258724] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 716.259692] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 716.263913] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 716.268589] nix-daemon[976]: accepted connection from pid 3089, user nix-grpc-daemon (trusted) worker2 # [ 716.270024] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 719.141467] niks3-server[1454]: 2026/11/12 09:30:20 INFO Received push request method=POST path=/api/pushes worker2 # [ 716.291646] nix-daemon[976]: reaped child process 3096, status = succeeded worker2 # [ 716.296521] nix-grpc-daemon[1723]: time=2026-11-12T09:30:21.568Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 716.298287] nix-grpc-daemon[1723]: time=2026-11-12T09:30:21.568Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 719.155576] garage[898]: 2026-11-12T09:30:20.914361Z INFO garage_api_common::generic_server: 192.168.1.4:56256 PUT /farm/log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093020Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2bec0781dfd403147a502eba0b0fe200ab0cb49e7aa2448e0ad979573310ab8a worker2 # [ 716.315790] nix-grpc-daemon[1723]: time=2026-11-12T09:30:21.588Z level=INFO msg="Uploading 1 narinfos" lb # [ 719.178919] garage[898]: 2026-11-12T09:30:20.925636Z INFO garage_api_common::generic_server: 192.168.1.4:56254 PUT /farm/1ini8mfd1rzqyp8jgqihp4k889588mpx.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093020Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cedc4926fd38c31523fddda81f463696fc84d1d70eeb05fdf98a60886353a9d6 worker2 # [ 716.334832] nix-grpc-daemon[1723]: time=2026-11-12T09:30:21.607Z level=INFO msg="Upload complete. (314ms)" worker2 # [ 716.340267] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 719.189994] garage[898]: 2026-11-12T09:30:20.926071Z INFO garage_api_common::generic_server: 192.168.1.4:56240 PUT /farm/nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093020Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e3bfcfbb1536f956fa9cc5d5a1f78c8a3602999c1d8e2479a3809d977ca9da2b lb # [ 719.201494] garage[898]: 2026-11-12T09:30:20.929417Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/1ini8mfd1rzqyp8jgqihp4k889588mpx.ls worker2 # [ 716.352859] nix-daemon[976]: reaped child process 3071, status = succeeded lb # [ 719.207161] garage[898]: 2026-11-12T09:30:20.929888Z INFO garage_api_common::generic_server: 192.168.1.4:56240 PUT /farm/1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093020Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9b1d9d773818e5268f23bc979ac001afc9bf0034dcfc3da330ce6fd2d236c413 lb # [ 719.217872] garage[898]: 2026-11-12T09:30:20.933136Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 719.223186] garage[898]: 2026-11-12T09:30:20.935053Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo lb # [ 719.227628] niks3-server[1454]: 2026/11/12 09:30:20 INFO Received sign narinfos request method=POST path=/api/pushes/79/sign lb # [ 719.230192] niks3-server[1454]: 2026/11/12 09:30:20 INFO Signed narinfos id=79 count=1 lb # [ 719.231730] niks3-server[1454]: 2026/11/12 09:30:20 INFO Received complete push request method=POST path=/api/pushes/79/complete lb # [ 719.234058] niks3-server[1454]: 2026/11/12 09:30:20 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 719.236302] niks3-server[1454]: 2026/11/12 09:30:20 INFO Completed push id=79 objects=12 duration=13.98472ms lb # [ 719.238152] niks3-server[1454]: 2026/11/12 09:30:20 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst client # [ 717.936775] sshd-session[2725]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 719.240909] niks3-server[1454]: 2026/11/12 09:30:20 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv client # [ 717.940372] sshd-session[2725]: Disconnected from user root UNKNOWN port 65535 lb # [ 719.243421] niks3-server[1454]: 2026/11/12 09:30:20 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo lb # [ 719.245796] garage[898]: 2026-11-12T09:30:20.937909Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst client # [ 717.944627] sshd-session[2703]: pam_unix(sshd:session): session closed for user root client # [ 717.951048] systemd[1]: sshd-vsock@96-97-3:22-2:96.service: Deactivated successfully. client # [ 717.958917] systemd[1]: session-114.scope: Deactivated successfully. client # [ 717.961757] systemd[1]: session-114.scope: Consumed 202ms CPU time over 4.572s wall clock time, 42.3M memory peak, 12.6K incoming IP traffic, 13.8K outgoing IP traffic. client # [ 717.971049] systemd-logind[427]: Session 114 logged out. Waiting for processes to exit. client # [ 717.973713] systemd-logind[427]: Removed session 114. client # [ 719.537459] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 719.545377] systemd[1]: Started SSH per-connection Daemon (vsock:2:97). client # [ 719.649901] sshd-session[2744]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 719.658873] sshd-session[2744]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 719.667159] sshd-session[2744]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 719.678135] systemd-logind[427]: New session '116' of user 'root' with class 'user' and type 'tty'. client # [ 719.685392] systemd[1]: Started Session 116 of User root. client # [ 719.826659] sshd-session[2750]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 719.829732] sshd-session[2750]: Disconnected from user root UNKNOWN port 65535 client # [ 719.832861] sshd-session[2744]: pam_unix(sshd:session): session closed for user root client # [ 719.836460] systemd[1]: sshd-vsock@97-98-3:22-2:97.service: Deactivated successfully. client # [ 719.841878] systemd[1]: session-116.scope: Deactivated successfully. client # [ 719.846290] systemd-logind[427]: Session 116 logged out. Waiting for processes to exit. client # [ 719.848605] systemd-logind[427]: Removed session 116. worker1 # [ 722.293301] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 722.301604] systemd[1]: Started SSH per-connection Daemon (vsock:2:120). worker1 # [ 722.397474] sshd-session[3779]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 722.406835] sshd-session[3779]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 722.415515] sshd-session[3779]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 722.435339] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 722.444467] systemd-logind[539]: New session '137' of user 'root' with class 'user' and type 'tty'. worker1 # [ 722.471864] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 722.478827] systemd[1]: Starting User Manager for UID 0... worker1 # [ 722.506491] (systemd)[3787]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 722.513248] systemd-logind[539]: New session '138' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 722.598474] systemd[3787]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 722.697099] systemd[3787]: Queued start job for default target Main User Target. worker1 # [ 722.701058] systemd[3787]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 722.705386] systemd[3787]: Created slice User Application Slice. worker1 # [ 722.706441] systemd[3787]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 722.707584] systemd[3787]: Reached target Paths. worker1 # [ 722.711036] systemd[3787]: Reached target Timers. worker1 # [ 722.711875] systemd[3787]: Starting D-Bus User Message Bus Socket... worker1 # [ 722.716364] systemd[3787]: Starting Create User Files and Directories... worker1 # [ 722.750928] systemd[3787]: Finished Create User Files and Directories. worker1 # [ 722.753921] systemd[3787]: Listening on D-Bus User Message Bus Socket. worker1 # [ 722.758515] systemd[3787]: Reached target Sockets. worker1 # [ 722.759538] systemd[3787]: Reached target Basic System. worker1 # [ 722.760580] systemd[3787]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 722.762034] systemd[3787]: Reached target Main User Target. worker1 # [ 722.762839] systemd[3787]: Startup finished in 227ms. worker1 # [ 722.763627] systemd[1]: Started User Manager for UID 0. worker1 # [ 722.767311] systemd[1]: Started Session 137 of User root. worker1 # [ 722.794310] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 722.902786] nix-grpc-daemon[3803]: ts=2026-11-12T09:30:26Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 722.905579] nix-grpc-daemon[3803]: ts=2026-11-12T09:30:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 722.909967] nix-grpc-daemon[3803]: ts=2026-11-12T09:30:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 722.918831] nix-grpc-daemon[3803]: ts=2026-11-12T09:30:26Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 722.959771] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 722.972438] sshd-session[3800]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 722.973803] systemd[1]: sshd-vsock@120-121-5:22-2:120.service: Deactivated successfully. worker1 # [ 722.980228] sshd-session[3800]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 722.982025] systemd[1]: session-137.scope: Deactivated successfully. worker1 # [ 722.983036] sshd-session[3779]: pam_unix(sshd:session): session closed for user root worker1 # [ 722.988047] systemd-logind[539]: Session 137 logged out. Waiting for processes to exit. worker1 # [ 722.991556] systemd-logind[539]: Removed session 137. worker1 # [ 722.992811] nix-grpc-daemon[3803]: ts=2026-11-12T09:30:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 721.439324] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:26Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:55080 worker2 # [ 721.439653] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:26Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb # [ 726.336154] envoy[897]: conn peer=[2001:db8:1::1]:37794 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=6364 tx=4000 ms=4364 lb # [ 727.494825] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 727.502795] systemd[1]: Started SSH per-connection Daemon (vsock:2:56). lb # [ 727.604565] sshd-session[2264]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 727.615913] sshd-session[2264]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 727.626112] sshd-session[2264]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 727.642694] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 727.656440] systemd-logind[499]: New session '77' of user 'root' with class 'user' and type 'tty'. lb # [ 727.680608] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 727.691703] systemd[1]: Starting User Manager for UID 0... lb # [ 727.723919] (systemd)[2272]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 727.730218] systemd-logind[499]: New session '78' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 727.819690] systemd[2272]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 727.957474] systemd[2272]: Queued start job for default target Main User Target. lb # [ 727.965117] systemd[2272]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 727.968247] systemd[2272]: Created slice User Application Slice. lb # [ 727.971087] systemd[2272]: Started Daily Cleanup of User's Temporary Directories. lb # [ 727.974274] systemd[2272]: Reached target Paths. lb # [ 727.975123] systemd[2272]: Reached target Timers. lb # [ 727.975814] systemd[2272]: Starting D-Bus User Message Bus Socket... lb # [ 727.980252] systemd[2272]: Starting Create User Files and Directories... lb # [ 728.024692] systemd[2272]: Finished Create User Files and Directories. lb # [ 728.027923] systemd[2272]: Listening on D-Bus User Message Bus Socket. lb # [ 728.032726] systemd[2272]: Reached target Sockets. lb # [ 728.033554] systemd[2272]: Reached target Basic System. lb # [ 728.034346] systemd[2272]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 728.035816] systemd[2272]: Reached target Main User Target. lb # [ 728.037411] systemd[2272]: Startup finished in 284ms. lb # [ 728.038201] systemd[1]: Started User Manager for UID 0. lb # [ 728.041221] systemd[1]: Started Session 77 of User root. lb # [ 728.074942] sshd-session[2287]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 728.077772] sshd-session[2287]: Disconnected from user root UNKNOWN port 65535 lb # [ 728.079070] sshd-session[2264]: pam_unix(sshd:session): session closed for user root lb # [ 728.083616] systemd[1]: sshd-vsock@56-57-4:22-2:56.service: Deactivated successfully. lb # [ 728.089427] systemd[1]: session-77.scope: Deactivated successfully. lb # [ 728.092536] systemd[1]: session-77.scope: Consumed 26ms CPU time over 50ms wall clock time, 2.9M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 728.097552] systemd-logind[499]: Session 77 logged out. Waiting for processes to exit. lb # [ 728.098796] systemd-logind[499]: Removed session 77. [e2e] heartbeat t=630s worker2 # [ 728.333440] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 728.341578] systemd[1]: Started SSH per-connection Daemon (vsock:2:79). client # [ 729.893174] systemd[1]: Stopping User Manager for UID 0... client # [ 729.901226] systemd[2712]: Activating special unit Exit the Session... client # [ 729.907543] systemd[2712]: Stopped target Main User Target. client # [ 729.911312] systemd[2712]: Stopped target Basic System. client # [ 729.913163] systemd[2712]: Stopped target Paths. client # [ 729.914280] systemd[2712]: Stopped target Sockets. client # [ 729.915422] systemd[2712]: Stopped target Timers. client # [ 729.916579] systemd[2712]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 729.918192] systemd[2712]: Closed D-Bus User Message Bus Socket. client # [ 729.919621] systemd[2712]: Stopped Create User Files and Directories. client # [ 729.921147] systemd[2712]: Removed slice User Application Slice. client # [ 729.922487] systemd[2712]: Reached target Shutdown. client # [ 729.923644] systemd[2712]: Finished Exit the Session. client # [ 729.925894] systemd[2712]: Reached target Exit the Session. client # [ 729.949890] systemd-logind[427]: Removed session 115. client # [ 729.957182] systemd[1]: user@0.service: Deactivated successfully. client # [ 729.962097] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 728.443044] sshd-session[3098]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 728.452980] sshd-session[3098]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 728.463080] sshd-session[3098]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 730.023594] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 728.486234] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 728.496614] systemd-logind[515]: New session '98' of user 'root' with class 'user' and type 'tty'. client # [ 730.061576] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 730.066523] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 730.070528] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 728.525606] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 728.532232] systemd[1]: Starting User Manager for UID 0... worker2 # [ 728.562837] (systemd)[3106]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 728.569420] systemd-logind[515]: New session '99' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 728.659533] systemd[3106]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 728.757704] systemd[3106]: Queued start job for default target Main User Target. worker2 # [ 728.765010] systemd[3106]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 728.769240] systemd[3106]: Created slice User Application Slice. worker2 # [ 728.770431] systemd[3106]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 728.771529] systemd[3106]: Reached target Paths. worker2 # [ 728.775235] systemd[3106]: Reached target Timers. worker2 # [ 728.777502] systemd[3106]: Starting D-Bus User Message Bus Socket... worker2 # [ 728.778521] systemd[3106]: Starting Create User Files and Directories... worker2 # [ 728.812494] systemd[3106]: Listening on D-Bus User Message Bus Socket. worker2 # [ 728.814848] systemd[3106]: Reached target Sockets. worker2 # [ 728.825291] systemd[3106]: Finished Create User Files and Directories. worker2 # [ 728.826429] systemd[3106]: Reached target Basic System. worker2 # [ 728.830822] systemd[1]: Started User Manager for UID 0. worker2 # [ 728.831787] systemd[3106]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 728.837301] systemd[3106]: Reached target Main User Target. worker2 # [ 728.838267] systemd[3106]: Startup finished in 243ms. worker2 # [ 728.839054] systemd[1]: Started Session 98 of User root. worker2 # [ 728.869172] sshd-session[3119]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 728.871721] sshd-session[3119]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 728.873842] sshd-session[3098]: pam_unix(sshd:session): session closed for user root worker2 # [ 728.877802] systemd[1]: sshd-vsock@79-80-6:22-2:79.service: Deactivated successfully. worker2 # [ 728.882705] systemd[1]: session-98.scope: Deactivated successfully. worker2 # [ 728.884420] systemd[1]: session-98.scope: Consumed 26ms CPU time over 50ms wall clock time, 6.3M memory peak, 19.7K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 728.889888] systemd-logind[515]: Session 98 logged out. Waiting for processes to exit. worker2 # [ 728.892365] systemd-logind[515]: Removed session 98. lb # [ 732.960341] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 732.964267] systemd[1]: Started SSH per-connection Daemon (vsock:2:57). lb # [ 733.063640] sshd-session[2292]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 733.073918] sshd-session[2292]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 733.082997] sshd-session[2292]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 733.094391] systemd-logind[499]: New session '79' of user 'root' with class 'user' and type 'tty'. lb # [ 733.100726] systemd[1]: Started Session 79 of User root. lb # [ 733.140572] sshd-session[2298]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 733.142093] sshd-session[2298]: Disconnected from user root UNKNOWN port 65535 lb # [ 733.143722] sshd-session[2292]: pam_unix(sshd:session): session closed for user root lb # [ 733.148297] systemd[1]: sshd-vsock@57-58-4:22-2:57.service: Deactivated successfully. lb # [ 733.153732] systemd[1]: session-79.scope: Deactivated successfully. lb # [ 733.155698] systemd[1]: session-79.scope: Consumed 30ms CPU time over 54ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 733.162145] systemd-logind[499]: Session 79 logged out. Waiting for processes to exit. lb # [ 733.163606] systemd-logind[499]: Removed session 79. worker1 # [ 732.055969] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 732.064472] systemd[1]: Started SSH per-connection Daemon (vsock:2:121). worker1 # [ 732.165775] sshd-session[3857]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 732.175878] sshd-session[3857]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 732.185098] sshd-session[3857]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 732.197122] systemd-logind[539]: New session '139' of user 'root' with class 'user' and type 'tty'. worker1 # [ 732.207977] systemd[1]: Started Session 139 of User root. worker1 # [ 732.243955] sshd-session[3863]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 732.245910] sshd-session[3863]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 732.247967] sshd-session[3857]: pam_unix(sshd:session): session closed for user root worker1 # [ 732.251971] systemd[1]: sshd-vsock@121-122-5:22-2:121.service: Deactivated successfully. worker1 # [ 732.257964] systemd[1]: session-139.scope: Deactivated successfully. worker1 # [ 732.261099] systemd[1]: session-139.scope: Consumed 30ms CPU time over 54ms wall clock time, 3.1M memory peak, 2K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 732.266415] systemd-logind[539]: Session 139 logged out. Waiting for processes to exit. worker1 # [ 732.267699] systemd-logind[539]: Removed session 139. ok test farm::serial::scheduler_restart_mid_build_finishes_without_a_double_build ... worker1 # [ 732.551395] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 732.559573] systemd[1]: Started SSH per-connection Daemon (vsock:2:122). worker1 # [ 732.657143] sshd-session[3868]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 732.664666] sshd-session[3868]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 732.675342] sshd-session[3868]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 732.684153] systemd-logind[539]: New session '140' of user 'root' with class 'user' and type 'tty'. worker1 # [ 732.693593] systemd[1]: Started Session 140 of User root. worker1 # [ 732.726202] sshd-session[3874]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 732.728961] sshd-session[3874]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 732.730781] sshd-session[3868]: pam_unix(sshd:session): session closed for user root worker1 # [ 732.734682] systemd[1]: sshd-vsock@122-123-5:22-2:122.service: Deactivated successfully. worker1 # [ 732.740178] systemd[1]: session-140.scope: Deactivated successfully. worker1 # [ 732.744863] systemd-logind[539]: Session 140 logged out. Waiting for processes to exit. worker1 # [ 732.747135] systemd-logind[539]: Removed session 140. worker2 # [ 731.438199] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 731.447385] systemd[1]: Started SSH per-connection Daemon (vsock:2:80). worker2 # [ 731.543290] sshd-session[3124]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 731.552246] sshd-session[3124]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 731.562547] sshd-session[3124]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 731.574878] systemd-logind[515]: New session '100' of user 'root' with class 'user' and type 'tty'. worker2 # [ 731.583165] systemd[1]: Started Session 100 of User root. worker2 # [ 731.614791] sshd-session[3130]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 731.618126] sshd-session[3130]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 731.619309] sshd-session[3124]: pam_unix(sshd:session): session closed for user root worker2 # [ 731.623400] systemd[1]: sshd-vsock@80-81-6:22-2:80.service: Deactivated successfully. worker2 # [ 731.629488] systemd[1]: session-100.scope: Deactivated successfully. worker2 # [ 731.633913] systemd-logind[515]: Session 100 logged out. Waiting for processes to exit. worker2 # [ 731.635973] systemd-logind[515]: Removed session 100. lb # [ 735.836505] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 735.845555] systemd[1]: Started SSH per-connection Daemon (vsock:2:58). lb # [ 735.943149] sshd-session[2303]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 735.953691] sshd-session[2303]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 735.962649] sshd-session[2303]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 735.974768] systemd-logind[499]: New session '80' of user 'root' with class 'user' and type 'tty'. lb # [ 735.979681] systemd[1]: Started Session 80 of User root. lb # [ 736.013046] sshd-session[2309]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 736.015611] sshd-session[2309]: Disconnected from user root UNKNOWN port 65535 lb # [ 736.017613] sshd-session[2303]: pam_unix(sshd:session): session closed for user root lb # [ 736.021166] systemd[1]: sshd-vsock@58-59-4:22-2:58.service: Deactivated successfully. lb # [ 736.026527] systemd[1]: session-80.scope: Deactivated successfully. lb # [ 736.029515] systemd[1]: session-80.scope: Consumed 28ms CPU time over 51ms wall clock time, 5.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 736.034569] systemd-logind[499]: Session 80 logged out. Waiting for processes to exit. lb # [ 736.035958] systemd-logind[499]: Removed session 80. worker2 # [ 734.055310] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 734.064852] systemd[1]: Started SSH per-connection Daemon (vsock:2:81). worker2 # [ 734.163388] sshd-session[3136]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 734.171708] sshd-session[3136]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 734.183126] sshd-session[3136]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 734.192891] systemd-logind[515]: New session '101' of user 'root' with class 'user' and type 'tty'. worker2 # [ 734.205595] systemd[1]: Started Session 101 of User root. worker2 # [ 734.243842] sshd-session[3142]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 734.246080] sshd-session[3142]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 734.249256] sshd-session[3136]: pam_unix(sshd:session): session closed for user root worker2 # [ 734.253915] systemd[1]: sshd-vsock@81-82-6:22-2:81.service: Deactivated successfully. worker2 # [ 734.258932] systemd[1]: session-101.scope: Deactivated successfully. worker2 # [ 734.261043] systemd[1]: session-101.scope: Consumed 29ms CPU time over 56ms wall clock time, 4.6M memory peak, 19.7K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 734.267382] systemd-logind[515]: Session 101 logged out. Waiting for processes to exit. worker2 # [ 734.270293] systemd-logind[515]: Removed session 101. client # [ 738.963938] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 738.971579] systemd[1]: Started SSH per-connection Daemon (vsock:2:98). client # [ 739.068854] sshd-session[2762]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 739.077244] sshd-session[2762]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 739.087985] sshd-session[2762]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 739.107863] systemd-logind[427]: New session '117' of user 'root' with class 'user' and type 'tty'. client # [ 739.120457] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 739.160495] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 739.167152] systemd[1]: Starting User Manager for UID 0... client # [ 739.193829] (systemd)[2771]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 739.200354] systemd-logind[427]: New session '118' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 739.287805] systemd[2771]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 739.387635] systemd[2771]: Queued start job for default target Main User Target. client # [ 739.397066] systemd[2771]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 739.400002] systemd[2771]: Created slice User Application Slice. client # [ 739.402495] systemd[2771]: Started Daily Cleanup of User's Temporary Directories. client # [ 739.403804] systemd[2771]: Reached target Paths. client # [ 739.406578] systemd[2771]: Reached target Timers. client # [ 739.407374] systemd[2771]: Starting D-Bus User Message Bus Socket... client # [ 739.410312] systemd[2771]: Starting Create User Files and Directories... client # [ 739.449596] systemd[2771]: Finished Create User Files and Directories. client # [ 739.454784] systemd[2771]: Listening on D-Bus User Message Bus Socket. client # [ 739.455980] systemd[2771]: Reached target Sockets. client # [ 739.456908] systemd[2771]: Reached target Basic System. client # [ 739.457673] systemd[2771]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 739.459099] systemd[2771]: Reached target Main User Target. client # [ 739.459898] systemd[2771]: Startup finished in 236ms. client # [ 739.463750] systemd[1]: Started User Manager for UID 0. client # [ 739.465759] systemd[1]: Started Session 117 of User root. client # [ 739.490021] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.pem&client-key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.key" --eval-store auto -f /nix/store/v7sckhacjvxxq8xv667z4hgvbaqhw2dd-slow.nix --argstr tag mid. client # [ 739.499960] sshd-session[2785]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 739.504925] sshd-session[2785]: Disconnected from user root UNKNOWN port 65535 client # [ 739.506130] sshd-session[2762]: pam_unix(sshd:session): session closed for user root client # [ 739.512799] systemd[1]: sshd-vsock@98-99-3:22-2:98.service: Deactivated successfully. client # [ 739.521811] systemd[1]: session-117.scope: Deactivated successfully. client # [ 739.528443] systemd-logind[427]: Session 117 logged out. Waiting for processes to exit. client # [ 739.534019] systemd-logind[427]: Removed session 117. worker1 # [ 739.701736] nix-grpc-daemon[3803]: ts=2026-11-12T09:30:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50846 worker1 # [ 739.711956] nix-daemon[1059]: accepted connection from pid 3803, user nix-grpc-daemon (trusted) client # [ 739.720261] nix[2788]: don't know how to build these paths: client # [ 739.722158] nix[2788]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker1 # [ 739.727757] nix-grpc-daemon[3803]: ts=2026-11-12T09:30:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50846 worker1 # [ 739.742455] nix-grpc-daemon[3803]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 1/5) worker1 # [ 739.769054] nix-grpc-daemon[3803]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 155 ms (attempt 2/5) worker1 # [ 739.925857] nix-grpc-daemon[3803]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 259 ms (attempt 3/5) worker1 # [ 740.186622] nix-grpc-daemon[3803]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 639 ms (attempt 4/5) worker1 # [ 740.677924] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 740.686459] systemd[1]: Started SSH per-connection Daemon (vsock:2:123). worker1 # [ 740.788905] sshd-session[3887]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 740.798899] sshd-session[3887]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 740.807728] sshd-session[3887]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 740.816481] systemd-logind[539]: New session '141' of user 'root' with class 'user' and type 'tty'. worker1 # [ 740.827403] nix-grpc-daemon[3803]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 740.833604] nix-grpc-daemon[3803]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 740.840129] systemd[1]: Started Session 141 of User root. lb # [ 742.142109] garage[898]: 2026-11-12T09:30:43.900516Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo lb # [ 742.142360] garage[898]: 2026-11-12T09:30:43.900973Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 739.301618] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 742.160851] garage[898]: 2026-11-12T09:30:43.920278Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo lb # [ 742.165866] garage[898]: 2026-11-12T09:30:43.920724Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 740.871199] sshd-session[3893]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 740.873878] sshd-session[3893]: Disconnected from user root UNKNOWN port 65535 lb # [ 742.171266] garage[898]: 2026-11-12T09:30:43.930182Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo worker1 # [ 740.875817] sshd-session[3887]: pam_unix(sshd:session): session closed for user root lb # [ 742.176903] garage[898]: 2026-11-12T09:30:43.930672Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 740.879645] systemd[1]: sshd-vsock@123-124-5:22-2:123.service: Deactivated successfully. worker1 # [ 740.887668] systemd[1]: session-141.scope: Deactivated successfully. worker1 # [ 740.889417] nix-grpc-daemon[3803]: ts=2026-11-12T09:30:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50846 lb # [ 742.188225] garage[898]: 2026-11-12T09:30:43.948170Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo worker1 # [ 740.893727] systemd-logind[539]: Session 141 logged out. Waiting for processes to exit. lb # [ 742.193708] garage[898]: 2026-11-12T09:30:43.952902Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 740.897737] systemd-logind[539]: Removed session 141. client # [ 740.896814] nix[2788]: copying 1 paths to 'lb:50051'... worker2 # [ 739.347448] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 client # [ 740.899311] nix[2788]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker2 # [ 739.359055] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 739.378646] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 739.528441] nix-daemon[976]: accepted connection from pid 3151, user nix-grpc-daemon (trusted) lb # [ 742.407796] niks3-server[1454]: 2026/11/12 09:30:44 INFO Received push request method=POST path=/api/pushes worker2 # [ 739.556636] nix-daemon[976]: reaped child process 3154, status = succeeded worker2 # [ 739.561859] nix-grpc-daemon[1723]: time=2026-11-12T09:30:44.833Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 739.563630] nix-grpc-daemon[1723]: time=2026-11-12T09:30:44.834Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 742.416234] garage[898]: 2026-11-12T09:30:44.175155Z INFO garage_api_common::generic_server: 192.168.1.4:56240 PUT /farm/nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093044Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6a94461b876705be124330d5611831d24fc75b96ca39efcc38315e0df17d699d worker2 # [ 739.575259] nix-grpc-daemon[1723]: time=2026-11-12T09:30:44.848Z level=INFO msg="Uploading 1 narinfos" worker2 # [ 739.583990] nix-grpc-daemon[1723]: time=2026-11-12T09:30:44.856Z level=INFO msg="Upload complete. (195ms)" lb # [ 742.438580] garage[898]: 2026-11-12T09:30:44.175802Z INFO garage_api_common::generic_server: 192.168.1.4:56254 PUT /farm/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093044Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=576aa95985819b78d666147cb13925b417517535d6fca0233e8e474c3beaeb70 worker2 # [ 739.592146] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48140 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 739.598619] nix-daemon[976]: reaped child process 3147, status = succeeded lb # [ 742.448435] garage[898]: 2026-11-12T09:30:44.189079Z INFO garage_api_common::generic_server: 192.168.1.4:56254 PUT /farm/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093044Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=44408307fa7604eb53eefb1ac1c97f2057b2c1e833e664817b2bb55e1a9e8f17 lb # [ 742.458366] garage[898]: 2026-11-12T09:30:44.192268Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 742.463169] garage[898]: 2026-11-12T09:30:44.192826Z INFO garage_api_common::generic_server: 127.0.0.1:33722 (key GK0123456789abcdef01234567) HEAD /farm/nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst worker2 # [ 739.617804] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:44Z level=debug event=want client=2 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 lb # [ 742.470403] garage[898]: 2026-11-12T09:30:44.195277Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo worker2 # [ 739.620786] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:44Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 lb # [ 742.475954] niks3-server[1454]: 2026/11/12 09:30:44 INFO Received sign narinfos request method=POST path=/api/pushes/80/sign lb # [ 742.479568] niks3-server[1454]: 2026/11/12 09:30:44 INFO Signed narinfos id=80 count=1 worker2 # [ 739.626774] nix-grpc-daemon[1487]: ts=2026-11-12T09:30:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48140 lb # [ 742.481682] niks3-server[1454]: 2026/11/12 09:30:44 INFO Received complete push request method=POST path=/api/pushes/80/complete lb # [ 742.485528] niks3-server[1454]: 2026/11/12 09:30:44 INFO Completed push id=80 objects=3 duration=5.72142ms lb # [ 742.487616] niks3-server[1454]: 2026/11/12 09:30:44 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo worker2 # [ 739.635549] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) lb # [ 742.490305] niks3-server[1454]: 2026/11/12 09:30:44 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 742.492718] niks3-server[1454]: 2026/11/12 09:30:44 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst client # [ 741.195438] nix[2788]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker2 # [ 739.646522] nix-daemon[976]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) worker2 # [ 740.235900] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 740.245667] systemd[1]: Started SSH per-connection Daemon (vsock:2:82). worker2 # [ 740.344898] sshd-session[3168]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 740.354594] sshd-session[3168]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 740.364503] sshd-session[3168]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 740.376550] systemd-logind[515]: New session '102' of user 'root' with class 'user' and type 'tty'. worker2 # [ 740.385109] systemd[1]: Started Session 102 of User root. worker2 # [ 740.424622] sshd-session[3174]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 740.427482] sshd-session[3174]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 740.429773] sshd-session[3168]: pam_unix(sshd:session): session closed for user root worker2 # [ 740.434192] systemd[1]: sshd-vsock@82-83-6:22-2:82.service: Deactivated successfully. worker2 # [ 740.439586] systemd[1]: session-102.scope: Deactivated successfully. worker2 # [ 740.444882] systemd-logind[515]: Session 102 logged out. Waiting for processes to exit. worker2 # [ 740.447938] systemd-logind[515]: Removed session 102. lb # [ 743.356986] garage[898]: 2026-11-12T09:30:45.115418Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo lb # [ 743.357237] garage[898]: 2026-11-12T09:30:45.116028Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 742.895083] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 742.903145] systemd[1]: Started SSH per-connection Daemon (vsock:2:124). worker1 # [ 743.000932] sshd-session[3898]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 743.011157] sshd-session[3898]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 743.020683] sshd-session[3898]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 743.032999] systemd-logind[539]: New session '142' of user 'root' with class 'user' and type 'tty'. worker1 # [ 743.036571] systemd[1]: Started Session 142 of User root. worker1 # [ 743.073133] sshd-session[3904]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 743.075776] sshd-session[3904]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 743.077427] sshd-session[3898]: pam_unix(sshd:session): session closed for user root worker1 # [ 743.081677] systemd[1]: sshd-vsock@124-125-5:22-2:124.service: Deactivated successfully. worker1 # [ 743.086975] systemd[1]: session-142.scope: Deactivated successfully. worker1 # [ 743.091721] systemd-logind[539]: Session 142 logged out. Waiting for processes to exit. worker1 # [ 743.094792] systemd-logind[539]: Removed session 142. worker2 # [ 742.863828] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 742.867850] systemd[1]: Started SSH per-connection Daemon (vsock:2:83). worker2 # [ 743.014013] sshd-session[3188]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 743.023076] sshd-session[3188]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 743.039459] sshd-session[3188]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 743.052074] systemd-logind[515]: New session '103' of user 'root' with class 'user' and type 'tty'. worker2 # [ 743.058639] systemd[1]: Started Session 103 of User root. lb # [ 746.057171] systemd[1]: Stopping User Manager for UID 0... lb # [ 746.063285] systemd[2272]: Activating special unit Exit the Session... lb # [ 746.069679] systemd[2272]: Stopped target Main User Target. lb # [ 746.074251] systemd[2272]: Stopped target Basic System. lb # [ 746.076222] systemd[2272]: Stopped target Paths. lb # [ 746.077409] systemd[2272]: Stopped target Sockets. lb # [ 746.078567] systemd[2272]: Stopped target Timers. lb # [ 746.080277] systemd[2272]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 746.082128] systemd[2272]: Closed D-Bus User Message Bus Socket. lb # [ 746.083575] systemd[2272]: Stopped Create User Files and Directories. lb # [ 746.085740] systemd[2272]: Removed slice User Application Slice. lb # [ 746.087143] systemd[2272]: Reached target Shutdown. lb # [ 746.088750] systemd[2272]: Finished Exit the Session. lb # [ 746.089958] systemd[2272]: Reached target Exit the Session. lb # [ 746.113583] systemd-logind[499]: Removed session 78. lb # [ 746.121488] systemd[1]: user@0.service: Deactivated successfully. lb # [ 746.126956] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 743.280319] sshd-session[3194]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 743.282263] sshd-session[3194]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 743.283334] sshd-session[3188]: pam_unix(sshd:session): session closed for user root worker2 # [ 743.312254] systemd[1]: sshd-vsock@83-84-6:22-2:83.service: Deactivated successfully. worker2 # [ 743.318107] systemd[1]: session-103.scope: Deactivated successfully. worker2 # [ 743.324582] systemd-logind[515]: Session 103 logged out. Waiting for processes to exit. worker2 # [ 743.326138] systemd-logind[515]: Removed session 103. lb # [ 746.185081] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 746.225369] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 746.231020] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 746.235185] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 747.509100] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 747.515789] systemd[1]: Started SSH per-connection Daemon (vsock:2:125). worker1 # [ 747.621024] sshd-session[3909]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 747.631485] sshd-session[3909]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 747.641278] sshd-session[3909]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 747.653263] systemd-logind[539]: New session '143' of user 'root' with class 'user' and type 'tty'. worker1 # [ 747.667497] systemd[1]: Started Session 143 of User root. worker1 # [ 747.703422] sshd-session[3915]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 747.706490] sshd-session[3915]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 747.708471] sshd-session[3909]: pam_unix(sshd:session): session closed for user root worker1 # [ 747.712926] systemd[1]: sshd-vsock@125-126-5:22-2:125.service: Deactivated successfully. worker1 # [ 747.718884] systemd[1]: session-143.scope: Deactivated successfully. worker1 # [ 747.723615] systemd-logind[539]: Session 143 logged out. Waiting for processes to exit. worker1 # [ 747.726429] systemd-logind[539]: Removed session 143. worker2 # [ 747.583010] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 747.584515] systemd[1]: Started SSH per-connection Daemon (vsock:2:84). worker2 # [ 747.713034] sshd-session[3199]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 747.728137] sshd-session[3199]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 747.744436] sshd-session[3199]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 747.753368] systemd-logind[515]: New session '104' of user 'root' with class 'user' and type 'tty'. worker2 # [ 747.763667] systemd[1]: Started Session 104 of User root. worker2 # [ 747.978149] sshd-session[3205]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 747.979615] sshd-session[3205]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 747.984505] sshd-session[3199]: pam_unix(sshd:session): session closed for user root worker2 # [ 748.022725] systemd[1]: sshd-vsock@84-85-6:22-2:84.service: Deactivated successfully. worker2 # [ 748.029079] systemd[1]: session-104.scope: Deactivated successfully. worker2 # [ 748.030197] systemd-logind[515]: Session 104 logged out. Waiting for processes to exit. worker2 # [ 748.031330] systemd-logind[515]: Removed session 104. client # [ 749.644563] systemd[1]: Stopping User Manager for UID 0... client # [ 749.651498] systemd[2771]: Activating special unit Exit the Session... client # [ 749.656656] systemd[2771]: Stopped target Main User Target. client # [ 749.662712] systemd[2771]: Stopped target Basic System. client # [ 749.664716] systemd[2771]: Stopped target Paths. client # [ 749.665929] systemd[2771]: Stopped target Sockets. client # [ 749.667221] systemd[2771]: Stopped target Timers. client # [ 749.668572] systemd[2771]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 749.670297] systemd[2771]: Closed D-Bus User Message Bus Socket. client # [ 749.671728] systemd[2771]: Stopped Create User Files and Directories. client # [ 749.674327] systemd[2771]: Removed slice User Application Slice. client # [ 749.675819] systemd[2771]: Reached target Shutdown. client # [ 749.677172] systemd[2771]: Finished Exit the Session. client # [ 749.678420] systemd[2771]: Reached target Exit the Session. client # [ 749.701759] systemd-logind[427]: Removed session 118. client # [ 749.709304] systemd[1]: user@0.service: Deactivated successfully. client # [ 749.714482] systemd[1]: Stopped User Manager for UID 0. client # [ 749.776211] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 749.822986] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 749.828939] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 749.832727] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 754.323516] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 754.331582] systemd[1]: Started SSH per-connection Daemon (vsock:2:59). lb # [ 754.429973] sshd-session[2322]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 754.440141] sshd-session[2322]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 754.448901] sshd-session[2322]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 754.476579] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 754.507930] systemd-logind[499]: New session '81' of user 'root' with class 'user' and type 'tty'. lb # [ 754.520740] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 754.528197] systemd[1]: Starting User Manager for UID 0... lb # [ 754.558984] (systemd)[2331]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 754.566252] systemd-logind[499]: New session '82' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 754.661237] systemd[2331]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 754.761663] systemd[2331]: Queued start job for default target Main User Target. lb # [ 754.769049] systemd[2331]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 754.771953] systemd[2331]: Created slice User Application Slice. lb # [ 754.774649] systemd[2331]: Started Daily Cleanup of User's Temporary Directories. lb # [ 754.775787] systemd[2331]: Reached target Paths. lb # [ 754.776899] systemd[2331]: Reached target Timers. lb # [ 754.779211] systemd[2331]: Starting D-Bus User Message Bus Socket... lb # [ 754.781677] systemd[2331]: Starting Create User Files and Directories... lb # [ 754.825305] systemd[2331]: Finished Create User Files and Directories. lb # [ 754.828623] systemd[2331]: Listening on D-Bus User Message Bus Socket. lb # [ 754.829708] systemd[2331]: Reached target Sockets. lb # [ 754.830439] systemd[2331]: Reached target Basic System. lb # [ 754.831246] systemd[2331]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 754.839563] systemd[2331]: Reached target Main User Target. lb # [ 754.842738] systemd[2331]: Startup finished in 245ms. lb # [ 754.843587] systemd[1]: Started User Manager for UID 0. lb # [ 754.845367] systemd[1]: Started Session 81 of User root. lb # [ 754.873763] sshd-session[2344]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 754.876320] sshd-session[2344]: Disconnected from user root UNKNOWN port 65535 lb # [ 754.878224] sshd-session[2322]: pam_unix(sshd:session): session closed for user root lb # [ 754.883587] systemd[1]: sshd-vsock@59-60-4:22-2:59.service: Deactivated successfully. lb # [ 754.887775] systemd[1]: session-81.scope: Deactivated successfully. lb # [ 754.889083] systemd[1]: session-81.scope: Consumed 26ms CPU time over 50ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 754.895181] systemd-logind[499]: Session 81 logged out. Waiting for processes to exit. lb # [ 754.897355] systemd-logind[499]: Removed session 81. worker1 # [ 757.789920] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 757.797307] systemd[3787]: Activating special unit Exit the Session... worker1 # [ 757.805053] systemd[3787]: Stopped target Main User Target. worker1 # [ 757.806590] systemd[3787]: Stopped target Basic System. worker1 # [ 757.807989] systemd[3787]: Stopped target Paths. worker1 # [ 757.811382] systemd[3787]: Stopped target Sockets. worker1 # [ 757.813983] systemd[3787]: Stopped target Timers. worker1 # [ 757.815175] systemd[3787]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 757.817110] systemd[3787]: Closed D-Bus User Message Bus Socket. worker1 # [ 757.818542] systemd[3787]: Stopped Create User Files and Directories. worker1 # [ 757.820470] systemd[3787]: Removed slice User Application Slice. worker1 # [ 757.821879] systemd[3787]: Reached target Shutdown. worker1 # [ 757.823091] systemd[3787]: Finished Exit the Session. worker1 # [ 757.824549] systemd[3787]: Reached target Exit the Session. worker1 # [ 757.833847] systemd-logind[539]: Removed session 138. worker1 # [ 757.841336] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 757.847086] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 757.857992] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 757.895569] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 757.900753] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 757.904506] systemd[1]: Stopped User Runtime Directory /run/user/0. [e2e] heartbeat t=660s worker2 # [ 758.082986] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 758.090037] systemd[3106]: Activating special unit Exit the Session... worker2 # [ 758.091239] systemd[3106]: Stopped target Main User Target. worker2 # [ 758.097616] systemd[3106]: Stopped target Basic System. worker2 # [ 758.098517] systemd[3106]: Stopped target Paths. worker2 # [ 758.099244] systemd[3106]: Stopped target Sockets. worker2 # [ 758.100000] systemd[3106]: Stopped target Timers. worker2 # [ 758.102381] systemd[3106]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 758.103483] systemd[3106]: Closed D-Bus User Message Bus Socket. worker2 # [ 758.108348] systemd[3106]: Stopped Create User Files and Directories. worker2 # [ 758.109424] systemd[3106]: Removed slice User Application Slice. worker2 # [ 758.110327] systemd[3106]: Reached target Shutdown. worker2 # [ 758.111091] systemd[3106]: Finished Exit the Session. worker2 # [ 758.111850] systemd[3106]: Reached target Exit the Session. worker2 # [ 758.144685] systemd-logind[515]: Removed session 99. worker2 # [ 758.145690] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 758.146643] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 758.160186] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 758.268272] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 758.269390] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 758.274943] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 760.005499] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 760.009833] systemd[1]: Started SSH per-connection Daemon (vsock:2:85). worker2 # [ 760.159246] sshd-session[3214]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 760.168264] sshd-session[3214]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 760.185093] sshd-session[3214]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 760.256521] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 760.285318] systemd-logind[515]: New session '105' of user 'root' with class 'user' and type 'tty'. worker2 # [ 760.340183] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 760.349597] systemd[1]: Starting User Manager for UID 0... worker2 # [ 760.494537] (systemd)[3222]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 760.506263] systemd-logind[515]: New session '106' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 760.818206] systemd[3222]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 765.055417] systemd[1]: Stopping User Manager for UID 0... lb # [ 765.063895] systemd[2331]: Activating special unit Exit the Session... worker2 # [ 762.217109] systemd[3222]: Queued start job for default target Main User Target. lb # [ 765.070033] systemd[2331]: Stopped target Main User Target. lb # [ 765.071434] systemd[2331]: Stopped target Basic System. lb # [ 765.075815] systemd[2331]: Stopped target Paths. lb # [ 765.077083] systemd[2331]: Stopped target Sockets. worker2 # [ 762.223396] systemd[3222]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 765.078229] systemd[2331]: Stopped target Timers. lb # [ 765.079328] systemd[2331]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 765.081342] systemd[2331]: Closed D-Bus User Message Bus Socket. lb # [ 765.082724] systemd[2331]: Stopped Create User Files and Directories. lb # [ 765.084424] systemd[2331]: Removed slice User Application Slice. lb # [ 765.085822] systemd[2331]: Reached target Shutdown. lb # [ 765.086995] systemd[2331]: Finished Exit the Session. lb # [ 765.088249] systemd[2331]: Reached target Exit the Session. worker2 # [ 762.236348] systemd[3222]: Created slice User Application Slice. worker2 # [ 762.237483] systemd[3222]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 762.238571] systemd[3222]: Reached target Paths. worker2 # [ 762.239284] systemd[3222]: Reached target Timers. lb # [ 765.097603] systemd-logind[499]: Removed session 82. worker2 # [ 762.240001] systemd[3222]: Starting D-Bus User Message Bus Socket... lb # [ 765.104859] systemd[1]: user@0.service: Deactivated successfully. lb # [ 765.108091] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 762.255789] systemd[3222]: Starting Create User Files and Directories... worker2 # [ 762.300758] systemd[3222]: Finished Create User Files and Directories. worker2 # [ 762.302147] systemd[3222]: Listening on D-Bus User Message Bus Socket. worker2 # [ 762.303163] systemd[3222]: Reached target Sockets. worker2 # [ 762.307673] systemd[3222]: Reached target Basic System. worker2 # [ 762.318367] systemd[3222]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 762.319961] systemd[3222]: Reached target Main User Target. lb # [ 765.170991] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 762.325271] systemd[3222]: Startup finished in 1.673s. worker2 # [ 762.326451] systemd[1]: Started User Manager for UID 0. worker2 # [ 762.327267] systemd[1]: Started Session 105 of User root. lb # [ 765.209023] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 765.213978] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 765.217862] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 762.452082] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1487 (nix-grpc-daemon) on client request. worker2 # [ 762.453943] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. worker2 # [ 762.480166] sshd-session[3235]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 762.481691] sshd-session[3235]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 762.483339] sshd-session[3214]: pam_unix(sshd:session): session closed for user root lb # [ 765.336359] niks3-server[1454]: 2026/11/12 09:31:07 INFO lead: released remote=192.168.1.4:54848 client # [ 764.038934] nix[2788]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker1 # [ 764.043115] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:07Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" lb # [ 765.342553] envoy[897]: [2026-11-12 09:31:07.101][897][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 13, upstream_reset_after_response_started{connection_termination} client # [ 764.042857] nix[2788]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 762.494960] systemd[1]: sshd-vsock@85-86-6:22-2:85.service: Deactivated successfully. lb # [ 765.347830] envoy[897]: [2026-11-12 09:31:07.101][897][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 13, upstream_reset_after_response_started{connection_termination} worker2 # [ 762.505873] systemd[1]: session-105.scope: Deactivated successfully. worker2 # [ 762.507213] systemd-logind[515]: Session 105 logged out. Waiting for processes to exit. worker2 # [ 762.517959] systemd-logind[515]: Removed session 105. worker2 # [ 762.518819] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 762.524521] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 762.526025] systemd[1]: nix-grpc-daemon.service: Consumed 6.292s CPU time over 10min 7.084s wall clock time, 71.7M memory peak, 993.6K incoming IP traffic, 1M outgoing IP traffic. worker2 # [ 762.650082] nix-daemon[976]: reaped child process 1721, status = succeeded worker2 # [ 762.652747] nix-daemon[976]: reaped child process 2270, status = succeeded worker2 # [ 762.653864] nix-daemon[976]: reaped child process 2353, status = succeeded worker2 # [ 762.654827] nix-daemon[976]: reaped child process 2464, status = succeeded worker2 # [ 762.655788] nix-daemon[976]: reaped child process 2651, status = succeeded worker2 # [ 762.658628] nix-daemon[976]: reaped child process 2903, status = succeeded worker2 # [ 762.659692] nix-daemon[976]: reaped child process 3149, status = succeeded worker2 # [ 762.661397] nix-daemon[976]: reaped child process 3159, status = succeeded worker2 # [ 762.662564] nix-daemon[976]: reaped child process 1605, status = succeeded worker2 # [ 762.664326] nix-daemon[976]: reaped child process 1823, status = succeeded worker2 # [ 762.665890] nix-daemon[976]: reaped child process 1863, status = succeeded worker2 # [ 762.667025] nix-daemon[976]: reaped child process 1937, status = succeeded worker2 # [ 762.668542] nix-daemon[976]: reaped child process 2024, status = succeeded worker2 # [ 762.669519] nix-daemon[976]: reaped child process 2184, status = succeeded worker2 # [ 762.670534] nix-daemon[976]: reaped child process 3009, status = succeeded worker2 # [ 762.676558] nix-daemon[3161]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 762.684750] nix-daemon[976]: reaped child process 3161, status = failed with exit code 1 worker1 # [ 764.243574] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 764.261531] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:08Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. retried and the latest reset reason: remote connection failure" worker2 # [ 762.831782] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 2. worker2 # [ 762.840539] systemd[1]: Starting scheduler-token.service... worker2 # [ 762.902243] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 762.906979] systemd[1]: Finished scheduler-token.service. worker1 # [ 764.462634] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 762.912319] systemd[1]: scheduler-token.service: Consumed 41ms CPU time over 65ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 762.917746] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 764.515677] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:08Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. retried and the latest reset reason: remote connection failure" client # [ 764.577833] nix[2788]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. retried and the latest reset reason: remote connection failure, reconnecting worker2 # [ 763.047839] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:08Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 763.050709] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:08Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 763.055276] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:08Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 765.924280] niks3-server[1454]: 2026/11/12 09:31:07 INFO lead: acquired remote=192.168.1.4:52084 worker2 # [ 763.084172] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:08Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 763.086380] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 763.119059] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 763.129573] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 764.716802] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 764.720305] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 763.330861] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 763.335775] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 764.921106] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 764.924769] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" lb # [ 766.333384] envoy[897]: conn peer=[2001:db8:1::4]:51806 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=96292 tx=6751 ms=606599 worker2 # [ 763.536922] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 763.541648] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 765.126200] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 765.129668] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 763.742759] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 763.747794] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 765.330292] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 765.333865] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 763.949204] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 763.954002] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 765.534674] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 765.538342] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" client # [ 765.580679] nix[2788]: scheduler at lb:50051: no healthy upstream, reconnecting worker2 # [ 764.156531] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 764.159205] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 765.739098] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 765.742448] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 764.357512] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 764.360858] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 765.943252] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 765.946861] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 764.562030] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 764.565469] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 766.149070] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 766.151443] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 764.766447] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 764.769811] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 766.349550] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 766.353255] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 764.970747] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 764.974450] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 766.554018] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 766.557986] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 765.120490] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 765.129688] systemd[1]: Started SSH per-connection Daemon (vsock:2:86). worker2 # [ 765.177972] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 765.184297] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 766.758745] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 766.762176] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 765.232910] sshd-session[3299]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 765.241166] sshd-session[3299]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 765.252120] sshd-session[3299]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 765.261663] systemd-logind[515]: New session '107' of user 'root' with class 'user' and type 'tty'. worker2 # [ 765.269956] systemd[1]: Started Session 107 of User root. worker2 # [ 765.300737] systemd[1]: Starting scheduler-token.service... worker2 # [ 765.344775] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 765.347777] systemd[1]: Finished scheduler-token.service. worker2 # [ 765.351497] systemd[1]: scheduler-token.service: Consumed 28ms CPU time over 46ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 765.356787] sshd-session[3305]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 765.358691] sshd-session[3305]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 765.360680] sshd-session[3299]: pam_unix(sshd:session): session closed for user root worker2 # [ 765.364226] systemd[1]: sshd-vsock@86-87-6:22-2:86.service: Deactivated successfully. worker2 # [ 765.369741] systemd[1]: session-107.scope: Deactivated successfully. worker2 # [ 765.374152] systemd-logind[515]: Session 107 logged out. Waiting for processes to exit. worker2 # [ 765.376950] systemd-logind[515]: Removed session 107. worker2 # [ 765.379025] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 765.381415] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 766.962871] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 766.966314] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 765.582357] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 765.585627] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 767.168235] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 767.178639] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 765.786707] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 765.790157] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 767.379737] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 767.383461] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 765.991183] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 765.994879] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 767.584243] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:11Z level=info event=scheduler_connected addr=lb:50051 client # [ 767.582382] nix[2788]: scheduler at lb:50051: no healthy upstream, reconnecting worker1 # [ 767.587744] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 766.197248] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 766.199675] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 767.788469] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 767.792468] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 766.398337] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 766.401798] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 767.992959] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 767.996490] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 766.602809] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 766.606292] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 768.198035] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 768.201293] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 766.807442] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 766.811214] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 768.399679] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 768.403328] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 767.012632] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 767.016273] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 768.604135] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 768.607744] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 767.217974] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 767.221089] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 768.808484] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 768.811808] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 767.419447] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 767.422937] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 769.012599] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 769.016123] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 767.623932] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 767.627713] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 769.218487] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 769.221559] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 767.828674] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 767.831999] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 769.418994] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 769.422383] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 768.032723] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 768.035938] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 769.623305] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 769.626673] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 768.238098] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 768.240536] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 769.827352] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 769.830832] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 768.439103] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 768.442455] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 770.031657] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 770.035050] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 768.643443] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 768.646894] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 770.236601] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 770.239737] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 768.847932] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 768.851391] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 770.440807] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 770.444279] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 769.052132] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 769.055561] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 770.644970] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 770.648475] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 769.258157] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 769.260746] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 770.849091] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 770.852592] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 769.458827] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 769.462239] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 771.053234] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 771.056616] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 769.663129] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 769.666653] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 771.258678] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 771.261339] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 769.867460] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 769.871102] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 771.459699] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 771.463138] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 771.584673] nix[2788]: scheduler at lb:50051: no healthy upstream, reconnecting worker2 # [ 770.072067] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 770.075583] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 771.663874] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 771.667361] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 770.277382] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 770.280575] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 771.868107] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 771.871425] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 770.481552] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 770.485030] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 772.072082] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 772.075554] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 770.686075] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 770.689507] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 772.277870] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 772.280678] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 770.890376] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 770.893904] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 772.478818] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 772.482178] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 771.094884] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 771.098655] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 772.682987] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 772.686499] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 771.300602] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 771.303726] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 772.887247] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 772.890603] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 771.505099] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 771.508585] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 773.071505] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 773.080299] systemd[1]: Started SSH per-connection Daemon (vsock:2:126). worker1 # [ 773.091351] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 773.095229] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 773.182312] sshd-session[3929]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 773.192184] sshd-session[3929]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 773.201035] sshd-session[3929]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 773.220966] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 773.229783] systemd-logind[539]: New session '144' of user 'root' with class 'user' and type 'tty'. worker1 # [ 773.255859] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 773.262810] systemd[1]: Starting User Manager for UID 0... worker2 # [ 771.709739] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 771.713414] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 773.289939] (systemd)[3937]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 773.295960] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 773.300365] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 773.302135] systemd-logind[539]: New session '145' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 773.387429] systemd[3937]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 771.914465] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 771.918155] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 773.488266] systemd[3937]: Queued start job for default target Main User Target. worker1 # [ 773.497028] systemd[3937]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 773.499504] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 773.501636] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 773.505891] systemd[3937]: Created slice User Application Slice. worker1 # [ 773.506942] systemd[3937]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 773.507981] systemd[3937]: Reached target Paths. worker1 # [ 773.512826] systemd[3937]: Reached target Timers. worker1 # [ 773.513614] systemd[3937]: Starting D-Bus User Message Bus Socket... worker1 # [ 773.516611] systemd[3937]: Starting Create User Files and Directories... worker1 # [ 773.559614] systemd[3937]: Finished Create User Files and Directories. worker1 # [ 773.564609] systemd[3937]: Listening on D-Bus User Message Bus Socket. worker1 # [ 773.565666] systemd[3937]: Reached target Sockets. worker1 # [ 773.571225] systemd[3937]: Reached target Basic System. worker1 # [ 773.572267] systemd[3937]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 773.573677] systemd[3937]: Reached target Main User Target. worker1 # [ 773.574472] systemd[3937]: Startup finished in 250ms. worker1 # [ 773.575230] systemd[1]: Started User Manager for UID 0. worker1 # [ 773.576576] systemd[1]: Started Session 144 of User root. worker1 # [ 773.609182] sshd-session[3950]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 773.612668] sshd-session[3950]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 773.613834] sshd-session[3929]: pam_unix(sshd:session): session closed for user root worker1 # [ 773.617725] systemd[1]: sshd-vsock@126-127-5:22-2:126.service: Deactivated successfully. worker1 # [ 773.622903] systemd[1]: session-144.scope: Deactivated successfully. worker1 # [ 773.627360] systemd-logind[539]: Session 144 logged out. Waiting for processes to exit. worker1 # [ 773.630283] systemd-logind[539]: Removed session 144. worker2 # [ 772.119105] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 772.122857] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 773.702459] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 773.705784] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 772.324461] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 772.328612] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 773.906481] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 773.909818] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 772.529628] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 772.533197] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 774.110321] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 774.113482] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 772.734289] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 772.737788] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 774.315709] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 774.318309] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 772.938560] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 772.942254] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 774.516628] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 774.520072] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 773.071722] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:18Z level=info event=scheduler_take_over worker2 # [ 773.143219] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 773.146992] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 774.720936] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 774.724458] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 773.350026] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 773.352639] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 774.925008] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 774.928448] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 773.551144] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 773.555055] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 775.129119] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 775.132449] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 773.756313] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 773.760140] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 775.333989] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 775.337403] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 773.960859] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 773.964634] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 775.537998] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 775.541338] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 774.048816] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:19Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 client # [ 775.600985] nix[2788]: warning: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {}, the workers offer {}, waiting up to 120s for a worker worker2 # [ 774.165584] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 774.173847] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:19Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 774.177146] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:19Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:54932 worker2 # [ 774.185772] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:19Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux,riscv64-linux max_jobs=1 running=0 worker1 # [ 775.742082] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 774.197042] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:19Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 774.205386] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54948 worker2 # [ 774.216508] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:19Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:54932 worker2 # [ 774.219358] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:19Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 774.229230] nix-daemon[976]: accepted connection from pid 3247, user nix-grpc-daemon (trusted) worker2 # [ 774.231313] nix-daemon[976]: accepted connection from pid 3247, user nix-grpc-daemon (trusted) worker2 # [ 774.241237] nix-daemon[976]: accepted connection from pid 3247, user nix-grpc-daemon (trusted) client # [ 775.802228] nix[2788]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker2 # [ 774.256206] nix-daemon[976]: accepted connection from pid 3247, user nix-grpc-daemon (trusted) worker2 # [ 774.577834] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 774.588691] systemd[1]: Started SSH per-connection Daemon (vsock:2:87). worker2 # [ 774.689283] sshd-session[3330]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 774.697651] sshd-session[3330]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 774.708782] sshd-session[3330]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 774.720535] systemd-logind[515]: New session '108' of user 'root' with class 'user' and type 'tty'. worker2 # [ 774.729423] systemd[1]: Started Session 108 of User root. worker2 # [ 774.766424] sshd-session[3336]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 774.768431] sshd-session[3336]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 774.769933] sshd-session[3330]: pam_unix(sshd:session): session closed for user root worker2 # [ 774.774667] systemd[1]: sshd-vsock@87-88-6:22-2:87.service: Deactivated successfully. worker2 # [ 774.780308] systemd[1]: session-108.scope: Deactivated successfully. worker2 # [ 774.785419] systemd-logind[515]: Session 108 logged out. Waiting for processes to exit. worker2 # [ 774.787895] systemd-logind[515]: Removed session 108. lb # [ 777.938472] garage[898]: 2026-11-12T09:31:19.697049Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo worker2 # [ 775.224528] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:20Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:54964 lb # [ 777.943775] garage[898]: 2026-11-12T09:31:19.697512Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 779.451643] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 779.461549] systemd[1]: Started SSH per-connection Daemon (vsock:2:127). worker1 # [ 779.560639] sshd-session[3955]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 779.568276] sshd-session[3955]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 779.581209] sshd-session[3955]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 779.592820] systemd-logind[539]: New session '146' of user 'root' with class 'user' and type 'tty'. worker1 # [ 779.599151] systemd[1]: Started Session 146 of User root. worker1 # [ 779.635191] sshd-session[3961]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 779.639027] sshd-session[3961]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 779.640583] sshd-session[3955]: pam_unix(sshd:session): session closed for user root worker1 # [ 779.644371] systemd[1]: sshd-vsock@127-128-5:22-2:127.service: Deactivated successfully. worker1 # [ 779.650002] systemd[1]: session-146.scope: Deactivated successfully. worker1 # [ 779.655137] systemd-logind[539]: Session 146 logged out. Waiting for processes to exit. worker1 # [ 779.658115] systemd-logind[539]: Removed session 146. worker2 # [ 780.435674] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 780.438911] systemd[1]: Started SSH per-connection Daemon (vsock:2:88). worker2 # [ 780.569060] sshd-session[3350]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 780.579444] sshd-session[3350]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 780.596483] sshd-session[3350]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 780.609953] systemd-logind[515]: New session '109' of user 'root' with class 'user' and type 'tty'. worker2 # [ 780.618690] systemd[1]: Started Session 109 of User root. worker2 # [ 780.828575] sshd-session[3356]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 780.830165] sshd-session[3356]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 780.833852] sshd-session[3350]: pam_unix(sshd:session): session closed for user root worker2 # [ 780.838638] systemd[1]: sshd-vsock@88-89-6:22-2:88.service: Deactivated successfully. worker2 # [ 780.845718] systemd[1]: session-109.scope: Deactivated successfully. worker2 # [ 780.851551] systemd-logind[515]: Session 109 logged out. Waiting for processes to exit. worker2 # [ 780.854332] systemd-logind[515]: Removed session 109. worker2 # [ 780.880632] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:26Z level=info event=niks3_push_started pid=3362 worker2 # [ 780.946838] nix-daemon[976]: reaped child process 3323, status = succeeded worker2 # [ 781.034281] nix-grpc-daemon[3362]: time=2026-11-12T09:31:26.306Z level=INFO msg="Configuring client TLS" cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker2.pem key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker2.key ca="" worker2 # [ 781.156113] nix-daemon[976]: accepted connection from pid 3374, user nix-grpc-daemon (trusted) lb # [ 784.034136] niks3-server[1454]: 2026/11/12 09:31:25 INFO Received push request method=POST path=/api/pushes worker2 # [ 781.184314] nix-daemon[976]: reaped child process 3377, status = succeeded worker2 # [ 781.188222] nix-grpc-daemon[3362]: time=2026-11-12T09:31:26.461Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 781.189866] nix-grpc-daemon[3362]: time=2026-11-12T09:31:26.461Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 784.052377] garage[898]: 2026-11-12T09:31:25.811661Z INFO garage_api_common::generic_server: 192.168.1.4:56120 PUT /farm/log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fa1c304f09dc41921ed14c7a6948b9bfc985f81aac1686d3b1d3cb5c6e79736d worker2 # [ 781.217602] nix-grpc-daemon[3362]: time=2026-11-12T09:31:26.489Z level=INFO msg="Uploading 1 narinfos" lb # [ 784.077763] garage[898]: 2026-11-12T09:31:25.821751Z INFO garage_api_common::generic_server: 192.168.1.4:56106 PUT /farm/fk2vdwmn2msb3ja19s2jwak35ignz889.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f81ef8587386086749468868f44c54f6ab7fab575484fbc586e95792caf6ce3e lb # [ 784.093879] garage[898]: 2026-11-12T09:31:25.822171Z INFO garage_api_common::generic_server: 192.168.1.4:56110 PUT /farm/nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cbd6e188053216926bd6e2e25b1b07c40a163c015c26411a282262f2677ac5c5 worker2 # [ 781.250831] nix-grpc-daemon[3362]: time=2026-11-12T09:31:26.523Z level=INFO msg="Upload complete. (212ms)" lb # [ 784.112437] garage[898]: 2026-11-12T09:31:25.826948Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker2 # [ 781.262289] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54948 duration_s=7 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 784.120522] garage[898]: 2026-11-12T09:31:25.828289Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst worker2 # [ 781.274188] nix-daemon[976]: reaped child process 3321, status = succeeded lb # [ 784.125918] garage[898]: 2026-11-12T09:31:25.831307Z INFO garage_api_common::generic_server: 192.168.1.4:56110 PUT /farm/fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9a348ac17a3882b845cac6e59e0477334b2e0953e1283651c30b10d8c46872d6 lb # [ 784.133816] garage[898]: 2026-11-12T09:31:25.836009Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/fk2vdwmn2msb3ja19s2jwak35ignz889.ls lb # [ 784.137285] niks3-server[1454]: 2026/11/12 09:31:25 INFO Received sign narinfos request method=POST path=/api/pushes/81/sign lb # [ 784.139230] niks3-server[1454]: 2026/11/12 09:31:25 INFO Signed narinfos id=81 count=1 lb # [ 784.140687] niks3-server[1454]: 2026/11/12 09:31:25 INFO Received complete push request method=POST path=/api/pushes/81/complete lb # [ 784.142633] niks3-server[1454]: 2026/11/12 09:31:25 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 784.144852] niks3-server[1454]: 2026/11/12 09:31:25 INFO Completed push id=81 objects=4 duration=30.05752ms lb # [ 784.146688] niks3-server[1454]: 2026/11/12 09:31:25 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo lb # [ 784.148790] niks3-server[1454]: 2026/11/12 09:31:25 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls client # [ 782.846362] systemd[1]: mid.service: Deactivated successfully. lb # [ 784.150814] niks3-server[1454]: 2026/11/12 09:31:25 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 784.153402] garage[898]: 2026-11-12T09:31:25.851596Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo client # [ 782.849926] systemd[1]: mid.service: Consumed 207ms CPU time over 43.358s wall clock time, 38.8M memory peak, 4K written to disk, 11.9K incoming IP traffic, 13.1K outgoing IP traffic. client # [ 783.747142] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 783.755139] systemd[1]: Started SSH per-connection Daemon (vsock:2:99). client # [ 783.850898] sshd-session[2809]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 783.859765] sshd-session[2809]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 783.871234] sshd-session[2809]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 783.888917] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 783.901640] systemd-logind[427]: New session '119' of user 'root' with class 'user' and type 'tty'. client # [ 783.933762] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 783.952287] systemd[1]: Starting User Manager for UID 0... client # [ 783.986904] (systemd)[2817]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 783.993884] systemd-logind[427]: New session '120' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 784.084867] systemd[2817]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 784.194432] systemd[2817]: Queued start job for default target Main User Target. client # [ 784.201097] systemd[2817]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 784.205635] systemd[2817]: Created slice User Application Slice. client # [ 784.206738] systemd[2817]: Started Daily Cleanup of User's Temporary Directories. client # [ 784.207855] systemd[2817]: Reached target Paths. client # [ 784.211624] systemd[2817]: Reached target Timers. client # [ 784.213454] systemd[2817]: Starting D-Bus User Message Bus Socket... client # [ 784.214467] systemd[2817]: Starting Create User Files and Directories... client # [ 784.263551] systemd[2817]: Finished Create User Files and Directories. client # [ 784.268994] systemd[2817]: Listening on D-Bus User Message Bus Socket. client # [ 784.271923] systemd[2817]: Reached target Sockets. client # [ 784.276300] systemd[2817]: Reached target Basic System. client # [ 784.277221] systemd[2817]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 784.278851] systemd[2817]: Reached target Main User Target. client # [ 784.279720] systemd[2817]: Startup finished in 260ms. client # [ 784.283796] systemd[1]: Started User Manager for UID 0. client # [ 784.285729] systemd[1]: Started Session 119 of User root. client # [ 784.319814] sshd-session[2831]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 784.323287] sshd-session[2831]: Disconnected from user root UNKNOWN port 65535 client # [ 784.325490] sshd-session[2809]: pam_unix(sshd:session): session closed for user root client # [ 784.329782] systemd[1]: sshd-vsock@99-100-3:22-2:99.service: Deactivated successfully. client # [ 784.335722] systemd[1]: session-119.scope: Deactivated successfully. client # [ 784.341961] systemd-logind[427]: Session 119 logged out. Waiting for processes to exit. client # [ 784.345557] systemd-logind[427]: Removed session 119. lb # [ 786.333184] envoy[897]: conn peer=[2001:db8:1::1]:46576 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4850 tx=2553 ms=43147 client # [ 786.485504] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 786.491294] systemd[1]: Started SSH per-connection Daemon (vsock:2:100). client # [ 786.575539] sshd-session[2837]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 786.584742] sshd-session[2837]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 786.592706] sshd-session[2837]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 786.601919] systemd-logind[427]: New session '121' of user 'root' with class 'user' and type 'tty'. client # [ 786.613401] systemd[1]: Started Session 121 of User root. client # [ 786.646153] sshd-session[2843]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 786.649396] sshd-session[2843]: Disconnected from user root UNKNOWN port 65535 client # [ 786.651555] sshd-session[2837]: pam_unix(sshd:session): session closed for user root client # [ 786.656175] systemd[1]: sshd-vsock@100-101-3:22-2:100.service: Deactivated successfully. client # [ 786.662858] systemd[1]: session-121.scope: Deactivated successfully. client # [ 786.667444] systemd-logind[427]: Session 121 logged out. Waiting for processes to exit. client # [ 786.671711] systemd-logind[427]: Removed session 121. ok test farm::serial::the_first_client_leaving_does_not_fail_the_second ... [e2e] heartbeat t=690s worker1 # [ 789.375505] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 789.384623] systemd[1]: Started SSH per-connection Daemon (vsock:2:128). worker1 # [ 789.492722] sshd-session[3966]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 789.503398] sshd-session[3966]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 789.512793] sshd-session[3966]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 789.525365] systemd-logind[539]: New session '147' of user 'root' with class 'user' and type 'tty'. worker1 # [ 789.529185] systemd[1]: Started Session 147 of User root. worker1 # [ 789.565028] sshd-session[3972]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 789.568242] sshd-session[3972]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 789.569677] sshd-session[3966]: pam_unix(sshd:session): session closed for user root worker1 # [ 789.574397] systemd[1]: sshd-vsock@128-129-5:22-2:128.service: Deactivated successfully. worker1 # [ 789.580901] systemd[1]: session-147.scope: Deactivated successfully. worker1 # [ 789.586302] systemd-logind[539]: Session 147 logged out. Waiting for processes to exit. worker1 # [ 789.589409] systemd-logind[539]: Removed session 147. worker2 # [ 789.315255] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 789.324846] systemd[1]: Started SSH per-connection Daemon (vsock:2:89). worker2 # [ 789.422241] sshd-session[3384]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 789.431561] sshd-session[3384]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 789.442359] sshd-session[3384]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 789.451816] systemd-logind[515]: New session '110' of user 'root' with class 'user' and type 'tty'. worker2 # [ 789.458870] systemd[1]: Started Session 110 of User root. worker2 # [ 789.489733] sshd-session[3390]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 789.492510] sshd-session[3390]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 789.494547] sshd-session[3384]: pam_unix(sshd:session): session closed for user root worker2 # [ 789.498288] systemd[1]: sshd-vsock@89-90-6:22-2:89.service: Deactivated successfully. worker2 # [ 789.503928] systemd[1]: session-110.scope: Deactivated successfully. worker2 # [ 789.508932] systemd-logind[515]: Session 110 logged out. Waiting for processes to exit. worker2 # [ 789.510808] systemd-logind[515]: Removed session 110. lb # [ 793.055899] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 793.060258] systemd[1]: Started SSH per-connection Daemon (vsock:2:60). lb # [ 793.168354] sshd-session[2361]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 793.175774] sshd-session[2361]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 793.186155] sshd-session[2361]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 793.216114] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 793.255132] systemd-logind[499]: New session '83' of user 'root' with class 'user' and type 'tty'. lb # [ 793.266817] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 793.273902] systemd[1]: Starting User Manager for UID 0... lb # [ 793.301878] (systemd)[2370]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 793.308471] systemd-logind[499]: New session '84' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 793.397835] systemd[2370]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 793.497994] systemd[2370]: Queued start job for default target Main User Target. lb # [ 793.501944] systemd[2370]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 793.503667] systemd[2370]: Created slice User Application Slice. lb # [ 793.508260] systemd[2370]: Started Daily Cleanup of User's Temporary Directories. lb # [ 793.509391] systemd[2370]: Reached target Paths. lb # [ 793.512518] systemd[2370]: Reached target Timers. lb # [ 793.513296] systemd[2370]: Starting D-Bus User Message Bus Socket... lb # [ 793.514210] systemd[2370]: Starting Create User Files and Directories... lb # [ 793.556150] systemd[2370]: Finished Create User Files and Directories. lb # [ 793.561184] systemd[2370]: Listening on D-Bus User Message Bus Socket. lb # [ 793.562272] systemd[2370]: Reached target Sockets. lb # [ 793.562987] systemd[2370]: Reached target Basic System. lb # [ 793.563774] systemd[2370]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 793.568419] systemd[2370]: Reached target Main User Target. lb # [ 793.569289] systemd[2370]: Startup finished in 234ms. lb # [ 793.570040] systemd[1]: Started User Manager for UID 0. lb # [ 793.570847] systemd[1]: Started Session 83 of User root. lb # [ 793.601500] sshd-session[2383]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 793.603905] sshd-session[2383]: Disconnected from user root UNKNOWN port 65535 lb # [ 793.606017] sshd-session[2361]: pam_unix(sshd:session): session closed for user root lb # [ 793.609884] systemd[1]: sshd-vsock@60-61-4:22-2:60.service: Deactivated successfully. lb # [ 793.614470] systemd[1]: session-83.scope: Deactivated successfully. lb # [ 793.618156] systemd[1]: session-83.scope: Consumed 25ms CPU time over 49ms wall clock time, 2.9M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 793.621174] systemd-logind[499]: Session 83 logged out. Waiting for processes to exit. lb # [ 793.623202] systemd-logind[499]: Removed session 83. worker2 # [ 791.160543] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 791.164553] systemd[1]: Started SSH per-connection Daemon (vsock:2:90). worker2 # [ 791.265680] sshd-session[3396]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 791.274584] sshd-session[3396]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 791.285443] sshd-session[3396]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 791.297166] systemd-logind[515]: New session '111' of user 'root' with class 'user' and type 'tty'. worker2 # [ 791.305526] systemd[1]: Started Session 111 of User root. worker2 # [ 791.343727] sshd-session[3402]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 791.345858] sshd-session[3402]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 791.347370] sshd-session[3396]: pam_unix(sshd:session): session closed for user root worker2 # [ 791.351863] systemd[1]: sshd-vsock@90-91-6:22-2:90.service: Deactivated successfully. worker2 # [ 791.357548] systemd[1]: session-111.scope: Deactivated successfully. worker2 # [ 791.359737] systemd[1]: session-111.scope: Consumed 29ms CPU time over 54ms wall clock time, 3.1M memory peak, 13.8K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 791.367358] systemd-logind[515]: Session 111 logged out. Waiting for processes to exit. worker2 # [ 791.369170] systemd-logind[515]: Removed session 111. client # [ 794.070586] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 794.079427] systemd[1]: Started SSH per-connection Daemon (vsock:2:101). client # [ 794.177095] sshd-session[2848]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 794.186690] sshd-session[2848]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 794.195380] sshd-session[2848]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 794.207667] systemd-logind[427]: New session '122' of user 'root' with class 'user' and type 'tty'. client # [ 794.212577] systemd[1]: Started Session 122 of User root. client # [ 794.241811] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.pem&client-key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.key" --eval-store auto -f /nix/store/v7sckhacjvxxq8xv667z4hgvbaqhw2dd-slow.nix --argstr tag share. client # [ 794.256884] sshd-session[2854]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 794.258275] sshd-session[2854]: Disconnected from user root UNKNOWN port 65535 client # [ 794.259413] sshd-session[2848]: pam_unix(sshd:session): session closed for user root client # [ 794.263554] systemd[1]: sshd-vsock@101-102-3:22-2:101.service: Deactivated successfully. client # [ 794.273951] systemd[1]: session-122.scope: Deactivated successfully. client # [ 794.281526] systemd-logind[427]: Session 122 logged out. Waiting for processes to exit. client # [ 794.286941] systemd-logind[427]: Removed session 122. client # [ 794.440540] nix[2857]: don't know how to build these paths: worker1 # [ 794.443382] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50846 client # [ 794.441910] nix[2857]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker2 # [ 792.893416] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54948 worker2 # [ 792.904240] nix-grpc-daemon[3247]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 47 ms (attempt 1/5) worker2 # [ 792.957258] nix-grpc-daemon[3247]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 2/5) worker2 # [ 793.042690] nix-grpc-daemon[3247]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 244 ms (attempt 3/5) worker2 # [ 793.288489] nix-grpc-daemon[3247]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 315 ms (attempt 4/5) worker2 # [ 793.605735] nix-grpc-daemon[3247]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 793.609879] nix-grpc-daemon[3247]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 796.470636] garage[898]: 2026-11-12T09:31:38.229010Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/fjww0fd4rwk1s35jav3cyal62l24n356.narinfo lb # [ 796.470831] garage[898]: 2026-11-12T09:31:38.229471Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 795.183528] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50846 lb # [ 796.488341] garage[898]: 2026-11-12T09:31:38.247729Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/fjww0fd4rwk1s35jav3cyal62l24n356.narinfo lb # [ 796.493174] garage[898]: 2026-11-12T09:31:38.248224Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 796.498284] garage[898]: 2026-11-12T09:31:38.257172Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/fjww0fd4rwk1s35jav3cyal62l24n356.narinfo lb # [ 796.503519] garage[898]: 2026-11-12T09:31:38.257576Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 793.656917] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54948 lb # [ 796.515623] garage[898]: 2026-11-12T09:31:38.275091Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo lb # [ 796.520928] garage[898]: 2026-11-12T09:31:38.275515Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 795.224201] nix[2857]: copying 1 paths to 'lb:50051'... worker2 # [ 793.674409] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54948 client # [ 795.224567] nix[2857]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' to 'lb:50051'... worker2 # [ 793.685799] nix-daemon[976]: accepted connection from pid 3247, user nix-grpc-daemon (trusted) worker2 # [ 793.704214] nix-daemon[976]: accepted connection from pid 3247, user nix-grpc-daemon (trusted) worker2 # [ 793.847683] nix-daemon[976]: accepted connection from pid 3415, user nix-grpc-daemon (trusted) lb # [ 796.726020] niks3-server[1454]: 2026/11/12 09:31:38 INFO Received push request method=POST path=/api/pushes worker2 # [ 793.877297] nix-daemon[976]: reaped child process 3418, status = succeeded worker2 # [ 793.880549] nix-grpc-daemon[3362]: time=2026-11-12T09:31:39.152Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 793.882261] nix-grpc-daemon[3362]: time=2026-11-12T09:31:39.152Z level=INFO msg="Uploading rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv (432B)" lb # [ 796.739617] garage[898]: 2026-11-12T09:31:38.498520Z INFO garage_api_common::generic_server: 192.168.1.4:56110 PUT /farm/nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093138Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7a0761b7dc00efe8596b1060764501ccdb9706f6f7494bec156c5c07be13f356 worker2 # [ 793.902482] nix-grpc-daemon[3362]: time=2026-11-12T09:31:39.174Z level=INFO msg="Uploading 1 narinfos" worker2 # [ 793.911087] nix-grpc-daemon[3362]: time=2026-11-12T09:31:39.184Z level=INFO msg="Upload complete. (197ms)" worker2 # [ 793.916737] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54948 duration_s=0 paths=1 nar_bytes_in=432 lb # [ 796.765096] garage[898]: 2026-11-12T09:31:38.499219Z INFO garage_api_common::generic_server: 192.168.1.4:56106 PUT /farm/rxafkggp1xca5h7p0r6gwpq3qqp2kn63.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093138Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fe910c57718ea040a1c9eb604d33aa0c70b7185310a58f3a96d7fbb7aa27163b lb # [ 796.775874] garage[898]: 2026-11-12T09:31:38.512159Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/rxafkggp1xca5h7p0r6gwpq3qqp2kn63.ls worker2 # [ 793.927741] nix-daemon[976]: reaped child process 3411, status = succeeded lb # [ 796.781654] garage[898]: 2026-11-12T09:31:38.516409Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst lb # [ 796.787784] garage[898]: 2026-11-12T09:31:38.516968Z INFO garage_api_common::generic_server: 192.168.1.4:56106 PUT /farm/rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093138Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cf52982b7ca26aa936359a6639f338c144e5fc1d0d0c7e443380db005e86d6f1 worker2 # [ 793.944417] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:39Z level=debug event=want client=2 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=0 lb # [ 796.797853] garage[898]: 2026-11-12T09:31:38.523092Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo worker2 # [ 793.947706] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:39Z level=debug event=assigned drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker=192.168.1.3:50051 clients=1 lb # [ 796.802993] niks3-server[1454]: 2026/11/12 09:31:38 INFO Received sign narinfos request method=POST path=/api/pushes/82/sign lb # [ 796.806597] niks3-server[1454]: 2026/11/12 09:31:38 INFO Signed narinfos id=82 count=1 lb # [ 796.808403] niks3-server[1454]: 2026/11/12 09:31:38 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.ls worker1 # [ 795.508801] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50846 lb # [ 796.810834] niks3-server[1454]: 2026/11/12 09:31:38 INFO Received complete push request method=POST path=/api/pushes/82/complete lb # [ 796.813399] niks3-server[1454]: 2026/11/12 09:31:38 INFO Registered completed upload object_key=nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst lb # [ 796.816204] niks3-server[1454]: 2026/11/12 09:31:38 INFO Completed push id=82 objects=3 duration=3.76926ms lb # [ 796.818258] niks3-server[1454]: 2026/11/12 09:31:38 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo worker1 # [ 795.518728] nix-daemon[1059]: accepted connection from pid 3803, user nix-grpc-daemon (trusted) lb # [ 796.831082] garage[898]: 2026-11-12T09:31:38.590407Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo lb # [ 796.837280] garage[898]: 2026-11-12T09:31:38.596020Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) GET /farm/rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo worker1 # [ 795.539003] nix-grpc-daemon[3803]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' from 'http://lb:5751'... lb # [ 796.845958] garage[898]: 2026-11-12T09:31:38.605457Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst lb # [ 796.852448] garage[898]: 2026-11-12T09:31:38.611459Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) GET /farm/nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst worker1 # [ 795.566698] nix-daemon[1059]: accepted connection from pid 3803, user nix-grpc-daemon (trusted) worker1 # [ 795.579927] nix-daemon[1059]: accepted connection from pid 3803, user nix-grpc-daemon (trusted) client # [ 795.579215] nix[2857]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051... client # [ 795.705562] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 795.715433] systemd[1]: Started SSH per-connection Daemon (vsock:2:102). client # [ 795.816447] sshd-session[2870]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 795.824324] sshd-session[2870]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 795.834034] sshd-session[2870]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 795.846108] systemd-logind[427]: New session '123' of user 'root' with class 'user' and type 'tty'. client # [ 795.853277] systemd[1]: Started Session 123 of User root. client # [ 795.881305] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.pem&client-key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.key" --eval-store auto -f /nix/store/v7sckhacjvxxq8xv667z4hgvbaqhw2dd-slow.nix --argstr tag share. client # [ 795.891527] sshd-session[2876]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 795.894009] sshd-session[2876]: Disconnected from user root UNKNOWN port 65535 client # [ 795.895063] sshd-session[2870]: pam_unix(sshd:session): session closed for user root client # [ 795.903063] systemd[1]: sshd-vsock@102-103-3:22-2:102.service: Deactivated successfully. client # [ 795.913914] systemd[1]: session-123.scope: Deactivated successfully. client # [ 795.921303] systemd-logind[427]: Session 123 logged out. Waiting for processes to exit. client # [ 795.925291] systemd-logind[427]: Removed session 123. worker1 # [ 796.086830] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50846 lb # [ 797.392523] garage[898]: 2026-11-12T09:31:39.151897Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/fjww0fd4rwk1s35jav3cyal62l24n356.narinfo lb # [ 797.397482] garage[898]: 2026-11-12T09:31:39.152397Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 796.099833] nix[2879]: this derivation will be built: worker2 # [ 794.551699] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:39Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:54948 client # [ 796.107625] nix[2879]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker2 # [ 794.559182] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54948 lb # [ 797.418537] garage[898]: 2026-11-12T09:31:39.177896Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/fjww0fd4rwk1s35jav3cyal62l24n356.narinfo lb # [ 797.423623] garage[898]: 2026-11-12T09:31:39.178384Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 794.576994] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54948 lb # [ 797.436043] garage[898]: 2026-11-12T09:31:39.195355Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/fjww0fd4rwk1s35jav3cyal62l24n356.narinfo lb # [ 797.440919] garage[898]: 2026-11-12T09:31:39.195796Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 797.446263] garage[898]: 2026-11-12T09:31:39.205035Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/fjww0fd4rwk1s35jav3cyal62l24n356.narinfo lb # [ 797.451721] garage[898]: 2026-11-12T09:31:39.205459Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 796.157539] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50846 worker1 # [ 796.167158] nix-daemon[1059]: accepted connection from pid 3803, user nix-grpc-daemon (trusted) worker1 # [ 796.190007] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:39Z level=info event=niks3_push_started pid=3994 lb # [ 797.644730] garage[898]: 2026-11-12T09:31:39.402693Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/fjww0fd4rwk1s35jav3cyal62l24n356.narinfo worker1 # [ 796.347145] nix-grpc-daemon[3994]: time=2026-11-12T09:31:40.137Z level=INFO msg="Configuring client TLS" cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker1.pem key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker1.key ca="" lb # [ 797.649145] garage[898]: 2026-11-12T09:31:39.403156Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 796.359116] nix-grpc-daemon[3994]: time=2026-11-12T09:31:40.152Z level=INFO msg="All 1 paths already cached" worker2 # [ 794.814685] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:40Z level=debug event=want client=3 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=0 worker1 # [ 796.372848] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50846 client # [ 796.373063] nix[2879]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051... worker1 # [ 796.907344] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 796.916371] systemd[1]: Started SSH per-connection Daemon (vsock:2:129). worker1 # [ 797.038937] sshd-session[4016]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 797.053808] sshd-session[4016]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 797.064372] sshd-session[4016]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 797.079316] systemd-logind[539]: New session '148' of user 'root' with class 'user' and type 'tty'. worker1 # [ 797.084980] systemd[1]: Started Session 148 of User root. worker1 # [ 797.292367] sshd-session[4022]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 797.293830] sshd-session[4022]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 797.294990] sshd-session[4016]: pam_unix(sshd:session): session closed for user root worker1 # [ 797.336916] systemd[1]: sshd-vsock@129-130-5:22-2:129.service: Deactivated successfully. worker1 # [ 797.338233] systemd[1]: session-148.scope: Deactivated successfully. worker1 # [ 797.342387] systemd-logind[539]: Session 148 logged out. Waiting for processes to exit. worker1 # [ 797.344783] systemd-logind[539]: Removed session 148. worker2 # [ 796.383870] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 796.392235] systemd[1]: Started SSH per-connection Daemon (vsock:2:91). worker2 # [ 796.493128] sshd-session[3424]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 796.503399] sshd-session[3424]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 796.512872] sshd-session[3424]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 796.524557] systemd-logind[515]: New session '112' of user 'root' with class 'user' and type 'tty'. worker2 # [ 796.533160] systemd[1]: Started Session 112 of User root. worker2 # [ 796.569327] sshd-session[3430]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 796.570802] sshd-session[3430]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 796.572472] sshd-session[3424]: pam_unix(sshd:session): session closed for user root worker2 # [ 796.577128] systemd[1]: sshd-vsock@91-92-6:22-2:91.service: Deactivated successfully. worker2 # [ 796.582563] systemd[1]: session-112.scope: Deactivated successfully. worker2 # [ 796.587272] systemd-logind[515]: Session 112 logged out. Waiting for processes to exit. worker2 # [ 796.589733] systemd-logind[515]: Removed session 112. worker2 # [ 797.599761] nix-grpc-daemon[3247]: ts=2026-11-12T09:31:42Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:54964 client # [ 800.170130] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 800.179263] systemd[1]: Started SSH per-connection Daemon (vsock:2:103). client # [ 800.282863] sshd-session[2892]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 800.293199] sshd-session[2892]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 800.302721] sshd-session[2892]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 800.312536] systemd-logind[427]: New session '124' of user 'root' with class 'user' and type 'tty'. client # [ 800.324885] systemd[1]: Started Session 124 of User root. client # [ 800.347023] systemd[1]: share1.service: Sent signal SIGINT to main process 2857 (nix) on client request. client # [ 800.353966] nix[2857]: shutting downerror: interrupted by the user client # [ 800.355251] sshd-session[2898]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 800.377395] sshd-session[2898]: Disconnected from user root UNKNOWN port 65535 client # [ 800.378608] systemd[1]: sshd-vsock@103-104-3:22-2:103.service: Deactivated successfully. client # [ 800.381426] sshd-session[2892]: pam_unix(sshd:session): session closed for user root client # [ 800.382652] systemd[1]: session-124.scope: Deactivated successfully. client # [ 800.384372] systemd-logind[427]: Session 124 logged out. Waiting for processes to exit. client # [ 800.386899] systemd-logind[427]: Removed session 124. client # [ 800.393670] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 800.395276] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 800.397492] systemd[1]: share1.service: Consumed 173ms CPU time over 6.152s wall clock time, 40.8M memory peak, 7.6K incoming IP traffic, 8.1K outgoing IP traffic. client # [ 802.011847] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 802.019777] systemd[1]: Started SSH per-connection Daemon (vsock:2:104). client # [ 802.123089] sshd-session[2906]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 802.133318] sshd-session[2906]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 802.142136] sshd-session[2906]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 802.152489] systemd-logind[427]: New session '125' of user 'root' with class 'user' and type 'tty'. client # [ 802.161225] systemd[1]: Started Session 125 of User root. client # [ 802.194157] sshd-session[2912]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 802.197234] sshd-session[2912]: Disconnected from user root UNKNOWN port 65535 client # [ 802.198619] sshd-session[2906]: pam_unix(sshd:session): session closed for user root client # [ 802.202850] systemd[1]: sshd-vsock@104-105-3:22-2:104.service: Deactivated successfully. client # [ 802.208900] systemd[1]: session-125.scope: Deactivated successfully. client # [ 802.213426] systemd-logind[427]: Session 125 logged out. Waiting for processes to exit. client # [ 802.215925] systemd-logind[427]: Removed session 125. lb # [ 803.805653] systemd[1]: Stopping User Manager for UID 0... lb # [ 803.813575] systemd[2370]: Activating special unit Exit the Session... lb # [ 803.818529] systemd[2370]: Stopped target Main User Target. lb # [ 803.824723] systemd[2370]: Stopped target Basic System. lb # [ 803.826065] systemd[2370]: Stopped target Paths. lb # [ 803.827196] systemd[2370]: Stopped target Sockets. lb # [ 803.829213] systemd[2370]: Stopped target Timers. lb # [ 803.830381] systemd[2370]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 803.831998] systemd[2370]: Closed D-Bus User Message Bus Socket. lb # [ 803.833540] systemd[2370]: Stopped Create User Files and Directories. lb # [ 803.834996] systemd[2370]: Removed slice User Application Slice. lb # [ 803.836591] systemd[2370]: Reached target Shutdown. lb # [ 803.837751] systemd[2370]: Finished Exit the Session. lb # [ 803.838934] systemd[2370]: Reached target Exit the Session. lb # [ 803.849788] systemd-logind[499]: Removed session 84. lb # [ 803.857214] systemd[1]: user@0.service: Deactivated successfully. lb # [ 803.860331] systemd[1]: Stopped User Manager for UID 0. lb # [ 803.923041] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 803.960565] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 803.965979] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 803.971414] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 802.879948] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 802.883382] systemd[1]: Started SSH per-connection Daemon (vsock:2:130). worker1 # [ 803.015340] sshd-session[4027]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 803.027333] sshd-session[4027]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 803.041649] sshd-session[4027]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 803.055971] systemd-logind[539]: New session '149' of user 'root' with class 'user' and type 'tty'. worker1 # [ 803.061286] systemd[1]: Started Session 149 of User root. worker1 # [ 803.264309] sshd-session[4033]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 803.265735] sshd-session[4033]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 803.272411] sshd-session[4027]: pam_unix(sshd:session): session closed for user root worker1 # [ 803.300402] systemd[1]: sshd-vsock@130-131-5:22-2:130.service: Deactivated successfully. worker1 # [ 803.309035] systemd[1]: session-149.scope: Deactivated successfully. worker1 # [ 803.311148] systemd-logind[539]: Session 149 logged out. Waiting for processes to exit. worker1 # [ 803.313118] systemd-logind[539]: Removed session 149. worker2 # [ 802.216517] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 802.224370] systemd[1]: Started SSH per-connection Daemon (vsock:2:92). worker2 # [ 802.321103] sshd-session[3435]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 802.330594] sshd-session[3435]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 802.339868] sshd-session[3435]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 802.349643] systemd-logind[515]: New session '113' of user 'root' with class 'user' and type 'tty'. worker2 # [ 802.360558] systemd[1]: Started Session 113 of User root. worker2 # [ 802.398749] sshd-session[3441]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 802.400953] sshd-session[3441]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 802.404894] sshd-session[3435]: pam_unix(sshd:session): session closed for user root worker2 # [ 802.409383] systemd[1]: sshd-vsock@92-93-6:22-2:92.service: Deactivated successfully. worker2 # [ 802.414686] systemd[1]: session-113.scope: Deactivated successfully. worker2 # [ 802.419220] systemd-logind[515]: Session 113 logged out. Waiting for processes to exit. worker2 # [ 802.422137] systemd-logind[515]: Removed session 113. worker1 # [ 804.414743] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 804.416241] systemd[1]: Started SSH per-connection Daemon (vsock:2:131). worker1 # [ 804.546097] sshd-session[4038]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 804.560164] sshd-session[4038]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 804.569731] sshd-session[4038]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 804.587134] systemd-logind[539]: New session '150' of user 'root' with class 'user' and type 'tty'. worker1 # [ 804.593091] systemd[1]: Started Session 150 of User root. worker1 # [ 804.774075] sshd-session[4044]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 804.775609] sshd-session[4044]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 804.779335] sshd-session[4038]: pam_unix(sshd:session): session closed for user root worker1 # [ 804.783369] systemd[1]: sshd-vsock@131-132-5:22-2:131.service: Deactivated successfully. worker1 # [ 804.788552] systemd[1]: session-150.scope: Deactivated successfully. worker1 # [ 804.793114] systemd-logind[539]: Session 150 logged out. Waiting for processes to exit. worker1 # [ 804.795342] systemd-logind[539]: Removed session 150. worker1 # [ 804.832495] nix-daemon[1059]: reaped child process 3984, status = succeeded worker1 # [ 804.942039] nix-daemon[1059]: accepted connection from pid 4050, user nix-grpc-daemon (trusted) lb # [ 806.265327] niks3-server[1454]: 2026/11/12 09:31:48 INFO Received push request method=POST path=/api/pushes worker1 # [ 804.967824] nix-daemon[1059]: reaped child process 4053, status = succeeded worker1 # [ 804.973773] nix-grpc-daemon[3994]: time=2026-11-12T09:31:48.766Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 804.975407] nix-grpc-daemon[3994]: time=2026-11-12T09:31:48.766Z level=INFO msg="Uploading fjww0fd4rwk1s35jav3cyal62l24n356-slow-share (120B)" lb # [ 806.283642] garage[898]: 2026-11-12T09:31:48.043011Z INFO garage_api_common::generic_server: 192.168.1.3:33268 PUT /farm/fjww0fd4rwk1s35jav3cyal62l24n356.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5fb949c2d3b8d3aeaea294f7f731e4e0de18260a281ebae26f7637bb331934d1 worker1 # [ 805.003897] nix-grpc-daemon[3994]: time=2026-11-12T09:31:48.796Z level=INFO msg="Uploading 1 narinfos" lb # [ 806.305428] garage[898]: 2026-11-12T09:31:48.052872Z INFO garage_api_common::generic_server: 192.168.1.3:33248 PUT /farm/nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dc630648ce19f3f5ac8fdebeacfd5e0ed9fb3e1bc98be18994c6899b99df5f58 worker1 # [ 805.025980] nix-grpc-daemon[3994]: time=2026-11-12T09:31:48.819Z level=INFO msg="Upload complete. (209ms)" worker1 # [ 805.032531] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50846 duration_s=9 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=2 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 806.325909] garage[898]: 2026-11-12T09:31:48.053158Z INFO garage_api_common::generic_server: 192.168.1.3:33254 PUT /farm/log/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d477c5d87cee64669ba9fb46cc681899eb3a7710d5abf45dba67010f2bf9c18b lb # [ 806.336166] garage[898]: 2026-11-12T09:31:48.056157Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/fjww0fd4rwk1s35jav3cyal62l24n356.ls worker1 # [ 805.042303] nix-grpc-daemon[3803]: ts=2026-11-12T09:31:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50846 duration_s=8 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=2 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 806.341180] garage[898]: 2026-11-12T09:31:48.059827Z INFO garage_api_common::generic_server: 127.0.0.1:33720 (key GK0123456789abcdef01234567) HEAD /farm/nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst worker1 # [ 805.046048] nix-daemon[1059]: reaped child process 3982, status = succeeded lb # [ 806.346571] garage[898]: 2026-11-12T09:31:48.060854Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/log/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv lb # [ 806.352811] niks3-server[1454]: 2026/11/12 09:31:48 INFO Received sign narinfos request method=POST path=/api/pushes/83/sign lb # [ 806.355255] niks3-server[1454]: 2026/11/12 09:31:48 INFO Signed narinfos id=83 count=1 lb # [ 806.357072] niks3-server[1454]: 2026/11/12 09:31:48 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.ls lb # [ 806.359415] niks3-server[1454]: 2026/11/12 09:31:48 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 806.362574] niks3-server[1454]: 2026/11/12 09:31:48 INFO Received complete push request method=POST path=/api/pushes/83/complete lb # [ 806.364549] niks3-server[1454]: 2026/11/12 09:31:48 INFO Registered completed upload object_key=log/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv lb # [ 806.366759] niks3-server[1454]: 2026/11/12 09:31:48 INFO Completed push id=83 objects=4 duration=8.23746ms lb # [ 806.368588] niks3-server[1454]: 2026/11/12 09:31:48 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.narinfo lb # [ 806.371117] envoy[897]: conn peer=[2001:db8:1::1]:59194 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2706 tx=825 ms=5930 client # [ 805.068437] systemd[1]: share2.service: Deactivated successfully. client # [ 805.071056] systemd[1]: share2.service: Consumed 177ms CPU time over 9.188s wall clock time, 34.7M memory peak, 8.5K incoming IP traffic, 7.2K outgoing IP traffic. lb # [ 806.373359] garage[898]: 2026-11-12T09:31:48.064482Z INFO garage_api_common::generic_server: 192.168.1.3:33248 PUT /farm/fjww0fd4rwk1s35jav3cyal62l24n356.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6681cef0ac80ec508063f33d032ab1d5cb5874fa5cf52d3193a55b25fea61cf5 lb # [ 806.380499] garage[898]: 2026-11-12T09:31:48.078090Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/fjww0fd4rwk1s35jav3cyal62l24n356.narinfo worker2 # [ 803.693690] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 803.703219] systemd[1]: Started SSH per-connection Daemon (vsock:2:93). worker2 # [ 803.816779] sshd-session[3446]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 803.826687] sshd-session[3446]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 803.835222] sshd-session[3446]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 803.846431] systemd-logind[515]: New session '114' of user 'root' with class 'user' and type 'tty'. worker2 # [ 803.853494] systemd[1]: Started Session 114 of User root. worker2 # [ 803.889053] sshd-session[3452]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 803.890537] sshd-session[3452]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 803.892127] sshd-session[3446]: pam_unix(sshd:session): session closed for user root worker2 # [ 803.896293] systemd[1]: sshd-vsock@93-94-6:22-2:93.service: Deactivated successfully. worker2 # [ 803.901711] systemd[1]: session-114.scope: Deactivated successfully. worker2 # [ 803.905968] systemd-logind[515]: Session 114 logged out. Waiting for processes to exit. worker2 # [ 803.908900] systemd-logind[515]: Removed session 114. client # [ 806.769867] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 806.779083] systemd[1]: Started SSH per-connection Daemon (vsock:2:105). client # [ 806.871940] sshd-session[2921]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 806.880817] sshd-session[2921]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 806.889108] sshd-session[2921]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 806.899960] systemd-logind[427]: New session '126' of user 'root' with class 'user' and type 'tty'. client # [ 806.904508] systemd[1]: Started Session 126 of User root. client # [ 806.937313] sshd-session[2927]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 806.940073] sshd-session[2927]: Disconnected from user root UNKNOWN port 65535 client # [ 806.941463] sshd-session[2921]: pam_unix(sshd:session): session closed for user root client # [ 806.946427] systemd[1]: sshd-vsock@105-106-3:22-2:105.service: Deactivated successfully. client # [ 806.951641] systemd[1]: session-126.scope: Deactivated successfully. client # [ 806.956820] systemd-logind[427]: Session 126 logged out. Waiting for processes to exit. client # [ 806.959426] systemd-logind[427]: Removed session 126. client # [ 808.999683] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 809.007514] systemd[1]: Started SSH per-connection Daemon (vsock:2:106). client # [ 809.105157] sshd-session[2933]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 809.114631] sshd-session[2933]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 809.123082] sshd-session[2933]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 809.134828] systemd-logind[427]: New session '127' of user 'root' with class 'user' and type 'tty'. client # [ 809.141004] systemd[1]: Started Session 127 of User root. client # [ 809.171195] sshd-session[2939]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 809.173965] sshd-session[2939]: Disconnected from user root UNKNOWN port 65535 client # [ 809.175427] sshd-session[2933]: pam_unix(sshd:session): session closed for user root ok test farm::serial::timeout_and_max_silent_time_reach_the_builder ... client # [ 809.179821] systemd[1]: sshd-vsock@106-107-3:22-2:106.service: Deactivated successfully. client # [ 809.186581] systemd[1]: session-127.scope: Deactivated successfully. client # [ 809.190188] systemd-logind[427]: Session 127 logged out. Waiting for processes to exit. client # [ 809.193718] systemd-logind[427]: Removed session 127. worker1 # [ 810.109357] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 810.118491] systemd[1]: Started SSH per-connection Daemon (vsock:2:132). worker1 # [ 810.215204] sshd-session[4055]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 810.224933] sshd-session[4055]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 810.234089] sshd-session[4055]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 810.243019] systemd-logind[539]: New session '151' of user 'root' with class 'user' and type 'tty'. worker1 # [ 810.252587] systemd[1]: Started Session 151 of User root. worker1 # [ 810.289741] sshd-session[4061]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 810.292647] sshd-session[4061]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 810.294115] sshd-session[4055]: pam_unix(sshd:session): session closed for user root worker1 # [ 810.298412] systemd[1]: sshd-vsock@132-133-5:22-2:132.service: Deactivated successfully. worker1 # [ 810.304280] systemd[1]: session-151.scope: Deactivated successfully. worker1 # [ 810.308919] systemd-logind[539]: Session 151 logged out. Waiting for processes to exit. worker1 # [ 810.311174] systemd-logind[539]: Removed session 151. worker2 # [ 810.003305] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 810.011903] systemd[1]: Started SSH per-connection Daemon (vsock:2:94). worker2 # [ 810.112793] sshd-session[3457]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 810.122688] sshd-session[3457]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 810.131548] sshd-session[3457]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 810.141019] systemd-logind[515]: New session '115' of user 'root' with class 'user' and type 'tty'. worker2 # [ 810.153326] systemd[1]: Started Session 115 of User root. worker2 # [ 810.189304] sshd-session[3463]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 810.191011] sshd-session[3463]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 810.193352] sshd-session[3457]: pam_unix(sshd:session): session closed for user root worker2 # [ 810.197587] systemd[1]: sshd-vsock@94-95-6:22-2:94.service: Deactivated successfully. worker2 # [ 810.202819] systemd[1]: session-115.scope: Deactivated successfully. worker2 # [ 810.207879] systemd-logind[515]: Session 115 logged out. Waiting for processes to exit. worker2 # [ 810.210719] systemd-logind[515]: Removed session 115. lb # [ 814.414704] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 814.422944] systemd[1]: Started SSH per-connection Daemon (vsock:2:61). lb # [ 814.519864] sshd-session[2396]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 814.527893] sshd-session[2396]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 814.538104] sshd-session[2396]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 814.554140] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 814.567210] systemd-logind[499]: New session '85' of user 'root' with class 'user' and type 'tty'. lb # [ 814.596401] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 814.612438] systemd[1]: Starting User Manager for UID 0... lb # [ 814.643974] (systemd)[2404]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 814.650264] systemd-logind[499]: New session '86' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 814.742165] systemd[2404]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 814.840456] systemd[2404]: Queued start job for default target Main User Target. lb # [ 814.845056] systemd[2404]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 814.848053] systemd[2404]: Created slice User Application Slice. lb # [ 814.850583] systemd[2404]: Started Daily Cleanup of User's Temporary Directories. lb # [ 814.851752] systemd[2404]: Reached target Paths. lb # [ 814.854545] systemd[2404]: Reached target Timers. lb # [ 814.855339] systemd[2404]: Starting D-Bus User Message Bus Socket... lb # [ 814.857896] systemd[2404]: Starting Create User Files and Directories... lb # [ 814.900335] systemd[2404]: Finished Create User Files and Directories. lb # [ 814.902915] systemd[2404]: Listening on D-Bus User Message Bus Socket. lb # [ 814.903948] systemd[2404]: Reached target Sockets. lb # [ 814.907403] systemd[2404]: Reached target Basic System. lb # [ 814.908518] systemd[2404]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 814.909949] systemd[2404]: Reached target Main User Target. lb # [ 814.910817] systemd[2404]: Startup finished in 236ms. lb # [ 814.911561] systemd[1]: Started User Manager for UID 0. lb # [ 814.915385] systemd[1]: Started Session 85 of User root. lb # [ 814.947475] sshd-session[2418]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 814.949271] sshd-session[2418]: Disconnected from user root UNKNOWN port 65535 lb # [ 814.951034] sshd-session[2396]: pam_unix(sshd:session): session closed for user root lb # [ 814.954710] systemd[1]: sshd-vsock@61-62-4:22-2:61.service: Deactivated successfully. lb # [ 814.959922] systemd[1]: session-85.scope: Deactivated successfully. lb # [ 814.963069] systemd[1]: session-85.scope: Consumed 25ms CPU time over 48ms wall clock time, 3.1M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 814.967404] systemd-logind[499]: Session 85 logged out. Waiting for processes to exit. lb # [ 814.970167] systemd-logind[499]: Removed session 85. worker2 # [ 812.759351] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 812.767834] systemd[1]: Started SSH per-connection Daemon (vsock:2:95). worker2 # [ 812.870419] sshd-session[3469]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 812.880303] sshd-session[3469]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 812.890585] sshd-session[3469]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 812.902781] systemd-logind[515]: New session '116' of user 'root' with class 'user' and type 'tty'. worker2 # [ 812.909113] systemd[1]: Started Session 116 of User root. worker2 # [ 812.944567] sshd-session[3475]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 812.947261] sshd-session[3475]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 812.949372] sshd-session[3469]: pam_unix(sshd:session): session closed for user root worker2 # [ 812.953768] systemd[1]: sshd-vsock@95-96-6:22-2:95.service: Deactivated successfully. worker2 # [ 812.958649] systemd[1]: session-116.scope: Deactivated successfully. worker2 # [ 812.961809] systemd[1]: session-116.scope: Consumed 28ms CPU time over 51ms wall clock time, 3M memory peak, 19K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 812.965761] systemd-logind[515]: Session 116 logged out. Waiting for processes to exit. worker2 # [ 812.967879] systemd-logind[515]: Removed session 116. lb # [ 816.335469] envoy[897]: conn peer=[2001:db8:1::1]:59198 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2247 tx=1990 ms=8975 worker1 # [ 816.400416] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 816.405559] systemd[1]: Started SSH per-connection Daemon (vsock:2:133). worker1 # [ 816.503008] sshd-session[4067]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 816.512289] sshd-session[4067]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 816.523347] sshd-session[4067]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 816.535219] systemd-logind[539]: New session '152' of user 'root' with class 'user' and type 'tty'. worker1 # [ 816.541538] systemd[1]: Started Session 152 of User root. worker1 # [ 816.577822] sshd-session[4073]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 816.580584] sshd-session[4073]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 816.582643] sshd-session[4067]: pam_unix(sshd:session): session closed for user root worker1 # [ 816.586988] systemd[1]: sshd-vsock@133-134-5:22-2:133.service: Deactivated successfully. worker1 # [ 816.592087] systemd[1]: session-152.scope: Deactivated successfully. worker1 # [ 816.593742] systemd[1]: session-152.scope: Consumed 29ms CPU time over 52ms wall clock time, 5.1M memory peak, 9.8K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 816.599139] systemd-logind[539]: Session 152 logged out. Waiting for processes to exit. worker1 # [ 816.601449] systemd-logind[539]: Removed session 152. [e2e] heartbeat t=720s worker2 # [ 817.214471] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 817.222555] systemd[1]: Started SSH per-connection Daemon (vsock:2:96). worker2 # [ 817.321082] sshd-session[3480]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 817.331344] sshd-session[3480]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 817.340913] sshd-session[3480]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 817.352522] systemd-logind[515]: New session '117' of user 'root' with class 'user' and type 'tty'. worker2 # [ 817.361145] systemd[1]: Started Session 117 of User root. worker2 # [ 817.398628] sshd-session[3486]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 817.401708] sshd-session[3486]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 817.403589] sshd-session[3480]: pam_unix(sshd:session): session closed for user root worker2 # [ 817.407987] systemd[1]: sshd-vsock@96-97-6:22-2:96.service: Deactivated successfully. worker2 # [ 817.414313] systemd[1]: session-117.scope: Deactivated successfully. worker2 # [ 817.416686] systemd[1]: session-117.scope: Consumed 29ms CPU time over 55ms wall clock time, 3.1M memory peak, 19K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 817.422473] systemd-logind[515]: Session 117 logged out. Waiting for processes to exit. worker2 # [ 817.423786] systemd-logind[515]: Removed session 117. client # [ 819.393455] systemd[1]: Stopping User Manager for UID 0... client # [ 819.401228] systemd[2817]: Activating special unit Exit the Session... client # [ 819.407383] systemd[2817]: Stopped target Main User Target. client # [ 819.411440] systemd[2817]: Stopped target Basic System. client # [ 819.412881] systemd[2817]: Stopped target Paths. client # [ 819.414042] systemd[2817]: Stopped target Sockets. client # [ 819.415280] systemd[2817]: Stopped target Timers. client # [ 819.416839] systemd[2817]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 819.418531] systemd[2817]: Closed D-Bus User Message Bus Socket. client # [ 819.419913] systemd[2817]: Stopped Create User Files and Directories. client # [ 819.421519] systemd[2817]: Removed slice User Application Slice. client # [ 819.422908] systemd[2817]: Reached target Shutdown. client # [ 819.424999] systemd[2817]: Finished Exit the Session. client # [ 819.426332] systemd[2817]: Reached target Exit the Session. client # [ 819.449729] systemd-logind[427]: Removed session 120. client # [ 819.458355] systemd[1]: user@0.service: Deactivated successfully. client # [ 819.462252] systemd[1]: Stopped User Manager for UID 0. client # [ 819.525869] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 819.560385] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 819.565834] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 819.571845] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 820.438724] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 820.446950] systemd[1]: Started SSH per-connection Daemon (vsock:2:107). client # [ 820.542351] sshd-session[2949]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 820.550775] sshd-session[2949]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 820.560921] sshd-session[2949]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 820.588487] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 820.622575] systemd-logind[427]: New session '128' of user 'root' with class 'user' and type 'tty'. client # [ 820.634660] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 820.641881] systemd[1]: Starting User Manager for UID 0... client # [ 820.669822] (systemd)[2958]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 820.676128] systemd-logind[427]: New session '129' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 820.763458] systemd[2958]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 820.861760] systemd[2958]: Queued start job for default target Main User Target. client # [ 820.864990] systemd[2958]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 820.868997] systemd[2958]: Created slice User Application Slice. client # [ 820.870053] systemd[2958]: Started Daily Cleanup of User's Temporary Directories. client # [ 820.871257] systemd[2958]: Reached target Paths. client # [ 820.871961] systemd[2958]: Reached target Timers. client # [ 820.876891] systemd[2958]: Starting D-Bus User Message Bus Socket... client # [ 820.877913] systemd[2958]: Starting Create User Files and Directories... client # [ 820.917740] systemd[2958]: Listening on D-Bus User Message Bus Socket. client # [ 820.920098] systemd[2958]: Finished Create User Files and Directories. client # [ 820.921175] systemd[2958]: Reached target Sockets. client # [ 820.921903] systemd[2958]: Reached target Basic System. client # [ 820.922701] systemd[2958]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 820.927635] systemd[2958]: Reached target Main User Target. client # [ 820.928896] systemd[2958]: Startup finished in 232ms. client # [ 820.929670] systemd[1]: Started User Manager for UID 0. client # [ 820.935416] systemd[1]: Started Session 128 of User root. worker2 # [ 819.550800] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54948 worker1 # [ 821.108494] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50846 lb # [ 822.414755] garage[898]: 2026-11-12T09:32:04.172851Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/yipif2fkj40xj5m61zaw0j67xgqra2xn.narinfo lb # [ 822.420060] garage[898]: 2026-11-12T09:32:04.173305Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 819.572379] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54948 lb # [ 822.426660] garage[898]: 2026-11-12T09:32:04.186641Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/yipif2fkj40xj5m61zaw0j67xgqra2xn.narinfo lb # [ 822.432238] garage[898]: 2026-11-12T09:32:04.191535Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 822.436985] garage[898]: 2026-11-12T09:32:04.196159Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/yipif2fkj40xj5m61zaw0j67xgqra2xn.narinfo lb # [ 822.441850] garage[898]: 2026-11-12T09:32:04.196537Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 819.594987] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54948 lb # [ 822.454230] garage[898]: 2026-11-12T09:32:04.213671Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/sfkglm39i7dsf4k91pn9ij8xz5mkgirx.narinfo lb # [ 822.459185] garage[898]: 2026-11-12T09:32:04.214139Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 819.613324] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54948 worker2 # [ 819.624432] nix-daemon[976]: accepted connection from pid 3247, user nix-grpc-daemon (trusted) worker2 # [ 819.642003] nix-daemon[976]: accepted connection from pid 3247, user nix-grpc-daemon (trusted) worker2 # [ 819.782201] nix-daemon[976]: accepted connection from pid 3495, user nix-grpc-daemon (trusted) worker2 # [ 819.806129] nix-daemon[976]: reaped child process 3498, status = succeeded lb # [ 822.666427] niks3-server[1454]: 2026/11/12 09:32:04 INFO Received push request method=POST path=/api/pushes worker2 # [ 819.820633] nix-grpc-daemon[3362]: time=2026-11-12T09:32:05.092Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 819.822314] nix-grpc-daemon[3362]: time=2026-11-12T09:32:05.092Z level=INFO msg="Uploading sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv (424B)" lb # [ 822.674547] garage[898]: 2026-11-12T09:32:04.433794Z INFO garage_api_common::generic_server: 192.168.1.4:56106 PUT /farm/nar/1m12xmj6yzmb9y2j8ly0yvh5fyzy1nqk7ajhqwr4wn3b5h0bsch5.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093204Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=956eef959fdfa605dc40ad72f6e53eeac568f21698fba661413185bce6a82205 worker2 # [ 819.837671] nix-grpc-daemon[3362]: time=2026-11-12T09:32:05.110Z level=INFO msg="Uploading 1 narinfos" worker2 # [ 819.845730] nix-grpc-daemon[3362]: time=2026-11-12T09:32:05.118Z level=INFO msg="Upload complete. (193ms)" lb # [ 822.699047] garage[898]: 2026-11-12T09:32:04.444208Z INFO garage_api_common::generic_server: 192.168.1.4:56110 PUT /farm/sfkglm39i7dsf4k91pn9ij8xz5mkgirx.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093204Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fc055c01506cdade26dc9a8a530b570d3bd08a3d139e6ae74b539e0795d69dbe worker2 # [ 819.852146] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54948 duration_s=0 paths=1 nar_bytes_in=424 lb # [ 822.708808] garage[898]: 2026-11-12T09:32:04.447859Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/sfkglm39i7dsf4k91pn9ij8xz5mkgirx.ls worker2 # [ 819.862616] nix-daemon[976]: reaped child process 3491, status = succeeded lb # [ 822.713958] garage[898]: 2026-11-12T09:32:04.451091Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/nar/1m12xmj6yzmb9y2j8ly0yvh5fyzy1nqk7ajhqwr4wn3b5h0bsch5.nar.zst lb # [ 822.720386] garage[898]: 2026-11-12T09:32:04.451602Z INFO garage_api_common::generic_server: 192.168.1.4:56110 PUT /farm/sfkglm39i7dsf4k91pn9ij8xz5mkgirx.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093204Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=740b79ce9819f261d27c6b4fec2396f7ba8d74d2128ff5f6de66af8c1c084c11 worker2 # [ 819.876724] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:05Z level=debug event=want client=4 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv cached=0 lb # [ 822.729777] garage[898]: 2026-11-12T09:32:04.455485Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/sfkglm39i7dsf4k91pn9ij8xz5mkgirx.narinfo worker2 # [ 819.879064] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:05Z level=debug event=assigned drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv worker=192.168.1.4:50051 clients=1 lb # [ 822.734901] niks3-server[1454]: 2026/11/12 09:32:04 INFO Received sign narinfos request method=POST path=/api/pushes/84/sign lb # [ 822.738581] niks3-server[1454]: 2026/11/12 09:32:04 INFO Signed narinfos id=84 count=1 lb # [ 822.741204] niks3-server[1454]: 2026/11/12 09:32:04 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.ls worker2 # [ 819.888232] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54948 lb # [ 822.744074] niks3-server[1454]: 2026/11/12 09:32:04 INFO Received complete push request method=POST path=/api/pushes/84/complete lb # [ 822.746522] niks3-server[1454]: 2026/11/12 09:32:04 INFO Registered completed upload object_key=nar/1m12xmj6yzmb9y2j8ly0yvh5fyzy1nqk7ajhqwr4wn3b5h0bsch5.nar.zst worker2 # [ 819.896402] nix-daemon[976]: accepted connection from pid 3247, user nix-grpc-daemon (trusted) lb # [ 822.749533] niks3-server[1454]: 2026/11/12 09:32:04 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.narinfo lb # [ 822.751954] niks3-server[1454]: 2026/11/12 09:32:04 INFO Completed push id=84 objects=3 duration=4.7582ms worker2 # [ 819.908155] nix-daemon[976]: accepted connection from pid 3247, user nix-grpc-daemon (trusted) lb # [ 823.701029] garage[898]: 2026-11-12T09:32:05.459686Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/yipif2fkj40xj5m61zaw0j67xgqra2xn.narinfo lb # [ 823.706097] garage[898]: 2026-11-12T09:32:05.460206Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 825.055156] systemd[1]: Stopping User Manager for UID 0... lb # [ 825.063235] systemd[2404]: Activating special unit Exit the Session... lb # [ 825.068396] systemd[2404]: Stopped target Main User Target. lb # [ 825.069797] systemd[2404]: Stopped target Basic System. lb # [ 825.071044] systemd[2404]: Stopped target Paths. lb # [ 825.077329] systemd[2404]: Stopped target Sockets. lb # [ 825.078582] systemd[2404]: Stopped target Timers. lb # [ 825.079683] systemd[2404]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 825.081519] systemd[2404]: Closed D-Bus User Message Bus Socket. lb # [ 825.082994] systemd[2404]: Stopped Create User Files and Directories. lb # [ 825.084681] systemd[2404]: Removed slice User Application Slice. lb # [ 825.086061] systemd[2404]: Reached target Shutdown. lb # [ 825.087202] systemd[2404]: Finished Exit the Session. lb # [ 825.088576] systemd[2404]: Reached target Exit the Session. lb # [ 825.117769] systemd-logind[499]: Removed session 86. lb # [ 825.125217] systemd[1]: user@0.service: Deactivated successfully. lb # [ 825.128262] systemd[1]: Stopped User Manager for UID 0. lb # [ 825.192880] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 825.233467] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 825.237514] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 825.241521] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 826.789813] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 826.796984] systemd[3937]: Activating special unit Exit the Session... worker1 # [ 826.804709] systemd[3937]: Stopped target Main User Target. worker1 # [ 826.806301] systemd[3937]: Stopped target Basic System. worker1 # [ 826.807570] systemd[3937]: Stopped target Paths. worker1 # [ 826.811102] systemd[3937]: Stopped target Sockets. worker1 # [ 826.813396] systemd[3937]: Stopped target Timers. worker1 # [ 826.814625] systemd[3937]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 826.816505] systemd[3937]: Closed D-Bus User Message Bus Socket. worker1 # [ 826.817919] systemd[3937]: Stopped Create User Files and Directories. worker1 # [ 826.819393] systemd[3937]: Removed slice User Application Slice. worker1 # [ 826.820984] systemd[3937]: Reached target Shutdown. worker1 # [ 826.822166] systemd[3937]: Finished Exit the Session. worker1 # [ 826.823382] systemd[3937]: Reached target Exit the Session. worker1 # [ 826.834015] systemd-logind[539]: Removed session 145. worker1 # [ 826.843048] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 826.847257] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 826.866161] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 826.910146] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 826.915334] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 826.918239] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 826.123961] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54948 duration_s=6 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv assign_id=3 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 826.154061] nix-daemon[976]: reaped child process 3503, status = succeeded worker2 # [ 826.155951] nix-daemon[976]: reaped child process 3505, status = succeeded client # [ 827.707940] sshd-session[2971]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 827.710916] sshd-session[2971]: Disconnected from user root UNKNOWN port 65535 client # [ 827.714575] sshd-session[2949]: pam_unix(sshd:session): session closed for user root client # [ 827.720566] systemd[1]: sshd-vsock@107-108-3:22-2:107.service: Deactivated successfully. client # [ 827.727864] systemd[1]: session-128.scope: Deactivated successfully. client # [ 827.730668] systemd[1]: session-128.scope: Consumed 181ms CPU time over 6.797s wall clock time, 40.1M memory peak, 7.7K incoming IP traffic, 8.1K outgoing IP traffic. client # [ 827.740848] systemd-logind[427]: Session 128 logged out. Waiting for processes to exit. client # [ 827.742735] systemd-logind[427]: Removed session 128. worker2 # [ 827.583590] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 827.591628] systemd[3222]: Activating special unit Exit the Session... worker2 # [ 827.598406] systemd[3222]: Stopped target Main User Target. worker2 # [ 827.599913] systemd[3222]: Stopped target Basic System. worker2 # [ 827.605200] systemd[3222]: Stopped target Paths. worker2 # [ 827.606482] systemd[3222]: Stopped target Sockets. worker2 # [ 827.607700] systemd[3222]: Stopped target Timers. worker2 # [ 827.609858] systemd[3222]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 827.611672] systemd[3222]: Closed D-Bus User Message Bus Socket. worker2 # [ 827.613391] systemd[3222]: Stopped Create User Files and Directories. worker2 # [ 827.614975] systemd[3222]: Removed slice User Application Slice. worker2 # [ 827.616806] systemd[3222]: Reached target Shutdown. worker2 # [ 827.618104] systemd[3222]: Finished Exit the Session. worker2 # [ 827.619416] systemd[3222]: Reached target Exit the Session. worker2 # [ 827.633838] systemd-logind[515]: Removed session 106. worker2 # [ 827.642910] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 827.647200] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 827.662608] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 827.702401] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 827.707187] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 827.712902] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 829.885751] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 829.894047] systemd[1]: Started SSH per-connection Daemon (vsock:2:108). client # [ 829.991171] sshd-session[2992]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 830.001940] sshd-session[2992]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 830.010922] sshd-session[2992]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 830.020329] systemd-logind[427]: New session '130' of user 'root' with class 'user' and type 'tty'. client # [ 830.028597] systemd[1]: Started Session 130 of User root. worker2 # [ 828.650007] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54948 worker2 # [ 828.657062] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54948 lb # [ 831.516888] garage[898]: 2026-11-12T09:32:13.275244Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/hqncn6si0500hyvnwj9b6zn8jg8vnxnl.narinfo lb # [ 831.521628] garage[898]: 2026-11-12T09:32:13.275697Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 828.674218] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54948 lb # [ 831.532553] garage[898]: 2026-11-12T09:32:13.292514Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/hqncn6si0500hyvnwj9b6zn8jg8vnxnl.narinfo lb # [ 831.538422] garage[898]: 2026-11-12T09:32:13.297350Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 831.543655] garage[898]: 2026-11-12T09:32:13.302545Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/hqncn6si0500hyvnwj9b6zn8jg8vnxnl.narinfo lb # [ 831.548926] garage[898]: 2026-11-12T09:32:13.302933Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 828.700622] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54948 lb # [ 831.559343] garage[898]: 2026-11-12T09:32:13.318800Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.narinfo lb # [ 831.564357] garage[898]: 2026-11-12T09:32:13.319249Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 830.272925] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50846 worker1 # [ 830.284588] nix-daemon[1059]: accepted connection from pid 3803, user nix-grpc-daemon (trusted) worker1 # [ 830.302545] nix-daemon[1059]: accepted connection from pid 3803, user nix-grpc-daemon (trusted) worker1 # [ 830.444661] nix-daemon[1059]: accepted connection from pid 4086, user nix-grpc-daemon (trusted) worker1 # [ 830.469191] nix-daemon[1059]: reaped child process 4089, status = succeeded lb # [ 831.776740] niks3-server[1454]: 2026/11/12 09:32:13 INFO Received push request method=POST path=/api/pushes worker1 # [ 830.484609] nix-grpc-daemon[3994]: time=2026-11-12T09:32:14.277Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 830.486466] nix-grpc-daemon[3994]: time=2026-11-12T09:32:14.277Z level=INFO msg="Uploading pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv (424B)" lb # [ 831.784147] garage[898]: 2026-11-12T09:32:13.543800Z INFO garage_api_common::generic_server: 192.168.1.3:33248 PUT /farm/nar/14f5yrnllfav3svmw4v4svw15r4zlf5yv1p972jy14mmq6gdw943.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093213Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6163426a5369042066a586eb727ff0a651d3c0c4b4c860d98c317ee652baf94e worker1 # [ 830.500302] nix-grpc-daemon[3994]: time=2026-11-12T09:32:14.293Z level=INFO msg="Uploading 1 narinfos" lb # [ 831.807224] garage[898]: 2026-11-12T09:32:13.554819Z INFO garage_api_common::generic_server: 192.168.1.3:33254 PUT /farm/pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093213Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e464a788125c735f2edd5589daab89bd274db494e8ea7026daeeaebb1c3386f7 lb # [ 831.818125] garage[898]: 2026-11-12T09:32:13.557562Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.ls worker1 # [ 830.523553] nix-grpc-daemon[3994]: time=2026-11-12T09:32:14.317Z level=INFO msg="Upload complete. (211ms)" lb # [ 831.823061] garage[898]: 2026-11-12T09:32:13.559785Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/nar/14f5yrnllfav3svmw4v4svw15r4zlf5yv1p972jy14mmq6gdw943.nar.zst worker1 # [ 830.531772] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50846 duration_s=0 paths=1 nar_bytes_in=424 lb # [ 831.828620] garage[898]: 2026-11-12T09:32:13.560342Z INFO garage_api_common::generic_server: 192.168.1.3:33254 PUT /farm/pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093213Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ca2870293a514db72f19a3541e9596a4dea1cc8835cf5ff4fa41c4b465fb15f2 worker1 # [ 830.541451] nix-daemon[1059]: reaped child process 4082, status = succeeded lb # [ 831.838377] garage[898]: 2026-11-12T09:32:13.565032Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.narinfo lb # [ 831.843312] niks3-server[1454]: 2026/11/12 09:32:13 INFO Received sign narinfos request method=POST path=/api/pushes/85/sign lb # [ 831.846684] niks3-server[1454]: 2026/11/12 09:32:13 INFO Signed narinfos id=85 count=1 lb # [ 831.850365] niks3-server[1454]: 2026/11/12 09:32:13 INFO Received complete push request method=POST path=/api/pushes/85/complete worker2 # [ 828.997747] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:14Z level=debug event=want client=5 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv cached=0 lb # [ 831.853695] niks3-server[1454]: 2026/11/12 09:32:13 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.ls worker2 # [ 829.001625] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:14Z level=debug event=assigned drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv worker=192.168.1.3:50051 clients=1 lb # [ 831.857254] niks3-server[1454]: 2026/11/12 09:32:13 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.narinfo worker1 # [ 830.558400] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50846 lb # [ 831.859833] niks3-server[1454]: 2026/11/12 09:32:13 INFO Registered completed upload object_key=nar/14f5yrnllfav3svmw4v4svw15r4zlf5yv1p972jy14mmq6gdw943.nar.zst lb # [ 831.863070] niks3-server[1454]: 2026/11/12 09:32:13 INFO Completed push id=85 objects=3 duration=20.05816ms worker1 # [ 830.568616] nix-daemon[1059]: accepted connection from pid 3803, user nix-grpc-daemon (trusted) worker1 # [ 830.584495] nix-daemon[1059]: accepted connection from pid 3803, user nix-grpc-daemon (trusted) lb # [ 832.699685] garage[898]: 2026-11-12T09:32:14.458885Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/hqncn6si0500hyvnwj9b6zn8jg8vnxnl.narinfo lb # [ 832.705027] garage[898]: 2026-11-12T09:32:14.464831Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 836.334273] envoy[897]: conn peer=[2001:db8:1::1]:58880 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2776 tx=975 ms=6596 worker1 # [ 836.801841] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50846 duration_s=6 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv assign_id=4 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 836.830389] nix-daemon[1059]: reaped child process 4092, status = succeeded worker1 # [ 836.832318] nix-daemon[1059]: reaped child process 4094, status = succeeded client # [ 836.831435] sshd-session[2998]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 836.831794] sshd-session[2998]: Disconnected from user root UNKNOWN port 65535 client # [ 836.836971] sshd-session[2992]: pam_unix(sshd:session): session closed for user root client # [ 836.843943] systemd[1]: sshd-vsock@108-109-3:22-2:108.service: Deactivated successfully. client # [ 836.852686] systemd[1]: session-130.scope: Deactivated successfully. client # [ 836.855304] systemd[1]: session-130.scope: Consumed 184ms CPU time over 6.826s wall clock time, 38.1M memory peak, 7.7K incoming IP traffic, 8.1K outgoing IP traffic. client # [ 836.865041] systemd-logind[427]: Session 130 logged out. Waiting for processes to exit. client # [ 836.866911] systemd-logind[427]: Removed session 130. worker1 # [ 837.993839] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 838.003345] systemd[1]: Started SSH per-connection Daemon (vsock:2:134). worker1 # [ 838.099800] sshd-session[4111]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 838.108290] sshd-session[4111]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 838.118572] sshd-session[4111]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 838.139074] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 838.148798] systemd-logind[539]: New session '153' of user 'root' with class 'user' and type 'tty'. worker1 # [ 838.177971] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 838.184872] systemd[1]: Starting User Manager for UID 0... worker1 # [ 838.209852] (systemd)[4119]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 838.216428] systemd-logind[539]: New session '154' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 838.305744] systemd[4119]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 838.412773] systemd[4119]: Queued start job for default target Main User Target. worker1 # [ 838.421338] systemd[4119]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 838.424961] systemd[4119]: Created slice User Application Slice. worker1 # [ 838.427592] systemd[4119]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 838.429416] systemd[4119]: Reached target Paths. worker1 # [ 838.430318] systemd[4119]: Reached target Timers. worker1 # [ 838.432979] systemd[4119]: Starting D-Bus User Message Bus Socket... worker1 # [ 838.435404] systemd[4119]: Starting Create User Files and Directories... worker1 # [ 838.481248] systemd[4119]: Finished Create User Files and Directories. worker1 # [ 838.485781] systemd[4119]: Listening on D-Bus User Message Bus Socket. worker1 # [ 838.489387] systemd[4119]: Reached target Sockets. worker1 # [ 838.490327] systemd[4119]: Reached target Basic System. worker1 # [ 838.491130] systemd[4119]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 838.495066] systemd[4119]: Reached target Main User Target. worker1 # [ 838.495985] systemd[4119]: Startup finished in 255ms. worker1 # [ 838.500987] systemd[1]: Started User Manager for UID 0. worker1 # [ 838.501887] systemd[1]: Started Session 153 of User root. worker1 # [ 838.532827] sshd-session[4132]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 838.535549] sshd-session[4132]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 838.537667] sshd-session[4111]: pam_unix(sshd:session): session closed for user root worker1 # [ 838.541441] systemd[1]: sshd-vsock@134-135-5:22-2:134.service: Deactivated successfully. worker1 # [ 838.547051] systemd[1]: session-153.scope: Deactivated successfully. worker1 # [ 838.552502] systemd-logind[539]: Session 153 logged out. Waiting for processes to exit. worker1 # [ 838.554801] systemd-logind[539]: Removed session 153. worker2 # [ 837.178654] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 837.188133] systemd[1]: Started SSH per-connection Daemon (vsock:2:97). worker2 # [ 837.286869] sshd-session[3528]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 837.296347] sshd-session[3528]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 837.307140] sshd-session[3528]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 837.328319] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 837.338164] systemd-logind[515]: New session '118' of user 'root' with class 'user' and type 'tty'. worker2 # [ 837.370656] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 837.379236] systemd[1]: Starting User Manager for UID 0... worker2 # [ 837.407104] (systemd)[3536]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 837.414954] systemd-logind[515]: New session '119' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 837.510483] systemd[3536]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 837.619928] systemd[3536]: Queued start job for default target Main User Target. worker2 # [ 837.629440] systemd[3536]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 837.634711] systemd[3536]: Created slice User Application Slice. worker2 # [ 837.635919] systemd[3536]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 837.639689] systemd[3536]: Reached target Paths. worker2 # [ 837.641923] systemd[3536]: Reached target Timers. worker2 # [ 837.642764] systemd[3536]: Starting D-Bus User Message Bus Socket... worker2 # [ 837.643760] systemd[3536]: Starting Create User Files and Directories... worker2 # [ 837.693676] systemd[3536]: Finished Create User Files and Directories. worker2 # [ 837.695670] systemd[3536]: Listening on D-Bus User Message Bus Socket. worker2 # [ 837.700513] systemd[3536]: Reached target Sockets. worker2 # [ 837.701400] systemd[3536]: Reached target Basic System. worker2 # [ 837.702248] systemd[3536]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 837.703790] systemd[3536]: Reached target Main User Target. worker2 # [ 837.706158] systemd[3536]: Startup finished in 265ms. worker2 # [ 837.707144] systemd[1]: Started User Manager for UID 0. worker2 # [ 837.709619] systemd[1]: Started Session 118 of User root. worker2 # [ 837.745167] sshd-session[3550]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 837.748131] sshd-session[3550]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 837.749628] sshd-session[3528]: pam_unix(sshd:session): session closed for user root worker2 # [ 837.754754] systemd[1]: sshd-vsock@97-98-6:22-2:97.service: Deactivated successfully. worker2 # [ 837.760771] systemd[1]: session-118.scope: Deactivated successfully. worker2 # [ 837.766255] systemd-logind[515]: Session 118 logged out. Waiting for processes to exit. worker2 # [ 837.769312] systemd-logind[515]: Removed session 118. worker1 # [ 839.610041] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 839.619554] systemd[1]: Started SSH per-connection Daemon (vsock:2:135). worker1 # [ 839.723019] sshd-session[4137]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 839.732309] sshd-session[4137]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 839.742971] sshd-session[4137]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 839.755527] systemd-logind[539]: New session '155' of user 'root' with class 'user' and type 'tty'. worker1 # [ 839.761176] systemd[1]: Started Session 155 of User root. worker1 # [ 839.799822] sshd-session[4143]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 839.801685] sshd-session[4143]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 839.803215] sshd-session[4137]: pam_unix(sshd:session): session closed for user root worker1 # [ 839.808247] systemd[1]: sshd-vsock@135-136-5:22-2:135.service: Deactivated successfully. worker1 # [ 839.813749] systemd[1]: session-155.scope: Deactivated successfully. worker1 # [ 839.816407] systemd[1]: session-155.scope: Consumed 29ms CPU time over 54ms wall clock time, 6.6M memory peak, 12.7K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 839.822522] systemd-logind[539]: Session 155 logged out. Waiting for processes to exit. worker1 # [ 839.823947] systemd-logind[539]: Removed session 155. worker2 # [ 838.383785] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 838.396469] systemd[1]: Started SSH per-connection Daemon (vsock:2:98). worker2 # [ 838.488657] sshd-session[3555]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 838.498172] sshd-session[3555]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 838.507028] sshd-session[3555]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 838.516644] systemd-logind[515]: New session '120' of user 'root' with class 'user' and type 'tty'. worker2 # [ 838.529597] systemd[1]: Started Session 120 of User root. worker2 # [ 838.566594] sshd-session[3561]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 838.569450] sshd-session[3561]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 838.571386] sshd-session[3555]: pam_unix(sshd:session): session closed for user root worker2 # [ 838.575841] systemd[1]: sshd-vsock@98-99-6:22-2:98.service: Deactivated successfully. worker2 # [ 838.581389] systemd[1]: session-120.scope: Deactivated successfully. worker2 # [ 838.583143] systemd[1]: session-120.scope: Consumed 29ms CPU time over 54ms wall clock time, 3.1M memory peak, 19.3K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 838.588688] systemd-logind[515]: Session 120 logged out. Waiting for processes to exit. worker2 # [ 838.590629] systemd-logind[515]: Removed session 120. ok test farm::serial::two_clients_wanting_the_same_drv_build_it_once ... worker1 # [ 841.971691] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 841.980532] systemd[1]: Started SSH per-connection Daemon (vsock:2:136). worker1 # [ 842.081225] sshd-session[4148]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 842.089627] sshd-session[4148]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 842.100837] sshd-session[4148]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 842.112815] systemd-logind[539]: New session '156' of user 'root' with class 'user' and type 'tty'. worker1 # [ 842.123145] systemd[1]: Started Session 156 of User root. worker1 # [ 842.157037] sshd-session[4154]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 842.159967] sshd-session[4154]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 842.162052] sshd-session[4148]: pam_unix(sshd:session): session closed for user root worker1 # [ 842.166154] systemd[1]: sshd-vsock@136-137-5:22-2:136.service: Deactivated successfully. worker1 # [ 842.171922] systemd[1]: session-156.scope: Deactivated successfully. worker1 # [ 842.176956] systemd-logind[539]: Session 156 logged out. Waiting for processes to exit. worker1 # [ 842.179075] systemd-logind[539]: Removed session 156. worker2 # [ 840.859657] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 840.868079] systemd[1]: Started SSH per-connection Daemon (vsock:2:99). worker2 # [ 840.968761] sshd-session[3566]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 840.976888] sshd-session[3566]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 840.987662] sshd-session[3566]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 840.997304] systemd-logind[515]: New session '121' of user 'root' with class 'user' and type 'tty'. worker2 # [ 841.008676] systemd[1]: Started Session 121 of User root. worker2 # [ 841.043140] sshd-session[3572]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 841.046189] sshd-session[3572]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 841.047664] sshd-session[3566]: pam_unix(sshd:session): session closed for user root worker2 # [ 841.052190] systemd[1]: sshd-vsock@99-100-6:22-2:99.service: Deactivated successfully. worker2 # [ 841.057958] systemd[1]: session-121.scope: Deactivated successfully. worker2 # [ 841.062812] systemd-logind[515]: Session 121 logged out. Waiting for processes to exit. worker2 # [ 841.065481] systemd-logind[515]: Removed session 121. lb # [ 845.024748] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 845.031074] systemd[1]: Started SSH per-connection Daemon (vsock:2:62). lb # [ 845.123472] sshd-session[2433]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 845.132598] sshd-session[2433]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 845.140976] sshd-session[2433]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 845.165548] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 845.203355] systemd-logind[499]: New session '87' of user 'root' with class 'user' and type 'tty'. lb # [ 845.214298] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 845.220289] systemd[1]: Starting User Manager for UID 0... lb # [ 845.241464] (systemd)[2442]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 845.247871] systemd-logind[499]: New session '88' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 845.347680] systemd[2442]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 845.448289] systemd[2442]: Queued start job for default target Main User Target. lb # [ 845.457073] systemd[2442]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 845.461208] systemd[2442]: Created slice User Application Slice. lb # [ 845.462310] systemd[2442]: Started Daily Cleanup of User's Temporary Directories. lb # [ 845.463423] systemd[2442]: Reached target Paths. lb # [ 845.467495] systemd[2442]: Reached target Timers. lb # [ 845.472464] systemd[2442]: Starting D-Bus User Message Bus Socket... lb # [ 845.473496] systemd[2442]: Starting Create User Files and Directories... lb # [ 845.516796] systemd[2442]: Listening on D-Bus User Message Bus Socket. lb # [ 845.523186] systemd[2442]: Reached target Sockets. lb # [ 845.526168] systemd[2442]: Finished Create User Files and Directories. lb # [ 845.527218] systemd[2442]: Reached target Basic System. lb # [ 845.528288] systemd[2442]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 845.529779] systemd[2442]: Reached target Main User Target. lb # [ 845.530608] systemd[2442]: Startup finished in 257ms. lb # [ 845.531377] systemd[1]: Started User Manager for UID 0. lb # [ 845.535296] systemd[1]: Started Session 87 of User root. lb # [ 845.566999] sshd-session[2455]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 845.569891] sshd-session[2455]: Disconnected from user root UNKNOWN port 65535 lb # [ 845.572238] sshd-session[2433]: pam_unix(sshd:session): session closed for user root lb # [ 845.576837] systemd[1]: sshd-vsock@62-63-4:22-2:62.service: Deactivated successfully. lb # [ 845.581605] systemd[1]: session-87.scope: Deactivated successfully. lb # [ 845.585006] systemd[1]: session-87.scope: Consumed 26ms CPU time over 50ms wall clock time, 3M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 845.589127] systemd-logind[499]: Session 87 logged out. Waiting for processes to exit. lb # [ 845.590566] systemd-logind[499]: Removed session 87. worker2 # [ 842.920679] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 842.926431] systemd[1]: Started SSH per-connection Daemon (vsock:2:100). worker2 # [ 843.024917] sshd-session[3578]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 843.035637] sshd-session[3578]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 843.045889] sshd-session[3578]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 843.058487] systemd-logind[515]: New session '122' of user 'root' with class 'user' and type 'tty'. worker2 # [ 843.064903] systemd[1]: Started Session 122 of User root. worker2 # [ 843.106463] sshd-session[3584]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 843.109584] sshd-session[3584]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 843.111145] sshd-session[3578]: pam_unix(sshd:session): session closed for user root worker2 # [ 843.115784] systemd[1]: sshd-vsock@100-101-6:22-2:100.service: Deactivated successfully. worker2 # [ 843.122610] systemd[1]: session-122.scope: Deactivated successfully. worker2 # [ 843.124815] systemd[1]: session-122.scope: Consumed 31ms CPU time over 59ms wall clock time, 3.1M memory peak, 19.3K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 843.130643] systemd-logind[515]: Session 122 logged out. Waiting for processes to exit. worker2 # [ 843.133455] systemd-logind[515]: Removed session 122. lb # [ 846.335570] envoy[897]: conn peer=[2001:db8:1::1]:58892 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2777 tx=964 ms=6618 worker1 # [ 846.117540] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 846.126545] systemd[1]: Started SSH per-connection Daemon (vsock:2:137). worker1 # [ 846.224099] sshd-session[4160]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 846.232313] sshd-session[4160]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 846.242504] sshd-session[4160]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 846.251551] systemd-logind[539]: New session '157' of user 'root' with class 'user' and type 'tty'. worker1 # [ 846.258775] systemd[1]: Started Session 157 of User root. worker1 # [ 846.292546] sshd-session[4166]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 846.295102] sshd-session[4166]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 846.297272] sshd-session[4160]: pam_unix(sshd:session): session closed for user root worker1 # [ 846.301158] systemd[1]: sshd-vsock@137-138-5:22-2:137.service: Deactivated successfully. worker1 # [ 846.306769] systemd[1]: session-157.scope: Deactivated successfully. worker1 # [ 846.309114] systemd[1]: session-157.scope: Consumed 27ms CPU time over 51ms wall clock time, 3.1M memory peak, 12.7K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 846.314823] systemd-logind[539]: Session 157 logged out. Waiting for processes to exit. worker1 # [ 846.316321] systemd-logind[539]: Removed session 157. client # [ 846.893225] systemd[1]: Stopping User Manager for UID 0... client # [ 846.900894] systemd[2958]: Activating special unit Exit the Session... client # [ 846.906655] systemd[2958]: Stopped target Main User Target. client # [ 846.911458] systemd[2958]: Stopped target Basic System. client # [ 846.913179] systemd[2958]: Stopped target Paths. client # [ 846.914339] systemd[2958]: Stopped target Sockets. client # [ 846.915483] systemd[2958]: Stopped target Timers. client # [ 846.916886] systemd[2958]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 846.918680] systemd[2958]: Closed D-Bus User Message Bus Socket. client # [ 846.920063] systemd[2958]: Stopped Create User Files and Directories. client # [ 846.921518] systemd[2958]: Removed slice User Application Slice. client # [ 846.922885] systemd[2958]: Reached target Shutdown. client # [ 846.924857] systemd[2958]: Finished Exit the Session. client # [ 846.927016] systemd[2958]: Reached target Exit the Session. client # [ 846.949968] systemd-logind[427]: Removed session 129. client # [ 846.957415] systemd[1]: user@0.service: Deactivated successfully. client # [ 846.962471] systemd[1]: Stopped User Manager for UID 0. client # [ 847.022720] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 847.060496] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 847.065908] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 847.070012] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 845.898666] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 845.907679] systemd[1]: Started SSH per-connection Daemon (vsock:2:101). worker2 # [ 846.004673] sshd-session[3589]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 846.013852] sshd-session[3589]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 846.022436] sshd-session[3589]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 846.032495] systemd-logind[515]: New session '123' of user 'root' with class 'user' and type 'tty'. worker2 # [ 846.041050] systemd[1]: Started Session 123 of User root. worker2 # [ 846.077209] sshd-session[3595]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 846.080514] sshd-session[3595]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 846.081664] sshd-session[3589]: pam_unix(sshd:session): session closed for user root worker2 # [ 846.085892] systemd[1]: sshd-vsock@101-102-6:22-2:101.service: Deactivated successfully. worker2 # [ 846.090710] systemd[1]: session-123.scope: Deactivated successfully. worker2 # [ 846.094028] systemd[1]: session-123.scope: Consumed 27ms CPU time over 51ms wall clock time, 6.8M memory peak, 19.3K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 846.099281] systemd-logind[515]: Session 123 logged out. Waiting for processes to exit. worker2 # [ 846.100806] systemd-logind[515]: Removed session 123. [e2e] heartbeat t=750s client # [ 849.044672] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 849.052165] systemd[1]: Started SSH per-connection Daemon (vsock:2:109). client # [ 849.150266] sshd-session[3020]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 849.160705] sshd-session[3020]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 849.170443] sshd-session[3020]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 849.200483] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 849.234669] systemd-logind[427]: New session '131' of user 'root' with class 'user' and type 'tty'. client # [ 849.246810] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 849.251763] systemd[1]: Starting User Manager for UID 0... client # [ 849.277386] (systemd)[3029]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 849.283568] systemd-logind[427]: New session '132' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 849.370628] systemd[3029]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 849.468179] systemd[3029]: Queued start job for default target Main User Target. client # [ 849.474141] systemd[3029]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 849.475819] systemd[3029]: Created slice User Application Slice. client # [ 849.480604] systemd[3029]: Started Daily Cleanup of User's Temporary Directories. client # [ 849.481741] systemd[3029]: Reached target Paths. client # [ 849.482544] systemd[3029]: Reached target Timers. client # [ 849.483253] systemd[3029]: Starting D-Bus User Message Bus Socket... client # [ 849.488294] systemd[3029]: Starting Create User Files and Directories... client # [ 849.526529] systemd[3029]: Finished Create User Files and Directories. client # [ 849.530913] systemd[3029]: Listening on D-Bus User Message Bus Socket. client # [ 849.536227] systemd[3029]: Reached target Sockets. client # [ 849.537110] systemd[3029]: Reached target Basic System. client # [ 849.537898] systemd[3029]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 849.539431] systemd[3029]: Reached target Main User Target. client # [ 849.540724] systemd[3029]: Startup finished in 234ms. client # [ 849.541484] systemd[1]: Started User Manager for UID 0. client # [ 849.550738] systemd[1]: Started Session 131 of User root. client # [ 849.574300] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.pem&client-key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.key" --eval-store auto -f /nix/store/v7sckhacjvxxq8xv667z4hgvbaqhw2dd-slow.nix --argstr tag dedup. client # [ 849.588960] sshd-session[3042]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 849.590388] sshd-session[3042]: Disconnected from user root UNKNOWN port 65535 client # [ 849.591396] sshd-session[3020]: pam_unix(sshd:session): session closed for user root client # [ 849.595721] systemd[1]: sshd-vsock@109-110-3:22-2:109.service: Deactivated successfully. client # [ 849.605891] systemd[1]: session-131.scope: Deactivated successfully. client # [ 849.613149] systemd-logind[427]: Session 131 logged out. Waiting for processes to exit. client # [ 849.618385] systemd-logind[427]: Removed session 131. worker1 # [ 849.774545] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50846 client # [ 849.775958] nix[3045]: don't know how to build these paths: client # [ 849.777239] nix[3045]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 849.784810] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50846 lb # [ 851.091517] garage[898]: 2026-11-12T09:32:32.849762Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo lb # [ 851.091838] garage[898]: 2026-11-12T09:32:32.850307Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 848.250692] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54948 lb # [ 851.110225] garage[898]: 2026-11-12T09:32:32.869353Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo lb # [ 851.116353] garage[898]: 2026-11-12T09:32:32.869825Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 851.120508] garage[898]: 2026-11-12T09:32:32.875448Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo lb # [ 851.125928] garage[898]: 2026-11-12T09:32:32.875831Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 849.827226] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50846 lb # [ 851.133003] garage[898]: 2026-11-12T09:32:32.892450Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo lb # [ 851.137922] garage[898]: 2026-11-12T09:32:32.892882Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 849.840391] nix[3045]: copying 1 paths to 'lb:50051'... client # [ 849.842536] nix[3045]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker2 # [ 848.292308] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54948 worker2 # [ 848.305426] nix-daemon[976]: accepted connection from pid 3247, user nix-grpc-daemon (trusted) worker2 # [ 848.321024] nix-daemon[976]: accepted connection from pid 3247, user nix-grpc-daemon (trusted) worker2 # [ 848.463592] nix-daemon[976]: accepted connection from pid 3605, user nix-grpc-daemon (trusted) worker2 # [ 848.489476] nix-daemon[976]: reaped child process 3608, status = succeeded lb # [ 851.351438] niks3-server[1454]: 2026/11/12 09:32:33 INFO Received push request method=POST path=/api/pushes worker2 # [ 848.505722] nix-grpc-daemon[3362]: time=2026-11-12T09:32:33.777Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 848.507601] nix-grpc-daemon[3362]: time=2026-11-12T09:32:33.777Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" lb # [ 851.359620] garage[898]: 2026-11-12T09:32:33.118896Z INFO garage_api_common::generic_server: 192.168.1.4:56110 PUT /farm/nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093233Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=de2e1d67a80035d1790479093d88cb7c640a5287686f6817aff48d9531062b1b worker2 # [ 848.523148] nix-grpc-daemon[3362]: time=2026-11-12T09:32:33.795Z level=INFO msg="Uploading 1 narinfos" lb # [ 851.390442] garage[898]: 2026-11-12T09:32:33.129106Z INFO garage_api_common::generic_server: 192.168.1.4:56106 PUT /farm/cp23830c44gs2dw4xy80s5wqyjm7vw84.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093233Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=73a76d6030cfe268dea15cd4b651333c050ed5b09178a7b55c034d2a6849c5df worker2 # [ 848.548640] nix-grpc-daemon[3362]: time=2026-11-12T09:32:33.821Z level=INFO msg="Upload complete. (214ms)" lb # [ 851.401225] garage[898]: 2026-11-12T09:32:33.132655Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst lb # [ 851.406444] garage[898]: 2026-11-12T09:32:33.136567Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/cp23830c44gs2dw4xy80s5wqyjm7vw84.ls worker2 # [ 848.556755] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54948 duration_s=0 paths=1 nar_bytes_in=432 lb # [ 851.411005] garage[898]: 2026-11-12T09:32:33.137149Z INFO garage_api_common::generic_server: 192.168.1.4:56110 PUT /farm/cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093233Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b68c3da446fb43bf7c09d28c027496c57c489c2e2d2d5ea08ea05f5c3d9fed7a lb # [ 851.419516] garage[898]: 2026-11-12T09:32:33.142005Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo lb # [ 851.423715] niks3-server[1454]: 2026/11/12 09:32:33 INFO Received sign narinfos request method=POST path=/api/pushes/86/sign lb # [ 851.426021] niks3-server[1454]: 2026/11/12 09:32:33 INFO Signed narinfos id=86 count=1 lb # [ 851.427795] niks3-server[1454]: 2026/11/12 09:32:33 INFO Received complete push request method=POST path=/api/pushes/86/complete worker2 # [ 848.574762] nix-daemon[976]: reaped child process 3600, status = succeeded lb # [ 851.432470] niks3-server[1454]: 2026/11/12 09:32:33 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 851.435987] niks3-server[1454]: 2026/11/12 09:32:33 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst lb # [ 851.439329] niks3-server[1454]: 2026/11/12 09:32:33 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker2 # [ 848.583466] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:33Z level=debug event=want client=6 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 lb # [ 851.441532] niks3-server[1454]: 2026/11/12 09:32:33 INFO Completed push id=86 objects=3 duration=21.29114ms worker2 # [ 848.588663] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:33Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 848.604718] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54948 worker2 # [ 848.607583] nix-daemon[976]: accepted connection from pid 3247, user nix-grpc-daemon (trusted) client # [ 850.168600] nix[3045]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 848.619367] nix-daemon[976]: accepted connection from pid 3247, user nix-grpc-daemon (trusted) lb # [ 852.324220] garage[898]: 2026-11-12T09:32:34.082589Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo lb # [ 852.328733] garage[898]: 2026-11-12T09:32:34.083044Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 851.845690] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 851.854124] systemd[1]: Started SSH per-connection Daemon (vsock:2:110). client # [ 851.954691] sshd-session[3058]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 851.966762] sshd-session[3058]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 851.975155] sshd-session[3058]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 851.984547] systemd-logind[427]: New session '133' of user 'root' with class 'user' and type 'tty'. client # [ 851.997586] systemd[1]: Started Session 133 of User root. client # [ 852.032459] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.pem&client-key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/ci.key" --eval-store auto -f /nix/store/v7sckhacjvxxq8xv667z4hgvbaqhw2dd-slow.nix --argstr tag dedup. client # [ 852.046509] sshd-session[3064]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 852.047841] sshd-session[3064]: Disconnected from user root UNKNOWN port 65535 client # [ 852.052512] sshd-session[3058]: pam_unix(sshd:session): session closed for user root client # [ 852.056717] systemd[1]: sshd-vsock@110-111-3:22-2:110.service: Deactivated successfully. client # [ 852.068093] systemd[1]: session-133.scope: Deactivated successfully. client # [ 852.075126] systemd-logind[427]: Session 133 logged out. Waiting for processes to exit. client # [ 852.079233] systemd-logind[427]: Removed session 133. client # [ 852.234511] nix[3067]: don't know how to build these paths: worker1 # [ 852.237098] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50846 client # [ 852.236509] nix[3067]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 852.242131] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50846 lb # [ 853.547669] garage[898]: 2026-11-12T09:32:35.306333Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo lb # [ 853.547907] garage[898]: 2026-11-12T09:32:35.306788Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 852.260607] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50846 lb # [ 853.565264] garage[898]: 2026-11-12T09:32:35.325197Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo lb # [ 853.570829] garage[898]: 2026-11-12T09:32:35.330135Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 853.575843] garage[898]: 2026-11-12T09:32:35.334957Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo lb # [ 853.580645] garage[898]: 2026-11-12T09:32:35.335347Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 850.734923] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54948 worker2 # [ 850.750165] nix-daemon[976]: accepted connection from pid 3247, user nix-grpc-daemon (trusted) worker2 # [ 850.772811] nix-grpc-daemon[3362]: time=2026-11-12T09:32:36.045Z level=INFO msg="All 1 paths already cached" worker2 # [ 850.782787] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:36Z level=debug event=want client=7 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 850.786527] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54948 client # [ 852.343336] nix[3067]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... lb # [ 855.806979] systemd[1]: Stopping User Manager for UID 0... lb # [ 855.813420] systemd[2442]: Activating special unit Exit the Session... lb # [ 855.818632] systemd[2442]: Stopped target Main User Target. lb # [ 855.824689] systemd[2442]: Stopped target Basic System. lb # [ 855.826073] systemd[2442]: Stopped target Paths. lb # [ 855.827168] systemd[2442]: Stopped target Sockets. lb # [ 855.828331] systemd[2442]: Stopped target Timers. lb # [ 855.829450] systemd[2442]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 855.831100] systemd[2442]: Closed D-Bus User Message Bus Socket. lb # [ 855.832615] systemd[2442]: Stopped Create User Files and Directories. lb # [ 855.834060] systemd[2442]: Removed slice User Application Slice. lb # [ 855.835412] systemd[2442]: Reached target Shutdown. lb # [ 855.837680] systemd[2442]: Finished Exit the Session. lb # [ 855.838904] systemd[2442]: Reached target Exit the Session. lb # [ 855.865874] systemd-logind[499]: Removed session 88. lb # [ 855.873057] systemd[1]: user@0.service: Deactivated successfully. lb # [ 855.878268] systemd[1]: Stopped User Manager for UID 0. lb # [ 855.946027] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 855.982078] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 855.986811] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 855.990462] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 855.941241] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 855.949514] systemd[1]: Started SSH per-connection Daemon (vsock:2:138). worker1 # [ 856.054602] sshd-session[4171]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 856.064838] sshd-session[4171]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 856.074323] sshd-session[4171]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 856.084662] systemd-logind[539]: New session '158' of user 'root' with class 'user' and type 'tty'. worker1 # [ 856.092965] systemd[1]: Started Session 158 of User root. worker1 # [ 856.127195] sshd-session[4177]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 856.130141] sshd-session[4177]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 856.131566] sshd-session[4171]: pam_unix(sshd:session): session closed for user root worker1 # [ 856.136786] systemd[1]: sshd-vsock@138-139-5:22-2:138.service: Deactivated successfully. worker1 # [ 856.142146] systemd[1]: session-158.scope: Deactivated successfully. worker1 # [ 856.146856] systemd-logind[539]: Session 158 logged out. Waiting for processes to exit. worker1 # [ 856.149630] systemd-logind[539]: Removed session 158. worker2 # [ 855.764684] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 855.770029] systemd[1]: Started SSH per-connection Daemon (vsock:2:102). worker2 # [ 855.903192] sshd-session[3636]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 855.913674] sshd-session[3636]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 855.927508] sshd-session[3636]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 855.940451] systemd-logind[515]: New session '124' of user 'root' with class 'user' and type 'tty'. worker2 # [ 855.946505] systemd[1]: Started Session 124 of User root. worker2 # [ 856.145617] sshd-session[3642]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 856.147119] sshd-session[3642]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 856.152821] sshd-session[3636]: pam_unix(sshd:session): session closed for user root worker2 # [ 856.177859] systemd[1]: sshd-vsock@102-103-6:22-2:102.service: Deactivated successfully. worker2 # [ 856.179180] systemd[1]: session-124.scope: Deactivated successfully. worker2 # [ 856.188273] systemd-logind[515]: Session 124 logged out. Waiting for processes to exit. worker2 # [ 856.189561] systemd-logind[515]: Removed session 124. worker1 # [ 859.815591] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 859.823772] systemd[1]: Started SSH per-connection Daemon (vsock:2:139). worker1 # [ 859.918714] sshd-session[4182]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 859.928178] sshd-session[4182]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 859.937331] sshd-session[4182]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 859.946600] systemd-logind[539]: New session '159' of user 'root' with class 'user' and type 'tty'. worker1 # [ 859.952935] systemd[1]: Started Session 159 of User root. worker1 # [ 859.986053] sshd-session[4188]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 859.988625] sshd-session[4188]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 859.990455] sshd-session[4182]: pam_unix(sshd:session): session closed for user root worker1 # [ 859.994418] systemd[1]: sshd-vsock@139-140-5:22-2:139.service: Deactivated successfully. worker1 # [ 859.999110] systemd[1]: session-159.scope: Deactivated successfully. worker1 # [ 860.003656] systemd-logind[539]: Session 159 logged out. Waiting for processes to exit. worker1 # [ 860.006520] systemd-logind[539]: Removed session 159. worker2 # [ 858.477693] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 858.479138] systemd[1]: Started SSH per-connection Daemon (vsock:2:103). worker2 # [ 858.609141] sshd-session[3647]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 858.619195] sshd-session[3647]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 858.633866] sshd-session[3647]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 858.648793] systemd-logind[515]: New session '125' of user 'root' with class 'user' and type 'tty'. worker2 # [ 858.653188] systemd[1]: Started Session 125 of User root. worker2 # [ 858.832829] sshd-session[3653]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 858.834325] sshd-session[3653]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 858.839498] sshd-session[3647]: pam_unix(sshd:session): session closed for user root worker2 # [ 858.852409] systemd[1]: sshd-vsock@103-104-6:22-2:103.service: Deactivated successfully. worker2 # [ 858.855284] systemd[1]: session-125.scope: Deactivated successfully. worker2 # [ 858.862141] systemd-logind[515]: Session 125 logged out. Waiting for processes to exit. worker2 # [ 858.863436] systemd-logind[515]: Removed session 125. client # [ 860.437627] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 860.445624] systemd[1]: Started SSH per-connection Daemon (vsock:2:111). client # [ 860.542236] sshd-session[3080]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 860.552256] sshd-session[3080]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 860.561381] sshd-session[3080]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 860.571019] systemd-logind[427]: New session '134' of user 'root' with class 'user' and type 'tty'. client # [ 860.580576] systemd[1]: Started Session 134 of User root. client # [ 860.615109] sshd-session[3086]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 860.618194] sshd-session[3086]: Disconnected from user root UNKNOWN port 65535 client # [ 860.619350] sshd-session[3080]: pam_unix(sshd:session): session closed for user root client # [ 860.623637] systemd[1]: sshd-vsock@111-112-3:22-2:111.service: Deactivated successfully. client # [ 860.629557] systemd[1]: session-134.scope: Deactivated successfully. client # [ 860.634225] systemd-logind[427]: Session 134 logged out. Waiting for processes to exit. client # [ 860.637022] systemd-logind[427]: Removed session 134. worker2 # [ 859.132918] nix-daemon[976]: reaped child process 3615, status = succeeded worker2 # [ 859.205011] nix-daemon[976]: accepted connection from pid 3659, user nix-grpc-daemon (trusted) lb # [ 862.081904] niks3-server[1454]: 2026/11/12 09:32:43 INFO Received push request method=POST path=/api/pushes worker2 # [ 859.231186] nix-daemon[976]: reaped child process 3662, status = succeeded worker2 # [ 859.236729] nix-grpc-daemon[3362]: time=2026-11-12T09:32:44.508Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 859.238480] nix-grpc-daemon[3362]: time=2026-11-12T09:32:44.508Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 862.090514] garage[898]: 2026-11-12T09:32:43.849854Z INFO garage_api_common::generic_server: 192.168.1.4:56110 PUT /farm/log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093243Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=06c4c01ac2cd7284c1607f3263875e80fe6b57d07fc51a55d0b4ef2629b317b1 worker2 # [ 859.256002] nix-grpc-daemon[3362]: time=2026-11-12T09:32:44.528Z level=INFO msg="Uploading 1 narinfos" lb # [ 862.117175] garage[898]: 2026-11-12T09:32:43.860408Z INFO garage_api_common::generic_server: 192.168.1.4:56120 PUT /farm/vamz940my4dma9a2daklr9pw9x9pp9hp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093243Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b9f3a6f21a647c1956b64b13f5de5e5065c0837a1dea4be01333bf1951dd949 lb # [ 862.128159] garage[898]: 2026-11-12T09:32:43.861056Z INFO garage_api_common::generic_server: 192.168.1.4:56106 PUT /farm/nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093243Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f66116e9d8c29b96f5b65fd766fb9c5a4a4e353f4e490824c565c6747368c472 worker2 # [ 859.285009] nix-grpc-daemon[3362]: time=2026-11-12T09:32:44.557Z level=INFO msg="Upload complete. (235ms)" lb # [ 862.139415] garage[898]: 2026-11-12T09:32:43.865494Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 862.146041] garage[898]: 2026-11-12T09:32:43.866795Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/vamz940my4dma9a2daklr9pw9x9pp9hp.ls worker2 # [ 859.296856] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54948 duration_s=8 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 862.151201] garage[898]: 2026-11-12T09:32:43.869983Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 862.156170] garage[898]: 2026-11-12T09:32:43.870444Z INFO garage_api_common::generic_server: 192.168.1.4:56106 PUT /farm/vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093243Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0b5cd321093fb65e7ea1446055c642132ae651e2cfda6c0dbbf2efd23cd1c7e2 lb # [ 862.165914] niks3-server[1454]: 2026/11/12 09:32:43 INFO Received sign narinfos request method=POST path=/api/pushes/87/sign worker2 # [ 859.310214] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54948 duration_s=10 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 862.169159] niks3-server[1454]: 2026/11/12 09:32:43 INFO Signed narinfos id=87 count=1 worker2 # [ 859.316637] nix-daemon[976]: reaped child process 3613, status = succeeded lb # [ 862.170872] niks3-server[1454]: 2026/11/12 09:32:43 INFO Received complete push request method=POST path=/api/pushes/87/complete lb # [ 862.174053] niks3-server[1454]: 2026/11/12 09:32:43 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 862.176885] niks3-server[1454]: 2026/11/12 09:32:43 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 862.179419] niks3-server[1454]: 2026/11/12 09:32:43 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 862.182442] niks3-server[1454]: 2026/11/12 09:32:43 INFO Completed push id=87 objects=4 duration=24.89968ms lb # [ 862.184437] niks3-server[1454]: 2026/11/12 09:32:43 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo lb # [ 862.186783] garage[898]: 2026-11-12T09:32:43.876501Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo client # [ 860.900610] systemd[1]: dedup2.service: Deactivated successfully. client # [ 860.905160] systemd[1]: dedup2.service: Consumed 172ms CPU time over 8.870s wall clock time, 30.7M memory peak, 8.2K incoming IP traffic, 7.1K outgoing IP traffic. client # [ 860.912620] systemd[1]: dedup1.service: Deactivated successfully. client # [ 860.914265] systemd[1]: dedup1.service: Consumed 180ms CPU time over 11.336s wall clock time, 38.8M memory peak, 8.7K incoming IP traffic, 8.6K outgoing IP traffic. client # [ 861.224170] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 861.231742] systemd[1]: Started SSH per-connection Daemon (vsock:2:112). client # [ 861.326937] sshd-session[3098]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 861.336832] sshd-session[3098]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 861.345762] sshd-session[3098]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 861.355207] systemd-logind[427]: New session '135' of user 'root' with class 'user' and type 'tty'. client # [ 861.364567] systemd[1]: Started Session 135 of User root. client # [ 861.401164] sshd-session[3104]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 861.404076] sshd-session[3104]: Disconnected from user root UNKNOWN port 65535 client # [ 861.405528] sshd-session[3098]: pam_unix(sshd:session): session closed for user root client # [ 861.410120] systemd[1]: sshd-vsock@112-113-3:22-2:112.service: Deactivated successfully. client # [ 861.415414] systemd[1]: session-135.scope: Deactivated successfully. client # [ 861.420900] systemd-logind[427]: Session 135 logged out. Waiting for processes to exit. client # [ 861.423554] systemd-logind[427]: Removed session 135. client # [ 861.609368] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 861.618019] systemd[1]: Started SSH per-connection Daemon (vsock:2:113). client # [ 861.714973] sshd-session[3110]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 861.724715] sshd-session[3110]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 861.733422] sshd-session[3110]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 861.742703] systemd-logind[427]: New session '136' of user 'root' with class 'user' and type 'tty'. client # [ 861.748543] systemd[1]: Started Session 136 of User root. client # [ 861.779073] sshd-session[3116]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 861.781770] sshd-session[3116]: Disconnected from user root UNKNOWN port 65535 client # [ 861.783197] sshd-session[3110]: pam_unix(sshd:session): session closed for user root client # [ 861.787410] systemd[1]: sshd-vsock@113-114-3:22-2:113.service: Deactivated successfully. client # [ 861.793535] systemd[1]: session-136.scope: Deactivated successfully. client # [ 861.798066] systemd-logind[427]: Session 136 logged out. Waiting for processes to exit. client # [ 861.800509] systemd-logind[427]: Removed session 136. client # [ 862.084994] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 862.092598] systemd[1]: Started SSH per-connection Daemon (vsock:2:114). client # [ 862.202387] sshd-session[3121]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 862.212662] sshd-session[3121]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 862.222386] sshd-session[3121]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 862.231937] systemd-logind[427]: New session '137' of user 'root' with class 'user' and type 'tty'. client # [ 862.240641] systemd[1]: Started Session 137 of User root. client # [ 862.273358] sshd-session[3127]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 862.276421] sshd-session[3127]: Disconnected from user root UNKNOWN port 65535 client # [ 862.277942] sshd-session[3121]: pam_unix(sshd:session): session closed for user root client # [ 862.282424] systemd[1]: sshd-vsock@114-115-3:22-2:114.service: Deactivated successfully. client # [ 862.287774] systemd[1]: session-137.scope: Deactivated successfully. client # [ 862.293271] systemd-logind[427]: Session 137 logged out. Waiting for processes to exit. client # [ 862.296406] systemd-logind[427]: Removed session 137. worker1 # [ 862.344412] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 862.348619] systemd[1]: Started SSH per-connection Daemon (vsock:2:140). worker1 # [ 862.449538] sshd-session[4193]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 862.458030] sshd-session[4193]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 862.468971] sshd-session[4193]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 862.480231] systemd-logind[539]: New session '160' of user 'root' with class 'user' and type 'tty'. worker1 # [ 862.484565] systemd[1]: Started Session 160 of User root. worker1 # [ 862.516651] sshd-session[4199]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 862.519361] sshd-session[4199]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 862.520874] sshd-session[4193]: pam_unix(sshd:session): session closed for user root worker1 # [ 862.525061] systemd[1]: sshd-vsock@140-141-5:22-2:140.service: Deactivated successfully. worker1 # [ 862.530762] systemd[1]: session-160.scope: Deactivated successfully. worker1 # [ 862.535292] systemd-logind[539]: Session 160 logged out. Waiting for processes to exit. worker1 # [ 862.538011] systemd-logind[539]: Removed session 160. worker2 # [ 861.098587] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 861.108418] systemd[1]: Started SSH per-connection Daemon (vsock:2:104). worker2 # [ 861.203794] sshd-session[3664]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 861.213055] sshd-session[3664]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 861.221899] sshd-session[3664]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 861.232504] systemd-logind[515]: New session '126' of user 'root' with class 'user' and type 'tty'. worker2 # [ 861.237155] systemd[1]: Started Session 126 of User root. worker2 # [ 861.267692] sshd-session[3670]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 861.270820] sshd-session[3670]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 861.273106] sshd-session[3664]: pam_unix(sshd:session): session closed for user root worker2 # [ 861.277470] systemd[1]: sshd-vsock@104-105-6:22-2:104.service: Deactivated successfully. worker2 # [ 861.282906] systemd[1]: session-126.scope: Deactivated successfully. worker2 # [ 861.287735] systemd-logind[515]: Session 126 logged out. Waiting for processes to exit. worker2 # [ 861.290814] systemd-logind[515]: Removed session 126. worker1 # [ 862.931757] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 862.940391] systemd[1]: Started SSH per-connection Daemon (vsock:2:141). worker1 # [ 863.032536] sshd-session[4204]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 863.041281] sshd-session[4204]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 863.052088] sshd-session[4204]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 863.063671] systemd-logind[539]: New session '161' of user 'root' with class 'user' and type 'tty'. worker1 # [ 863.069129] systemd[1]: Started Session 161 of User root. worker1 # [ 863.107948] sshd-session[4210]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 863.110100] sshd-session[4210]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 863.112090] sshd-session[4204]: pam_unix(sshd:session): session closed for user root worker1 # [ 863.116536] systemd[1]: sshd-vsock@141-142-5:22-2:141.service: Deactivated successfully. worker1 # [ 863.121779] systemd[1]: session-161.scope: Deactivated successfully. worker1 # [ 863.126559] systemd[1]: session-161.scope: Consumed 29ms CPU time over 54ms wall clock time, 4.8M memory peak, 12.7K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 863.130118] systemd-logind[539]: Session 161 logged out. Waiting for processes to exit. worker1 # [ 863.131305] systemd-logind[539]: Removed session 161. worker2 # [ 861.683501] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 861.691431] systemd[1]: Started SSH per-connection Daemon (vsock:2:105). worker2 # [ 861.789486] sshd-session[3675]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 861.798165] sshd-session[3675]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 861.806569] sshd-session[3675]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 861.816226] systemd-logind[515]: New session '127' of user 'root' with class 'user' and type 'tty'. worker2 # [ 861.824952] systemd[1]: Started Session 127 of User root. worker2 # [ 861.861663] sshd-session[3681]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 861.864338] sshd-session[3681]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 861.865765] sshd-session[3675]: pam_unix(sshd:session): session closed for user root worker2 # [ 861.870377] systemd[1]: sshd-vsock@105-106-6:22-2:105.service: Deactivated successfully. worker2 # [ 861.875521] systemd[1]: session-127.scope: Deactivated successfully. worker2 # [ 861.877646] systemd[1]: session-127.scope: Consumed 27ms CPU time over 52ms wall clock time, 4.8M memory peak, 19.4K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 861.882813] systemd-logind[515]: Session 127 logged out. Waiting for processes to exit. worker2 # [ 861.885385] systemd-logind[515]: Removed session 127. ok test farm::serial::upload_whose_reference_the_worker_lacks_is_completed_from_the_cache ... worker1 # [ 863.533319] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 863.542193] systemd[1]: Started SSH per-connection Daemon (vsock:2:142). worker1 # [ 863.653111] sshd-session[4215]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 863.662202] sshd-session[4215]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 863.673787] sshd-session[4215]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 863.686908] systemd-logind[539]: New session '162' of user 'root' with class 'user' and type 'tty'. worker1 # [ 863.692635] systemd[1]: Started Session 162 of User root. worker1 # [ 863.727372] sshd-session[4221]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 863.730347] sshd-session[4221]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 863.731712] sshd-session[4215]: pam_unix(sshd:session): session closed for user root worker1 # [ 863.736127] systemd[1]: sshd-vsock@142-143-5:22-2:142.service: Deactivated successfully. worker1 # [ 863.742034] systemd[1]: session-162.scope: Deactivated successfully. worker1 # [ 863.746687] systemd-logind[539]: Session 162 logged out. Waiting for processes to exit. worker1 # [ 863.749448] systemd-logind[539]: Removed session 162. worker2 # [ 862.343509] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 862.352452] systemd[1]: Started SSH per-connection Daemon (vsock:2:106). worker2 # [ 862.453039] sshd-session[3686]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 862.461047] sshd-session[3686]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 862.471505] sshd-session[3686]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 862.481672] systemd-logind[515]: New session '128' of user 'root' with class 'user' and type 'tty'. worker2 # [ 862.492737] systemd[1]: Started Session 128 of User root. worker2 # [ 862.535580] sshd-session[3692]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 862.538946] sshd-session[3692]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 862.540723] sshd-session[3686]: pam_unix(sshd:session): session closed for user root worker2 # [ 862.545448] systemd[1]: sshd-vsock@106-107-6:22-2:106.service: Deactivated successfully. worker2 # [ 862.551351] systemd[1]: session-128.scope: Deactivated successfully. worker2 # [ 862.557206] systemd-logind[515]: Session 128 logged out. Waiting for processes to exit. worker2 # [ 862.559826] systemd-logind[515]: Removed session 128. lb # [ 865.526472] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 865.534367] systemd[1]: Started SSH per-connection Daemon (vsock:2:63). lb # [ 865.631740] sshd-session[2472]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 865.641900] sshd-session[2472]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 865.650914] sshd-session[2472]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 865.680559] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 865.715462] systemd-logind[499]: New session '89' of user 'root' with class 'user' and type 'tty'. lb # [ 865.728332] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 865.733329] systemd[1]: Starting User Manager for UID 0... lb # [ 865.763628] (systemd)[2481]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 865.770098] systemd-logind[499]: New session '90' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 865.859823] systemd[2481]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 865.964380] systemd[2481]: Queued start job for default target Main User Target. lb # [ 865.973122] systemd[2481]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 865.977437] systemd[2481]: Created slice User Application Slice. lb # [ 865.978529] systemd[2481]: Started Daily Cleanup of User's Temporary Directories. lb # [ 865.979594] systemd[2481]: Reached target Paths. lb # [ 865.983554] systemd[2481]: Reached target Timers. lb # [ 865.985381] systemd[2481]: Starting D-Bus User Message Bus Socket... lb # [ 865.986355] systemd[2481]: Starting Create User Files and Directories... lb # [ 866.019793] systemd[2481]: Listening on D-Bus User Message Bus Socket. lb # [ 866.021887] systemd[2481]: Reached target Sockets. lb # [ 866.035601] systemd[2481]: Finished Create User Files and Directories. lb # [ 866.037956] systemd[2481]: Reached target Basic System. lb # [ 866.042959] systemd[2481]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 866.047851] systemd[2481]: Reached target Main User Target. lb # [ 866.049902] systemd[2481]: Startup finished in 252ms. lb # [ 866.050719] systemd[1]: Started User Manager for UID 0. lb # [ 866.052468] systemd[1]: Started Session 89 of User root. lb # [ 866.088155] sshd-session[2494]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 866.089947] sshd-session[2494]: Disconnected from user root UNKNOWN port 65535 lb # [ 866.092249] sshd-session[2472]: pam_unix(sshd:session): session closed for user root lb # [ 866.096655] systemd[1]: sshd-vsock@63-64-4:22-2:63.service: Deactivated successfully. lb # [ 866.102235] systemd[1]: session-89.scope: Deactivated successfully. lb # [ 866.104839] systemd[1]: session-89.scope: Consumed 31ms CPU time over 58ms wall clock time, 4.9M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 866.109551] systemd-logind[499]: Session 89 logged out. Waiting for processes to exit. lb # [ 866.112199] systemd-logind[499]: Removed session 89. worker2 # [ 863.292188] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 863.300975] systemd[1]: Started SSH per-connection Daemon (vsock:2:107). worker2 # [ 863.400749] sshd-session[3698]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 863.408355] sshd-session[3698]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 863.418375] sshd-session[3698]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 863.428252] systemd-logind[515]: New session '129' of user 'root' with class 'user' and type 'tty'. worker2 # [ 863.436874] systemd[1]: Started Session 129 of User root. worker2 # [ 863.472985] sshd-session[3704]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 863.474454] sshd-session[3704]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 863.476609] sshd-session[3698]: pam_unix(sshd:session): session closed for user root worker2 # [ 863.480775] systemd[1]: sshd-vsock@107-108-6:22-2:107.service: Deactivated successfully. lb # [ 866.333063] envoy[897]: conn peer=[2001:db8:1::1]:35338 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2141 tx=1612 ms=8645 lb # [ 866.335808] envoy[897]: conn peer=[2001:db8:1::1]:47226 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2882 tx=1593 ms=11109 worker2 # [ 863.485978] systemd[1]: session-129.scope: Deactivated successfully. worker2 # [ 863.489121] systemd[1]: session-129.scope: Consumed 28ms CPU time over 50ms wall clock time, 4.6M memory peak, 19.4K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 863.495328] systemd-logind[515]: Session 129 logged out. Waiting for processes to exit. worker2 # [ 863.496930] systemd-logind[515]: Removed session 129. client # [ 865.281497] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 865.289619] systemd[1]: Started SSH per-connection Daemon (vsock:2:115). client # [ 865.394424] sshd-session[3132]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 865.404691] sshd-session[3132]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 865.413680] sshd-session[3132]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 865.423523] systemd-logind[427]: New session '138' of user 'root' with class 'user' and type 'tty'. client # [ 865.430955] systemd[1]: Started Session 138 of User root. client # [ 865.778381] sshd-session[3138]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 865.781338] sshd-session[3138]: Disconnected from user root UNKNOWN port 65535 client # [ 865.783568] sshd-session[3132]: pam_unix(sshd:session): session closed for user root client # [ 865.787998] systemd[1]: sshd-vsock@115-116-3:22-2:115.service: Deactivated successfully. client # [ 865.793518] systemd[1]: session-138.scope: Deactivated successfully. client # [ 865.798412] systemd-logind[427]: Session 138 logged out. Waiting for processes to exit. client # [ 865.801112] systemd-logind[427]: Removed session 138. client # [ 865.852819] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 865.860865] systemd[1]: Started SSH per-connection Daemon (vsock:2:116). client # [ 865.957816] sshd-session[3153]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 865.966766] sshd-session[3153]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 865.974575] sshd-session[3153]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 865.984746] systemd-logind[427]: New session '139' of user 'root' with class 'user' and type 'tty'. client # [ 865.995636] systemd[1]: Started Session 139 of User root. client # [ 866.331856] sshd-session[3159]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 866.334616] sshd-session[3159]: Disconnected from user root UNKNOWN port 65535 client # [ 866.336770] sshd-session[3153]: pam_unix(sshd:session): session closed for user root client # [ 866.341620] systemd[1]: sshd-vsock@116-117-3:22-2:116.service: Deactivated successfully. client # [ 866.346991] systemd[1]: session-139.scope: Deactivated successfully. client # [ 866.351779] systemd-logind[427]: Session 139 logged out. Waiting for processes to exit. client # [ 866.354606] systemd-logind[427]: Removed session 139. client # [ 866.450494] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 866.459122] systemd[1]: Started SSH per-connection Daemon (vsock:2:117). client # [ 866.553687] sshd-session[3174]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 866.563230] sshd-session[3174]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 866.571804] sshd-session[3174]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 866.580912] systemd-logind[427]: New session '140' of user 'root' with class 'user' and type 'tty'. client # [ 866.592638] systemd[1]: Started Session 140 of User root. client # [ 866.743259] sshd-session[3180]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 866.745982] sshd-session[3180]: Disconnected from user root UNKNOWN port 65535 client # [ 866.747379] sshd-session[3174]: pam_unix(sshd:session): session closed for user root client # [ 866.751515] systemd[1]: sshd-vsock@117-118-3:22-2:117.service: Deactivated successfully. client # [ 866.757092] systemd[1]: session-140.scope: Deactivated successfully. client # [ 866.761548] systemd-logind[427]: Session 140 logged out. Waiting for processes to exit. client # [ 866.763875] systemd-logind[427]: Removed session 140. worker1 # [ 866.897935] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 866.905827] systemd[1]: Started SSH per-connection Daemon (vsock:2:143). worker1 # [ 867.008495] sshd-session[4227]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 867.018447] sshd-session[4227]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 867.027696] sshd-session[4227]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 867.037169] systemd-logind[539]: New session '163' of user 'root' with class 'user' and type 'tty'. worker1 # [ 867.044554] systemd[1]: Started Session 163 of User root. worker1 # [ 867.211038] sshd-session[4233]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 867.214612] sshd-session[4233]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 867.216579] sshd-session[4227]: pam_unix(sshd:session): session closed for user root worker1 # [ 867.221323] systemd[1]: sshd-vsock@143-144-5:22-2:143.service: Deactivated successfully. worker1 # [ 867.227021] systemd[1]: session-163.scope: Deactivated successfully. worker1 # [ 867.232441] systemd-logind[539]: Session 163 logged out. Waiting for processes to exit. worker1 # [ 867.234673] systemd-logind[539]: Removed session 163. worker2 # [ 865.805983] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 865.815053] systemd[1]: Started SSH per-connection Daemon (vsock:2:108). worker2 # [ 865.911322] sshd-session[3709]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 865.920257] sshd-session[3709]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 865.930664] sshd-session[3709]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 865.940509] systemd-logind[515]: New session '130' of user 'root' with class 'user' and type 'tty'. worker2 # [ 865.948974] systemd[1]: Started Session 130 of User root. worker2 # [ 865.974667] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 866.121613] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:51Z level=info event=draining worker2 # [ 866.127462] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:51Z level=info event=signal_exit lb # [ 869.934638] niks3-server[1454]: 2026/11/12 09:32:51 INFO lead: released remote=192.168.1.4:52084 worker1 # [ 869.633846] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:53Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 868.081230] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:53Z level=info event=scheduler_restarting lb # [ 870.933272] envoy[897]: [2026-11-12 09:32:52.690][897][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker2 # [ 868.081573] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:53Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 868.081644] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:53Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:54932 lb # [ 870.933637] envoy[897]: [2026-11-12 09:32:52.691][897][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker2 # [ 868.081748] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:53Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 868.081808] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:53Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:54932 worker2 # [ 868.081864] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:53Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 868.161923] nix-daemon[976]: reaped child process 3316, status = succeeded worker2 # [ 868.163304] nix-daemon[976]: reaped child process 3493, status = succeeded worker2 # [ 868.165369] nix-daemon[976]: reaped child process 3632, status = succeeded worker2 # [ 868.166944] nix-daemon[976]: reaped child process 3413, status = succeeded worker2 # [ 868.168308] nix-daemon[976]: reaped child process 3318, status = succeeded worker2 # [ 868.169444] nix-daemon[976]: reaped child process 3602, status = succeeded worker1 # [ 869.834210] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 869.837730] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 868.297302] nix-grpc-daemon[3247]: ts=2026-11-12T09:32:53Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 870.038506] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 870.041939] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 870.242676] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 870.246162] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 870.446970] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 870.450526] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 870.651956] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 870.654913] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 870.853362] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 870.856699] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 869.495450] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 869.497046] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 871.057352] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 869.502410] systemd[1]: nix-grpc-daemon.service: Consumed 1.545s CPU time over 1min 46.986s wall clock time, 52.9M memory peak, 703.2K incoming IP traffic, 342K outgoing IP traffic. worker1 # [ 871.060305] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 869.520484] sshd-session[3715]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 869.522657] sshd-session[3715]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 869.526684] sshd-session[3709]: pam_unix(sshd:session): session closed for user root worker2 # [ 869.533340] systemd[1]: sshd-vsock@108-109-6:22-2:108.service: Deactivated successfully. worker2 # [ 869.540448] systemd[1]: session-130.scope: Deactivated successfully. worker2 # [ 869.547813] systemd-logind[515]: Session 130 logged out. Waiting for processes to exit. worker2 # [ 869.551389] systemd-logind[515]: Removed session 130. lb # [ 872.458988] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 872.467683] systemd[1]: Started SSH per-connection Daemon (vsock:2:64). worker1 # [ 871.261154] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 871.268469] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 872.576660] sshd-session[2499]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 872.586260] sshd-session[2499]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 872.595068] sshd-session[2499]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 872.605307] systemd-logind[499]: New session '91' of user 'root' with class 'user' and type 'tty'. lb # [ 872.617038] systemd[1]: Started Session 91 of User root. lb # [ 872.657399] sshd-session[2505]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 872.658920] sshd-session[2505]: Disconnected from user root UNKNOWN port 65535 lb # [ 872.660570] sshd-session[2499]: pam_unix(sshd:session): session closed for user root lb # [ 872.665616] systemd[1]: sshd-vsock@64-65-4:22-2:64.service: Deactivated successfully. lb # [ 872.670838] systemd[1]: session-91.scope: Deactivated successfully. lb # [ 872.672796] systemd[1]: session-91.scope: Consumed 31ms CPU time over 55ms wall clock time, 4.8M memory peak, 5.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 872.678746] systemd-logind[499]: Session 91 logged out. Waiting for processes to exit. lb # [ 872.679891] systemd-logind[499]: Removed session 91. worker1 # [ 871.469431] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 871.473157] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 871.675312] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 871.677975] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 871.876225] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 871.879681] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 872.080542] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 872.084257] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 872.284923] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 872.288284] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 872.489002] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 872.492310] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 872.694498] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 872.696994] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 872.895425] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 872.898951] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 874.234319] niks3-server[1454]: 2026/11/12 09:32:55 INFO lead: acquired remote=192.168.1.3:43420 worker1 # [ 873.099574] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 873.103067] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 873.303684] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 873.307064] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 873.507644] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 873.511012] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 873.712677] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 873.715757] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 873.914358] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 873.917859] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 874.118604] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 874.122071] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 874.322824] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 874.326355] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 874.527195] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 874.530691] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 874.732534] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 874.735599] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 874.936470] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 874.939938] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 876.333113] envoy[897]: conn peer=[2001:db8:1::4]:60152 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=43957 tx=2416 ms=105170 client # [ 875.062719] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 875.070727] systemd[1]: Started SSH per-connection Daemon (vsock:2:118). worker1 # [ 875.140660] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 875.144128] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 875.156980] sshd-session[3187]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 875.164754] sshd-session[3187]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 875.172261] sshd-session[3187]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 875.182270] systemd-logind[427]: New session '141' of user 'root' with class 'user' and type 'tty'. client # [ 875.188554] systemd[1]: Started Session 141 of User root. worker1 # [ 875.345506] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 875.350312] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 875.354665] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50846 worker1 # [ 875.357692] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:50846 client # [ 875.369521] sshd-session[3193]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 875.372211] sshd-session[3193]: Disconnected from user root UNKNOWN port 65535 client # [ 875.373654] sshd-session[3187]: pam_unix(sshd:session): session closed for user root client # [ 875.377808] systemd[1]: sshd-vsock@118-119-3:22-2:118.service: Deactivated successfully. client # [ 875.382704] systemd[1]: session-141.scope: Deactivated successfully. client # [ 875.385594] systemd[1]: session-141.scope: Consumed 147ms CPU time over 195ms wall clock time, 27.6M memory peak, 5.8K incoming IP traffic, 4.1K outgoing IP traffic. client # [ 875.390561] systemd-logind[427]: Session 141 logged out. Waiting for processes to exit. client # [ 875.391764] systemd-logind[427]: Removed session 141. worker1 # [ 875.550027] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 875.553516] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 875.755812] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 875.758359] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 875.956589] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 875.959989] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 876.160738] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 876.164233] nix-grpc-daemon[3803]: ts=2026-11-12T09:32:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 876.364588] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 876.367974] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 876.568839] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 876.572342] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 876.774706] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 876.777617] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 876.975166] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 876.979253] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 877.179897] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 877.183636] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 877.289866] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 877.297080] systemd[4119]: Activating special unit Exit the Session... worker1 # [ 877.303404] systemd[4119]: Stopped target Main User Target. worker1 # [ 877.307837] systemd[4119]: Stopped target Basic System. worker1 # [ 877.309350] systemd[4119]: Stopped target Paths. worker1 # [ 877.310485] systemd[4119]: Stopped target Sockets. worker1 # [ 877.311630] systemd[4119]: Stopped target Timers. worker1 # [ 877.313304] systemd[4119]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 877.315138] systemd[4119]: Closed D-Bus User Message Bus Socket. worker1 # [ 877.316630] systemd[4119]: Stopped Create User Files and Directories. worker1 # [ 877.318102] systemd[4119]: Removed slice User Application Slice. worker1 # [ 877.319426] systemd[4119]: Reached target Shutdown. worker1 # [ 877.321313] systemd[4119]: Finished Exit the Session. worker1 # [ 877.322752] systemd[4119]: Reached target Exit the Session. worker1 # [ 877.353201] systemd-logind[539]: Removed session 154. worker1 # [ 877.358775] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 877.364301] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 877.374638] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 877.384631] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 877.394628] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 877.418332] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 877.423403] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 877.428610] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 877.592193] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 877.595585] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 877.797600] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 877.800301] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 877.998520] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 878.002103] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" [e2e] heartbeat t=780s worker1 # [ 878.202730] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 878.206069] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 878.406546] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 878.410461] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 878.611135] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 878.614622] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 878.816603] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 878.819087] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 879.017488] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 879.020992] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 879.221854] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 879.225289] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 879.425952] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 879.429220] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 879.629877] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 879.633235] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 879.835045] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 879.837506] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 880.035648] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 880.039113] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 880.239798] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 880.243457] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 880.444136] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 880.447590] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 880.648325] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 880.651816] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 880.853557] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 880.856174] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 881.054520] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 881.058027] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 879.585151] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 879.591189] systemd[3536]: Activating special unit Exit the Session... worker2 # [ 879.597931] systemd[3536]: Stopped target Main User Target. worker2 # [ 879.599369] systemd[3536]: Stopped target Basic System. worker2 # [ 879.603710] systemd[3536]: Stopped target Paths. worker2 # [ 879.605870] systemd[3536]: Stopped target Sockets. worker2 # [ 879.607053] systemd[3536]: Stopped target Timers. worker2 # [ 879.608596] systemd[3536]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 879.610395] systemd[3536]: Closed D-Bus User Message Bus Socket. worker2 # [ 879.612279] systemd[3536]: Stopped Create User Files and Directories. worker2 # [ 879.613931] systemd[3536]: Removed slice User Application Slice. worker2 # [ 879.615443] systemd[3536]: Reached target Shutdown. worker2 # [ 879.616819] systemd[3536]: Finished Exit the Session. worker2 # [ 879.618081] systemd[3536]: Reached target Exit the Session. worker2 # [ 879.627197] systemd-logind[515]: Removed session 119. worker2 # [ 879.635242] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 879.640929] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 879.658874] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 879.702004] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 881.258872] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 879.707316] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 881.262407] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 879.712823] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 881.463188] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 881.467174] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 882.806846] systemd[1]: Stopping User Manager for UID 0... lb # [ 882.814457] systemd[2481]: Activating special unit Exit the Session... lb # [ 882.819435] systemd[2481]: Stopped target Main User Target. lb # [ 882.825946] systemd[2481]: Stopped target Basic System. lb # [ 882.827363] systemd[2481]: Stopped target Paths. lb # [ 882.829310] systemd[2481]: Stopped target Sockets. lb # [ 882.830495] systemd[2481]: Stopped target Timers. lb # [ 882.831603] systemd[2481]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 882.833620] systemd[2481]: Closed D-Bus User Message Bus Socket. lb # [ 882.834996] systemd[2481]: Stopped Create User Files and Directories. lb # [ 882.838834] systemd[2481]: Removed slice User Application Slice. lb # [ 882.840501] systemd[2481]: Reached target Shutdown. lb # [ 882.841618] systemd[2481]: Finished Exit the Session. lb # [ 882.842754] systemd[2481]: Reached target Exit the Session. lb # [ 882.846376] systemd-logind[499]: Removed session 90. lb # [ 882.857113] systemd[1]: user@0.service: Deactivated successfully. lb # [ 882.862159] systemd[1]: Stopped User Manager for UID 0. lb # [ 882.918609] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 882.957235] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 882.962482] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 882.966570] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 881.667941] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 881.671473] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 881.873060] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 881.876178] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 882.074624] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 882.078754] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 880.695073] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 880.703360] systemd[1]: Started SSH per-connection Daemon (vsock:2:109). worker1 # [ 882.279474] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 882.283250] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 880.807419] sshd-session[3730]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 880.815826] sshd-session[3730]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 880.826753] sshd-session[3730]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 880.844371] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 880.859796] systemd-logind[515]: New session '131' of user 'root' with class 'user' and type 'tty'. worker2 # [ 880.885979] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 880.894695] systemd[1]: Starting User Manager for UID 0... worker2 # [ 880.933828] (systemd)[3738]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 882.489112] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 880.940952] systemd-logind[515]: New session '132' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 882.493243] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 881.038423] systemd[3738]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 881.140321] systemd[3738]: Queued start job for default target Main User Target. worker1 # [ 882.694451] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 882.698035] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 881.149397] systemd[3738]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 881.154015] systemd[3738]: Created slice User Application Slice. worker2 # [ 881.155145] systemd[3738]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 881.160943] systemd[3738]: Reached target Paths. worker2 # [ 881.161818] systemd[3738]: Reached target Timers. worker2 # [ 881.162615] systemd[3738]: Starting D-Bus User Message Bus Socket... worker2 # [ 881.168247] systemd[3738]: Starting Create User Files and Directories... worker2 # [ 881.219447] systemd[3738]: Finished Create User Files and Directories. worker2 # [ 881.222282] systemd[3738]: Listening on D-Bus User Message Bus Socket. worker2 # [ 881.225241] systemd[3738]: Reached target Sockets. worker2 # [ 881.226189] systemd[3738]: Reached target Basic System. worker2 # [ 881.227043] systemd[3738]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 881.232391] systemd[3738]: Reached target Main User Target. worker2 # [ 881.233431] systemd[3738]: Startup finished in 265ms. worker2 # [ 881.234306] systemd[1]: Started User Manager for UID 0. worker2 # [ 881.239719] systemd[1]: Started Session 131 of User root. worker2 # [ 881.257092] sshd-session[3751]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 881.260883] sshd-session[3751]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 881.262191] sshd-session[3730]: pam_unix(sshd:session): session closed for user root worker2 # [ 881.266379] systemd[1]: sshd-vsock@109-110-6:22-2:109.service: Deactivated successfully. worker2 # [ 881.273044] systemd[1]: session-131.scope: Deactivated successfully. worker2 # [ 881.278138] systemd-logind[515]: Session 131 logged out. Waiting for processes to exit. worker2 # [ 881.281269] systemd-logind[515]: Removed session 131. worker1 # [ 882.900121] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 882.902901] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 882.934254] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:06Z level=info event=scheduler_take_over worker1 # [ 883.100974] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 883.104557] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 883.305195] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 883.308912] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 883.509504] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 883.513366] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 883.714353] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 883.717821] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 883.919519] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 883.932292] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:07Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:46920 worker1 # [ 883.935455] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:07Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 883.206040] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 883.215038] systemd[1]: Started SSH per-connection Daemon (vsock:2:110). worker2 # [ 883.305848] sshd-session[3756]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 883.313421] sshd-session[3756]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 883.323181] sshd-session[3756]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 883.331993] systemd-logind[515]: New session '133' of user 'root' with class 'user' and type 'tty'. worker2 # [ 883.340578] systemd[1]: Started Session 133 of User root. worker2 # [ 883.370135] systemd[1]: Starting scheduler-token.service... worker2 # [ 883.420480] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 883.422670] systemd[1]: Finished scheduler-token.service. worker2 # [ 883.427451] systemd[1]: scheduler-token.service: Consumed 29ms CPU time over 52ms wall clock time, 4.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 883.438337] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 886.334798] envoy[897]: conn peer=[2001:db8:1::1]:36596 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=18 worker2 # [ 883.551273] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:08Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 883.554090] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:08Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 883.558551] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:08Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 883.567593] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:08Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 883.599074] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 883.621042] sshd-session[3762]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 883.622465] systemd[1]: sshd-vsock@110-111-6:22-2:110.service: Deactivated successfully. worker2 # [ 883.632619] sshd-session[3762]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 883.633928] systemd[1]: session-133.scope: Deactivated successfully. worker2 # [ 883.634931] sshd-session[3756]: pam_unix(sshd:session): session closed for user root worker2 # [ 883.639855] systemd-logind[515]: Session 133 logged out. Waiting for processes to exit. worker2 # [ 883.644173] systemd-logind[515]: Removed session 133. worker2 # [ 883.645093] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 885.206289] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:08Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 885.206556] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:08Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:46920 worker1 # [ 885.206687] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux,riscv64-linux max_jobs=1 running=0 worker1 # [ 885.218169] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 885.226344] systemd[1]: Started SSH per-connection Daemon (vsock:2:144). worker1 # [ 885.329212] sshd-session[4244]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 885.338807] sshd-session[4244]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 885.350718] sshd-session[4244]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 885.374421] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 885.380480] systemd-logind[539]: New session '164' of user 'root' with class 'user' and type 'tty'. worker1 # [ 885.412511] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 885.418970] systemd[1]: Starting User Manager for UID 0... worker1 # [ 885.445563] (systemd)[4252]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 885.451153] systemd-logind[539]: New session '165' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 885.547026] systemd[4252]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 885.646525] systemd[4252]: Queued start job for default target Main User Target. client # [ 885.643254] systemd[1]: Stopping User Manager for UID 0... client # [ 885.651592] systemd[3029]: Activating special unit Exit the Session... worker1 # [ 885.657095] systemd[4252]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 885.660731] systemd[4252]: Created slice User Application Slice. worker1 # [ 885.661816] systemd[4252]: Started Daily Cleanup of User's Temporary Directories. client # [ 885.658118] systemd[3029]: Stopped target Main User Target. worker1 # [ 885.662960] systemd[4252]: Reached target Paths. client # [ 885.659579] systemd[3029]: Stopped target Basic System. worker1 # [ 885.667054] systemd[4252]: Reached target Timers. client # [ 885.663730] systemd[3029]: Stopped target Paths. worker1 # [ 885.667991] systemd[4252]: Starting D-Bus User Message Bus Socket... client # [ 885.665695] systemd[3029]: Stopped target Sockets. worker1 # [ 885.670244] systemd[4252]: Starting Create User Files and Directories... client # [ 885.666872] systemd[3029]: Stopped target Timers. client # [ 885.667970] systemd[3029]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 885.670775] systemd[3029]: Closed D-Bus User Message Bus Socket. client # [ 885.672375] systemd[3029]: Stopped Create User Files and Directories. client # [ 885.673942] systemd[3029]: Removed slice User Application Slice. client # [ 885.675285] systemd[3029]: Reached target Shutdown. client # [ 885.676583] systemd[3029]: Finished Exit the Session. client # [ 885.677776] systemd[3029]: Reached target Exit the Session. client # [ 885.698747] systemd-logind[427]: Removed session 132. client # [ 885.706610] systemd[1]: user@0.service: Deactivated successfully. client # [ 885.712593] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 885.716788] systemd[4252]: Finished Create User Files and Directories. worker1 # [ 885.722582] systemd[4252]: Listening on D-Bus User Message Bus Socket. worker1 # [ 885.723738] systemd[4252]: Reached target Sockets. worker1 # [ 885.731090] systemd[4252]: Reached target Basic System. worker1 # [ 885.734013] systemd[4252]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 885.738096] systemd[4252]: Reached target Main User Target. worker1 # [ 885.739092] systemd[4252]: Startup finished in 255ms. worker1 # [ 885.739906] systemd[1]: Started User Manager for UID 0. worker1 # [ 885.742020] systemd[1]: Started Session 164 of User root. worker1 # [ 885.760251] systemd[1]: Stopping Nix worker-protocol over gRPC... client # [ 885.775762] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 885.817834] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 885.823645] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. client # [ 885.827977] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 885.988946] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:09Z level=info event=draining worker1 # [ 885.992110] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:09Z level=info event=signal_exit lb # [ 888.245452] niks3-server[1454]: 2026/11/12 09:33:09 INFO lead: released remote=192.168.1.3:43420 worker2 # [ 886.389909] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:11Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 887.946434] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:11Z level=info event=scheduler_restarting worker1 # [ 887.946723] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:11Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 887.946791] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:46920 worker1 # [ 887.954645] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:11Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 887.954792] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:46920 worker1 # [ 887.954849] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:11Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 888.003947] nix-daemon[1059]: reaped child process 3978, status = succeeded worker1 # [ 888.012171] nix-daemon[1059]: reaped child process 3881, status = succeeded worker1 # [ 888.013476] nix-daemon[1059]: reaped child process 4084, status = succeeded worker1 # [ 888.014790] nix-daemon[1059]: reaped child process 3992, status = succeeded worker2 # [ 886.590310] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 886.594210] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 888.157050] nix-grpc-daemon[3803]: ts=2026-11-12T09:33:11Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 886.795012] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 886.798553] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 886.999742] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 887.003607] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 887.204799] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 887.208413] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 887.410631] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 887.413219] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 889.153112] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 889.154292] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 889.155780] systemd[1]: nix-grpc-daemon.service: Consumed 1.386s CPU time over 2min 46.360s wall clock time, 47.9M memory peak, 156.8K incoming IP traffic, 216.6K outgoing IP traffic. worker2 # [ 887.611735] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 887.615189] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 889.174768] sshd-session[4265]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 889.178708] sshd-session[4265]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 889.181771] sshd-session[4244]: pam_unix(sshd:session): session closed for user root worker1 # [ 889.187918] systemd[1]: sshd-vsock@144-145-5:22-2:144.service: Deactivated successfully. worker1 # [ 889.196332] systemd[1]: session-164.scope: Deactivated successfully. worker1 # [ 889.202682] systemd-logind[539]: Session 164 logged out. Waiting for processes to exit. worker1 # [ 889.205943] systemd-logind[539]: Removed session 164. worker2 # [ 887.816440] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 887.819877] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 888.020975] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 888.024424] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 888.225506] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 888.229736] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 888.432283] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 888.434845] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 891.434150] niks3-server[1454]: 2026/11/12 09:33:13 INFO lead: acquired remote=192.168.1.4:35872 worker2 # [ 888.633393] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 888.636987] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 888.838005] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 888.841807] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 889.042652] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 889.046115] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 889.247036] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 889.250508] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 889.453155] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 889.455671] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 892.329914] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 892.337944] systemd[1]: Started SSH per-connection Daemon (vsock:2:65). lb # [ 892.441208] sshd-session[2517]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 892.451886] sshd-session[2517]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 892.460756] sshd-session[2517]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 892.488517] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 889.654257] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 889.657780] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 892.522925] systemd-logind[499]: New session '92' of user 'root' with class 'user' and type 'tty'. lb # [ 892.534352] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 892.541301] systemd[1]: Starting User Manager for UID 0... lb # [ 892.565055] (systemd)[2526]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 892.570215] systemd-logind[499]: New session '93' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 892.663200] systemd[2526]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 889.858702] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 889.862214] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 892.763029] systemd[2526]: Queued start job for default target Main User Target. lb # [ 892.773017] systemd[2526]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 892.775959] systemd[2526]: Created slice User Application Slice. lb # [ 892.777145] systemd[2526]: Started Daily Cleanup of User's Temporary Directories. lb # [ 892.779694] systemd[2526]: Reached target Paths. lb # [ 892.780632] systemd[2526]: Reached target Timers. lb # [ 892.783109] systemd[2526]: Starting D-Bus User Message Bus Socket... lb # [ 892.785478] systemd[2526]: Starting Create User Files and Directories... lb # [ 892.827802] systemd[2526]: Listening on D-Bus User Message Bus Socket. lb # [ 892.830583] systemd[2526]: Reached target Sockets. lb # [ 892.831372] systemd[2526]: Finished Create User Files and Directories. lb # [ 892.836456] systemd[2526]: Reached target Basic System. lb # [ 892.837539] systemd[2526]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 892.839112] systemd[2526]: Reached target Main User Target. lb # [ 892.839952] systemd[2526]: Startup finished in 247ms. lb # [ 892.843775] systemd[1]: Started User Manager for UID 0. lb # [ 892.847118] systemd[1]: Started Session 92 of User root. lb # [ 892.874932] sshd-session[2539]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 892.877325] sshd-session[2539]: Disconnected from user root UNKNOWN port 65535 lb # [ 892.879375] sshd-session[2517]: pam_unix(sshd:session): session closed for user root lb # [ 892.883391] systemd[1]: sshd-vsock@65-66-4:22-2:65.service: Deactivated successfully. lb # [ 892.888415] systemd[1]: session-92.scope: Deactivated successfully. lb # [ 892.890060] systemd[1]: session-92.scope: Consumed 25ms CPU time over 48ms wall clock time, 3.1M memory peak, 5.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 892.895115] systemd-logind[499]: Session 92 logged out. Waiting for processes to exit. lb # [ 892.897803] systemd-logind[499]: Removed session 92. worker2 # [ 890.063211] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 890.066929] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 890.267922] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 890.271303] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 890.473740] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 890.476159] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 890.674610] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 890.678072] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 893.643789] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 893.652998] systemd[1]: Started SSH per-connection Daemon (vsock:2:66). worker2 # [ 890.878974] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 890.882388] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 893.746590] sshd-session[2544]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 893.755895] sshd-session[2544]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 893.764819] sshd-session[2544]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 893.776291] systemd-logind[499]: New session '94' of user 'root' with class 'user' and type 'tty'. lb # [ 893.780559] systemd[1]: Started Session 94 of User root. lb # [ 893.817642] sshd-session[2550]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 893.820261] sshd-session[2550]: Disconnected from user root UNKNOWN port 65535 lb # [ 893.821838] sshd-session[2544]: pam_unix(sshd:session): session closed for user root lb # [ 893.835459] systemd[1]: sshd-vsock@66-67-4:22-2:66.service: Deactivated successfully. lb # [ 893.841415] systemd[1]: session-94.scope: Deactivated successfully. lb # [ 893.843349] systemd[1]: session-94.scope: Consumed 28ms CPU time over 62ms wall clock time, 3.1M memory peak, 5.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 893.849588] systemd-logind[499]: Session 94 logged out. Waiting for processes to exit. lb # [ 893.850853] systemd-logind[499]: Removed session 94. worker2 # [ 891.083434] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 891.087025] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 891.288186] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 891.291481] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 891.493984] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 891.496543] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 891.695130] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 891.698673] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 891.899595] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 891.903098] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 892.104190] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 892.107408] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 892.308328] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 892.311458] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 892.513922] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 892.516357] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 895.505414] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 895.513887] systemd[1]: Started SSH per-connection Daemon (vsock:2:67). worker2 # [ 892.715160] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 892.718732] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 895.601627] sshd-session[2555]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 895.610379] sshd-session[2555]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 895.618011] sshd-session[2555]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 895.628733] systemd-logind[499]: New session '95' of user 'root' with class 'user' and type 'tty'. lb # [ 895.632589] systemd[1]: Started Session 95 of User root. lb # [ 895.667310] sshd-session[2561]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 895.671808] sshd-session[2561]: Disconnected from user root UNKNOWN port 65535 lb # [ 895.673417] sshd-session[2555]: pam_unix(sshd:session): session closed for user root lb # [ 895.676774] systemd[1]: sshd-vsock@67-68-4:22-2:67.service: Deactivated successfully. lb # [ 895.682506] systemd[1]: session-95.scope: Deactivated successfully. lb # [ 895.685596] systemd[1]: session-95.scope: Consumed 27ms CPU time over 51ms wall clock time, 4.8M memory peak, 5.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 895.689780] systemd-logind[499]: Session 95 logged out. Waiting for processes to exit. lb # [ 895.691974] systemd-logind[499]: Removed session 95. worker2 # [ 892.919667] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 892.923303] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 893.124247] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 893.127586] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 893.328861] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 893.332598] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 896.336330] envoy[897]: conn peer=[2001:db8:1::3]:54606 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=18366 tx=5065 ms=165162 worker2 # [ 893.534446] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 893.538000] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 893.738900] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 893.742497] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 893.834858] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 893.841911] systemd[3738]: Activating special unit Exit the Session... worker2 # [ 893.843655] systemd[3738]: Stopped target Main User Target. worker2 # [ 893.852500] systemd[3738]: Stopped target Basic System. worker2 # [ 893.854018] systemd[3738]: Stopped target Paths. worker2 # [ 893.855275] systemd[3738]: Stopped target Sockets. worker2 # [ 893.856762] systemd[3738]: Stopped target Timers. worker2 # [ 893.857955] systemd[3738]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 893.859722] systemd[3738]: Closed D-Bus User Message Bus Socket. worker2 # [ 893.862214] systemd[3738]: Stopped Create User Files and Directories. worker2 # [ 893.864179] systemd[3738]: Removed slice User Application Slice. worker2 # [ 893.865767] systemd[3738]: Reached target Shutdown. worker2 # [ 893.867098] systemd[3738]: Finished Exit the Session. worker2 # [ 893.868688] systemd[3738]: Reached target Exit the Session. worker2 # [ 893.893989] systemd-logind[515]: Removed session 132. worker2 # [ 893.902052] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 893.905543] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 893.926470] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 893.944769] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 893.950130] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 893.969752] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 893.973333] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 893.979230] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 894.151024] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 894.154875] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 894.356103] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 894.359508] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 894.562014] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 894.564875] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 894.762789] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 894.766426] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 894.967347] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 894.970929] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 895.172250] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 895.175661] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 895.376851] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 895.380516] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 895.582315] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 895.586196] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 895.787337] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 895.791033] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 895.992104] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 895.995590] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 898.858891] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 898.867210] systemd[1]: Started SSH per-connection Daemon (vsock:2:68). lb # [ 898.966424] sshd-session[2566]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 898.976676] sshd-session[2566]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 898.985823] sshd-session[2566]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 898.994895] systemd-logind[499]: New session '96' of user 'root' with class 'user' and type 'tty'. lb # [ 899.000580] systemd[1]: Started Session 96 of User root. lb # [ 899.037293] sshd-session[2572]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 899.039853] sshd-session[2572]: Disconnected from user root UNKNOWN port 65535 lb # [ 899.041511] sshd-session[2566]: pam_unix(sshd:session): session closed for user root lb # [ 899.045997] systemd[1]: sshd-vsock@68-69-4:22-2:68.service: Deactivated successfully. worker2 # [ 896.196592] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:21Z level=info event=scheduler_connected addr=lb:50051 lb # [ 899.051590] systemd[1]: session-96.scope: Deactivated successfully. worker2 # [ 896.199828] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 899.055035] systemd[1]: session-96.scope: Consumed 28ms CPU time over 52ms wall clock time, 3.1M memory peak, 5.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 899.060269] systemd-logind[499]: Session 96 logged out. Waiting for processes to exit. lb # [ 899.061577] systemd-logind[499]: Removed session 96. worker2 # [ 896.400980] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 896.404262] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 896.606395] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 896.609103] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 896.807514] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 896.811236] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 897.012498] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 897.015979] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 900.039775] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 900.047881] systemd[1]: Started SSH per-connection Daemon (vsock:2:69). lb # [ 900.055925] systemd[1]: Starting Cleanup of Temporary Directories... worker2 # [ 897.216985] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 897.220580] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 900.203998] systemd[1]: systemd-tmpfiles-clean.service: Deactivated successfully. lb # [ 900.206768] systemd[1]: Finished Cleanup of Temporary Directories. lb # [ 900.215863] sshd-session[2577]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 900.223785] sshd-session[2577]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 900.230589] sshd-session[2577]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 900.239844] systemd-logind[499]: New session '97' of user 'root' with class 'user' and type 'tty'. lb # [ 900.245283] systemd[1]: Started Session 97 of User root. worker2 # [ 897.421475] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:22Z level=info event=scheduler_connected addr=lb:50051 lb # [ 900.278445] sshd-session[2585]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 897.424988] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 900.281059] sshd-session[2585]: Disconnected from user root UNKNOWN port 65535 lb # [ 900.282516] sshd-session[2577]: pam_unix(sshd:session): session closed for user root lb # [ 900.287060] systemd[1]: sshd-vsock@69-70-4:22-2:69.service: Deactivated successfully. lb # [ 900.292561] systemd[1]: session-97.scope: Deactivated successfully. lb # [ 900.294224] systemd[1]: session-97.scope: Consumed 26ms CPU time over 49ms wall clock time, 3.1M memory peak, 5.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 900.299409] systemd-logind[499]: Session 97 logged out. Waiting for processes to exit. lb # [ 900.302119] systemd-logind[499]: Removed session 97. worker2 # [ 897.626976] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 897.629653] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 899.289426] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 899.297684] systemd[4252]: Activating special unit Exit the Session... worker1 # [ 899.299401] systemd[4252]: Stopped target Main User Target. worker1 # [ 899.303871] systemd[4252]: Stopped target Basic System. worker1 # [ 899.307262] systemd[4252]: Stopped target Paths. worker1 # [ 899.310278] systemd[4252]: Stopped target Sockets. worker1 # [ 899.311478] systemd[4252]: Stopped target Timers. worker1 # [ 899.312936] systemd[4252]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 899.314759] systemd[4252]: Closed D-Bus User Message Bus Socket. worker1 # [ 899.317089] systemd[4252]: Stopped Create User Files and Directories. worker1 # [ 899.318648] systemd[4252]: Removed slice User Application Slice. worker1 # [ 899.320201] systemd[4252]: Reached target Shutdown. worker1 # [ 899.321386] systemd[4252]: Finished Exit the Session. worker1 # [ 899.322606] systemd[4252]: Reached target Exit the Session. worker1 # [ 899.349730] systemd-logind[539]: Removed session 165. worker1 # [ 899.357199] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 899.362727] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 899.378831] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 897.828064] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 897.831217] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 899.420666] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 899.426324] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 899.432190] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 898.032357] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 898.035593] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 898.236560] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 898.240321] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 898.441134] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 898.444407] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 898.580136] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:23Z level=info event=scheduler_take_over worker2 # [ 898.646948] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 898.649575] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 901.589447] envoy[897]: [2026-11-12 09:33:23.348][897][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:227] StreamEndpoints gRPC config stream to sched closed since 30s ago: 14, no healthy upstream{no_healthy_upstream} worker2 # [ 898.848085] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 898.851382] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 899.052418] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 899.055727] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 899.256877] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 899.267210] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:24Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 899.270100] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:24Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:45408 worker2 # [ 899.273227] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:24Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux,riscv64-linux max_jobs=1 running=0 lb # [ 902.540583] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 902.548877] systemd[1]: Started SSH per-connection Daemon (vsock:2:70). lb # [ 902.647441] sshd-session[2590]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 902.657618] sshd-session[2590]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 902.666478] sshd-session[2590]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 902.676474] systemd-logind[499]: New session '98' of user 'root' with class 'user' and type 'tty'. lb # [ 902.686894] systemd[1]: Started Session 98 of User root. lb # [ 902.720877] sshd-session[2596]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 902.723579] sshd-session[2596]: Disconnected from user root UNKNOWN port 65535 lb # [ 902.725131] sshd-session[2590]: pam_unix(sshd:session): session closed for user root lb # [ 902.729416] systemd[1]: sshd-vsock@70-71-4:22-2:70.service: Deactivated successfully. lb # [ 902.734786] systemd[1]: session-98.scope: Deactivated successfully. lb # [ 902.736619] systemd[1]: session-98.scope: Consumed 28ms CPU time over 51ms wall clock time, 4.8M memory peak, 5.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 902.742019] systemd-logind[499]: Session 98 logged out. Waiting for processes to exit. lb # [ 902.744395] systemd-logind[499]: Removed session 98. worker1 # [ 901.541731] systemd[1]: Starting Cleanup of Temporary Directories... worker1 # [ 901.643109] systemd[1]: systemd-tmpfiles-clean.service: Deactivated successfully. worker1 # [ 901.646069] systemd[1]: Finished Cleanup of Temporary Directories. lb # [ 903.406616] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 903.416317] systemd[1]: Started SSH per-connection Daemon (vsock:2:71). worker2 # [ 900.582903] systemd[1]: Starting Cleanup of Temporary Directories... lb # [ 903.514243] sshd-session[2601]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 903.524897] sshd-session[2601]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 900.691445] systemd[1]: systemd-tmpfiles-clean.service: Deactivated successfully. lb # [ 903.548239] sshd-session[2601]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 900.696594] systemd[1]: Finished Cleanup of Temporary Directories. lb # [ 903.556161] systemd-logind[499]: New session '99' of user 'root' with class 'user' and type 'tty'. lb # [ 903.566025] systemd[1]: Started Session 99 of User root. lb # [ 903.605133] sshd-session[2607]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 903.606685] sshd-session[2607]: Disconnected from user root UNKNOWN port 65535 lb # [ 903.608391] sshd-session[2601]: pam_unix(sshd:session): session closed for user root lb # [ 903.613026] systemd[1]: sshd-vsock@71-72-4:22-2:71.service: Deactivated successfully. lb # [ 903.618062] systemd[1]: session-99.scope: Deactivated successfully. lb # [ 903.621312] systemd[1]: session-99.scope: Consumed 30ms CPU time over 54ms wall clock time, 3.1M memory peak, 5.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 903.625502] systemd-logind[499]: Session 99 logged out. Waiting for processes to exit. lb # [ 903.627636] systemd-logind[499]: Removed session 99. worker2 # [ 901.757306] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:27Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:45422 lb # [ 907.692336] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 907.696647] systemd[1]: Started SSH per-connection Daemon (vsock:2:72). lb # [ 907.801185] sshd-session[2613]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 907.809389] sshd-session[2613]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 907.816923] sshd-session[2613]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 907.825373] systemd-logind[499]: New session '100' of user 'root' with class 'user' and type 'tty'. lb # [ 907.837375] systemd[1]: Started Session 100 of User root. lb # [ 907.872676] sshd-session[2619]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 907.874350] sshd-session[2619]: Disconnected from user root UNKNOWN port 65535 lb # [ 907.875884] sshd-session[2613]: pam_unix(sshd:session): session closed for user root lb # [ 907.879953] systemd[1]: sshd-vsock@72-73-4:22-2:72.service: Deactivated successfully. lb # [ 907.885604] systemd[1]: session-100.scope: Deactivated successfully. lb # [ 907.889001] systemd[1]: session-100.scope: Consumed 27ms CPU time over 50ms wall clock time, 3.1M memory peak, 5K incoming IP traffic, 486B outgoing IP traffic. lb # [ 907.893196] systemd-logind[499]: Session 100 logged out. Waiting for processes to exit. lb # [ 907.894450] systemd-logind[499]: Removed session 100. worker2 # [ 905.090873] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:30Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:45422 [e2e] heartbeat t=810s client # [ 908.244943] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 908.252994] systemd[1]: Started SSH per-connection Daemon (vsock:2:119). client # [ 908.265073] systemd[1]: Starting Cleanup of Temporary Directories... client # [ 908.404578] sshd-session[3212]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 908.408934] systemd[1]: systemd-tmpfiles-clean.service: Deactivated successfully. client # [ 908.412613] systemd[1]: Finished Cleanup of Temporary Directories. client # [ 908.417939] sshd-session[3212]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 908.426227] sshd-session[3212]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 908.452238] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 908.480658] systemd-logind[427]: New session '142' of user 'root' with class 'user' and type 'tty'. client # [ 908.491029] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 908.500876] systemd[1]: Starting User Manager for UID 0... client # [ 908.525173] (systemd)[3223]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 908.530912] systemd-logind[427]: New session '143' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 908.627328] systemd[3223]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 908.727626] systemd[3223]: Queued start job for default target Main User Target. client # [ 908.733034] systemd[3223]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 908.737053] systemd[3223]: Created slice User Application Slice. client # [ 908.738112] systemd[3223]: Started Daily Cleanup of User's Temporary Directories. client # [ 908.739171] systemd[3223]: Reached target Paths. client # [ 908.739852] systemd[3223]: Reached target Timers. client # [ 908.745832] systemd[3223]: Starting D-Bus User Message Bus Socket... client # [ 908.746830] systemd[3223]: Starting Create User Files and Directories... client # [ 908.791726] systemd[3223]: Finished Create User Files and Directories. client # [ 908.796591] systemd[3223]: Listening on D-Bus User Message Bus Socket. client # [ 908.801511] systemd[3223]: Reached target Sockets. client # [ 908.802409] systemd[3223]: Reached target Basic System. client # [ 908.803222] systemd[3223]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 908.804768] systemd[3223]: Reached target Main User Target. client # [ 908.805698] systemd[3223]: Startup finished in 251ms. client # [ 908.806439] systemd[1]: Started User Manager for UID 0. client # [ 908.809500] systemd[1]: Started Session 142 of User root. worker2 # [ 907.428828] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45432 worker2 # [ 907.438552] nix-daemon[976]: accepted connection from pid 3768, user nix-grpc-daemon (trusted) worker2 # [ 907.454989] nix-grpc-daemon[3768]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 77 ms (attempt 1/5) worker2 # [ 907.538164] nix-grpc-daemon[3768]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 2/5) worker2 # [ 907.604821] nix-grpc-daemon[3768]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 6 ms (attempt 3/5) worker2 # [ 907.616639] nix-grpc-daemon[3768]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 364 ms (attempt 4/5) worker2 # [ 907.983171] nix-grpc-daemon[3768]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 907.987477] nix-grpc-daemon[3768]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 910.848754] garage[898]: 2026-11-12T09:33:32.607134Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/4qa29zdvdyy3f250b3qmy0x9ghdm3rmf.narinfo lb # [ 910.849062] garage[898]: 2026-11-12T09:33:32.607621Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 910.857741] garage[898]: 2026-11-12T09:33:32.617209Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/knczd713xmm4vwdnh5lh4hf0hvnacm1b.narinfo lb # [ 910.862580] garage[898]: 2026-11-12T09:33:32.617628Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 908.016783] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45432 worker2 # [ 908.028713] nix-daemon[976]: accepted connection from pid 3768, user nix-grpc-daemon (trusted) worker2 # [ 908.053378] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:33Z level=info event=niks3_push_started pid=3837 worker2 # [ 908.209648] nix-grpc-daemon[3837]: time=2026-11-12T09:33:33.482Z level=INFO msg="Configuring client TLS" cert=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker2.pem key=/nix/store/c96qc7dz8nww0hikbkmizmah7z9r3vxf-farm-certs/worker2.key ca="" worker2 # [ 908.339435] nix-daemon[976]: accepted connection from pid 3850, user nix-grpc-daemon (trusted) worker2 # [ 908.363695] nix-daemon[976]: reaped child process 3853, status = succeeded lb # [ 911.224257] niks3-server[1454]: 2026/11/12 09:33:32 INFO Received push request method=POST path=/api/pushes worker2 # [ 908.382098] nix-grpc-daemon[3837]: time=2026-11-12T09:33:33.652Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 908.383921] nix-grpc-daemon[3837]: time=2026-11-12T09:33:33.652Z level=INFO msg="Uploading 4qa29zdvdyy3f250b3qmy0x9ghdm3rmf-refers-to-input-viacache (184B)" worker2 # [ 908.388622] nix-grpc-daemon[3837]: time=2026-11-12T09:33:33.653Z level=INFO msg="Uploading knczd713xmm4vwdnh5lh4hf0hvnacm1b-local-input-viacache (128B)" lb # [ 911.246321] garage[898]: 2026-11-12T09:33:33.005615Z INFO garage_api_common::generic_server: 192.168.1.4:49732 PUT /farm/knczd713xmm4vwdnh5lh4hf0hvnacm1b.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093332Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e41acd40433c9cbaa53dbebf5dbfa0c8cddfac1e887021a798ea3f84c3087e8d lb # [ 911.273285] garage[898]: 2026-11-12T09:33:33.015081Z INFO garage_api_common::generic_server: 192.168.1.4:49720 PUT /farm/4qa29zdvdyy3f250b3qmy0x9ghdm3rmf.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093332Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2ef55c57644c5ed62c9dc85b209acb6bceb76c81ced93d5c61ccf6c77fe84ad9 worker2 # [ 908.445720] nix-grpc-daemon[3837]: time=2026-11-12T09:33:33.717Z level=INFO msg="Uploading 2 narinfos" lb # [ 911.307579] garage[898]: 2026-11-12T09:33:33.015564Z INFO garage_api_common::generic_server: 192.168.1.4:49724 PUT /farm/nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093332Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e6ac8e370bf29f2935a9f523031df4ba07d6c4c48951bf5fc32ab5789818ea6 worker2 # [ 908.463999] nix-grpc-daemon[3837]: time=2026-11-12T09:33:33.736Z level=INFO msg="Upload complete. (249ms)" worker2 # [ 908.472777] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45432 duration_s=0 paths=2 nar_bytes_in=312 lb # [ 911.329779] garage[898]: 2026-11-12T09:33:33.015886Z INFO garage_api_common::generic_server: 192.168.1.4:49730 PUT /farm/nar/0fjxhq38wi9z8dvrpzvpxdjw97n1pkhc4sinsjg18c80m7qzzl7h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093332Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=14042313ed3a140c52c3d380d786604d4dea441a09a8a44eca4f0dd647adf76a lb # [ 911.336867] garage[898]: 2026-11-12T09:33:33.021302Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/knczd713xmm4vwdnh5lh4hf0hvnacm1b.ls worker2 # [ 908.485692] nix-daemon[976]: reaped child process 3835, status = succeeded lb # [ 911.339621] garage[898]: 2026-11-12T09:33:33.023976Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/4qa29zdvdyy3f250b3qmy0x9ghdm3rmf.ls lb # [ 911.342612] garage[898]: 2026-11-12T09:33:33.027872Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/nar/0fjxhq38wi9z8dvrpzvpxdjw97n1pkhc4sinsjg18c80m7qzzl7h.nar.zst lb # [ 911.345887] niks3-server[1454]: 2026/11/12 09:33:33 INFO Received sign narinfos request method=POST path=/api/pushes/88/sign lb # [ 911.347521] niks3-server[1454]: 2026/11/12 09:33:33 INFO Registered completed upload object_key=knczd713xmm4vwdnh5lh4hf0hvnacm1b.ls lb # [ 911.349625] niks3-server[1454]: 2026/11/12 09:33:33 INFO Registered completed upload object_key=4qa29zdvdyy3f250b3qmy0x9ghdm3rmf.ls lb # [ 911.351362] niks3-server[1454]: 2026/11/12 09:33:33 INFO Registered completed upload object_key=nar/0fjxhq38wi9z8dvrpzvpxdjw97n1pkhc4sinsjg18c80m7qzzl7h.nar.zst lb # [ 911.353526] niks3-server[1454]: 2026/11/12 09:33:33 INFO Signed narinfos id=88 count=2 lb # [ 911.354669] niks3-server[1454]: 2026/11/12 09:33:33 INFO Received complete push request method=POST path=/api/pushes/88/complete lb # [ 911.356344] niks3-server[1454]: 2026/11/12 09:33:33 INFO Completed push id=88 objects=6 duration=13.84448ms client # [ 910.053210] sshd-session[3236]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 911.357735] niks3-server[1454]: 2026/11/12 09:33:33 INFO Registered completed upload object_key=4qa29zdvdyy3f250b3qmy0x9ghdm3rmf.narinfo client # [ 910.053639] sshd-session[3236]: Disconnected from user root UNKNOWN port 65535 lb # [ 911.359714] niks3-server[1454]: 2026/11/12 09:33:33 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 911.361973] niks3-server[1454]: 2026/11/12 09:33:33 INFO Registered completed upload object_key=knczd713xmm4vwdnh5lh4hf0hvnacm1b.narinfo client # [ 910.058505] sshd-session[3212]: pam_unix(sshd:session): session closed for user root lb # [ 911.363746] garage[898]: 2026-11-12T09:33:33.058918Z INFO garage_api_common::generic_server: 127.0.0.1:33272 (key GK0123456789abcdef01234567) HEAD /farm/nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst client # [ 910.065915] systemd[1]: sshd-vsock@119-120-3:22-2:119.service: Deactivated successfully. lb # [ 911.367185] garage[898]: 2026-11-12T09:33:33.059508Z INFO garage_api_common::generic_server: 192.168.1.4:49720 PUT /farm/4qa29zdvdyy3f250b3qmy0x9ghdm3rmf.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093332Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e7e382518dbc4d10d20f54d15eba2c773bddc3fa9df608b16e186778784d8255 client # [ 910.073281] systemd[1]: session-142.scope: Deactivated successfully. lb # [ 911.373054] garage[898]: 2026-11-12T09:33:33.060267Z INFO garage_api_common::generic_server: 192.168.1.4:49730 PUT /farm/knczd713xmm4vwdnh5lh4hf0hvnacm1b.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261112%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261112T093332Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=beb98dd26a68240b59aea65b1536a366eb9bf9fa8fd2df3d898f2bfb5aa78e83 lb # [ 911.379060] garage[898]: 2026-11-12T09:33:33.077384Z INFO garage_api_common::generic_server: 127.0.0.1:33272 (key GK0123456789abcdef01234567) HEAD /farm/knczd713xmm4vwdnh5lh4hf0hvnacm1b.narinfo lb # [ 911.381910] garage[898]: 2026-11-12T09:33:33.077865Z INFO garage_api_common::generic_server: 127.0.0.1:33738 (key GK0123456789abcdef01234567) HEAD /farm/4qa29zdvdyy3f250b3qmy0x9ghdm3rmf.narinfo client # [ 910.077970] systemd[1]: session-142.scope: Consumed 167ms CPU time over 1.266s wall clock time, 35.6M memory peak, 5.8K incoming IP traffic, 5K outgoing IP traffic. client # [ 910.086002] systemd-logind[427]: Session 142 logged out. Waiting for processes to exit. client # [ 910.087829] systemd-logind[427]: Removed session 142. worker2 # [ 909.446964] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 909.453102] systemd[1]: Started SSH per-connection Daemon (vsock:2:111). worker2 # [ 909.542759] sshd-session[3855]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 909.551643] sshd-session[3855]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 909.559440] sshd-session[3855]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 909.575302] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 909.589541] systemd-logind[515]: New session '134' of user 'root' with class 'user' and type 'tty'. worker2 # [ 909.613250] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 909.620813] systemd[1]: Starting User Manager for UID 0... worker2 # [ 909.649973] (systemd)[3863]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 909.655458] systemd-logind[515]: New session '135' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 909.747711] systemd[3863]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 909.848417] systemd[3863]: Queued start job for default target Main User Target. worker2 # [ 909.853062] systemd[3863]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 909.857555] systemd[3863]: Created slice User Application Slice. worker2 # [ 909.858653] systemd[3863]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 909.859760] systemd[3863]: Reached target Paths. worker2 # [ 909.863289] systemd[3863]: Reached target Timers. worker2 # [ 909.868312] systemd[3863]: Starting D-Bus User Message Bus Socket... worker2 # [ 909.869415] systemd[3863]: Starting Create User Files and Directories... worker2 # [ 909.915279] systemd[3863]: Finished Create User Files and Directories. worker2 # [ 909.919444] systemd[3863]: Listening on D-Bus User Message Bus Socket. worker2 # [ 909.922178] systemd[3863]: Reached target Sockets. worker2 # [ 909.923002] systemd[3863]: Reached target Basic System. worker2 # [ 909.923918] systemd[3863]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 909.925840] systemd[3863]: Reached target Main User Target. worker2 # [ 909.927776] systemd[3863]: Startup finished in 245ms. worker2 # [ 909.931519] systemd[1]: Started User Manager for UID 0. worker2 # [ 909.935087] systemd[1]: Started Session 134 of User root. worker2 # [ 909.947134] sshd-session[3876]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 909.950614] sshd-session[3876]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 909.951716] sshd-session[3855]: pam_unix(sshd:session): session closed for user root worker2 # [ 909.957023] systemd[1]: sshd-vsock@111-112-6:22-2:111.service: Deactivated successfully. worker2 # [ 909.961021] systemd[1]: session-134.scope: Deactivated successfully. worker2 # [ 909.964863] systemd-logind[515]: Session 134 logged out. Waiting for processes to exit. worker2 # [ 909.968321] systemd-logind[515]: Removed session 134. worker2 # [ 911.856223] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 911.860762] systemd[1]: Started SSH per-connection Daemon (vsock:2:112). worker2 # [ 911.962575] sshd-session[3881]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 911.972237] sshd-session[3881]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 911.982667] sshd-session[3881]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 911.994372] systemd-logind[515]: New session '136' of user 'root' with class 'user' and type 'tty'. worker2 # [ 912.001330] systemd[1]: Started Session 136 of User root. worker2 # [ 912.021344] sshd-session[3887]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 912.023334] sshd-session[3887]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 912.025695] sshd-session[3881]: pam_unix(sshd:session): session closed for user root worker2 # [ 912.030059] systemd[1]: sshd-vsock@112-113-6:22-2:112.service: Deactivated successfully. worker2 # [ 912.034917] systemd[1]: session-136.scope: Deactivated successfully. worker2 # [ 912.040418] systemd-logind[515]: Session 136 logged out. Waiting for processes to exit. worker2 # [ 912.042810] systemd-logind[515]: Removed session 136. worker1 # [ 914.289434] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 914.297903] systemd[1]: Started SSH per-connection Daemon (vsock:2:145). worker1 # [ 914.394310] sshd-session[4282]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 914.402575] sshd-session[4282]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 914.413258] sshd-session[4282]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 914.428848] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 914.441292] systemd-logind[539]: New session '166' of user 'root' with class 'user' and type 'tty'. worker1 # [ 914.464733] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 914.472582] systemd[1]: Starting User Manager for UID 0... worker1 # [ 914.497766] (systemd)[4290]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 914.504317] systemd-logind[539]: New session '167' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 914.590685] systemd[4290]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 914.703516] systemd[4290]: Queued start job for default target Main User Target. worker1 # [ 914.709162] systemd[4290]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 914.713997] systemd[4290]: Created slice User Application Slice. worker1 # [ 914.715100] systemd[4290]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 914.718585] systemd[4290]: Reached target Paths. worker1 # [ 914.719370] systemd[4290]: Reached target Timers. worker1 # [ 914.721675] systemd[4290]: Starting D-Bus User Message Bus Socket... worker1 # [ 914.722656] systemd[4290]: Starting Create User Files and Directories... worker1 # [ 914.768764] systemd[4290]: Finished Create User Files and Directories. worker1 # [ 914.773601] systemd[4290]: Listening on D-Bus User Message Bus Socket. worker1 # [ 914.776389] systemd[4290]: Reached target Sockets. worker1 # [ 914.777245] systemd[4290]: Reached target Basic System. worker1 # [ 914.778161] systemd[1]: Started User Manager for UID 0. worker1 # [ 914.778937] systemd[4290]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 914.783492] systemd[4290]: Reached target Main User Target. worker1 # [ 914.784617] systemd[4290]: Startup finished in 257ms. worker1 # [ 914.790901] systemd[1]: Started Session 166 of User root. worker1 # [ 914.820133] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 914.931067] nix-grpc-daemon[4306]: ts=2026-11-12T09:33:38Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 914.933930] nix-grpc-daemon[4306]: ts=2026-11-12T09:33:38Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 914.938398] nix-grpc-daemon[4306]: ts=2026-11-12T09:33:38Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 914.947438] nix-grpc-daemon[4306]: ts=2026-11-12T09:33:38Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 914.972454] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 914.973704] sshd-session[4303]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 914.974920] sshd-session[4303]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 914.975892] sshd-session[4282]: pam_unix(sshd:session): session closed for user root worker1 # [ 915.013876] systemd[1]: sshd-vsock@145-146-5:22-2:145.service: Deactivated successfully. worker1 # [ 915.015143] systemd[1]: session-166.scope: Deactivated successfully. worker1 # [ 915.019603] systemd-logind[539]: Session 166 logged out. Waiting for processes to exit. worker1 # [ 915.023802] systemd-logind[539]: Removed session 166. worker1 # [ 915.024908] nix-grpc-daemon[4306]: ts=2026-11-12T09:33:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 913.475827] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:38Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:45408 worker2 # [ 913.479089] nix-grpc-daemon[3768]: ts=2026-11-12T09:33:38Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb # [ 916.333617] envoy[897]: conn peer=[2001:db8:1::1]:57562 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1012 tx=306 ms=1068 lb # [ 917.065318] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 917.073721] systemd[1]: Started SSH per-connection Daemon (vsock:2:73). lb # [ 917.173463] sshd-session[2631]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 917.182954] sshd-session[2631]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 917.192556] sshd-session[2631]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 917.204523] systemd-logind[499]: New session '101' of user 'root' with class 'user' and type 'tty'. lb # [ 917.209489] systemd[1]: Started Session 101 of User root. lb # [ 917.245780] sshd-session[2637]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 917.249439] sshd-session[2637]: Disconnected from user root UNKNOWN port 65535 lb # [ 917.250582] sshd-session[2631]: pam_unix(sshd:session): session closed for user root lb # [ 917.254558] systemd[1]: sshd-vsock@73-74-4:22-2:73.service: Deactivated successfully. lb # [ 917.260384] systemd[1]: session-101.scope: Deactivated successfully. lb # [ 917.263514] systemd[1]: session-101.scope: Consumed 29ms CPU time over 53ms wall clock time, 4.8M memory peak, 5.8K incoming IP traffic, 486B outgoing IP traffic. lb # [ 917.269207] systemd-logind[499]: Session 101 logged out. Waiting for processes to exit. lb # [ 917.270437] systemd-logind[499]: Removed session 101. ok test result: ok. 22 passed; 0 failed; 0 ignored; 0 measured; 42 filtered out; finished in 819.64s [962.14s] (finished: subtest: scheduler and lifecycle, in 820.06 seconds) [962.14s] (finished: run the VM test script, in 959.42 seconds) [962.53s] test script finished in 959.82s [962.54s] cleanup [962.54s] kill QemuMachine (pid 48) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lq2fsnmg0q3y0vlxn91w8s8wvj1m6fld-python3-3.14.8/bin/python3.14) client # [2026-11-12T09:33:40Z INFO virtiofsd] Client disconnected, shutting down client # [2026-11-12T09:33:40Z INFO virtiofsd] Client disconnected, shutting down client # [2026-11-12T09:33:40Z INFO virtiofsd] Client disconnected, shutting down [963.39s] kill QemuMachine (pid 54) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lq2fsnmg0q3y0vlxn91w8s8wvj1m6fld-python3-3.14.8/bin/python3.14) lb # [2026-11-12T09:33:41Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-11-12T09:33:41Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-11-12T09:33:41Z INFO virtiofsd] Client disconnected, shutting down [964.38s] kill QemuMachine (pid 56) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lq2fsnmg0q3y0vlxn91w8s8wvj1m6fld-python3-3.14.8/bin/python3.14) worker1 # [2026-11-12T09:33:42Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-11-12T09:33:42Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-11-12T09:33:42Z INFO virtiofsd] Client disconnected, shutting down [965.78s] kill QemuMachine (pid 57) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lq2fsnmg0q3y0vlxn91w8s8wvj1m6fld-python3-3.14.8/bin/python3.14) worker2 # [2026-11-12T09:33:43Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-11-12T09:33:43Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-11-12T09:33:43Z INFO virtiofsd] Client disconnected, shutting down [966.64s] (finished: cleanup, in 4.11 seconds) SSH backdoor enabled, the machines can be accessed like this: Note: this requires systemd-ssh-proxy(1) to be enabled (default on NixOS 25.05 and newer). client: ssh -o User=root vsock-mux//build/tmpdhnzra0c/client_host.socket lb: ssh -o User=root vsock-mux//build/tmpdhnzra0c/lb_host.socket worker1: ssh -o User=root vsock-mux//build/tmpdhnzra0c/worker1_host.socket worker2: ssh -o User=root vsock-mux//build/tmpdhnzra0c/worker2_host.socket additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh