tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.01 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm client # Disk image does not exist, creating the virtualisation disk image... client: QEMU running (pid 47) client # Formatting '/build/vm-state-client/tmp.2JMM0S3H3y', fmt=raw size=1073741824 client # mke2fs 1.47.4 (6-Mar-2025) client # Discarding device blocks: 0/262144 done client # Creating filesystem with 262144 4k blocks and 65536 inodes client # Filesystem UUID: 32f2a617-6fbd-4a16-9ba5-91b9449d1caa client # Superblock backups stored on blocks: client # 32768, 98304, 163840, 229376 client # client # Allocating group tables: 0/8 done client # Writing inode tables: 0/8 done client # Creating journal (8192 blocks): done client # Writing superblocks and filesystem accounting information: 0/8 done client # client # Virtualisation disk image created. lb # Disk image does not exist, creating the virtualisation disk image... lb # Formatting '/build/vm-state-lb/tmp.MoTCHbbL5O', fmt=raw size=1073741824 lb # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/262144 done lb # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Filesystem UUID: fa3e8856-a0fc-4d3d-b184-d1a9aa0fd7fb lb # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376 lb # lb # Allocating group tables: 0/8 done lb # Writing inode tables: 0/8 done lb # Creating journal (8192 blocks): done lb # Writing superblocks and filesystem accounting information: 0/8 done lb # lb # Virtualisation disk image created. lb: QEMU running (pid 48) worker1 # Disk image does not exist, creating the virtualisation disk image... worker1 # Formatting '/build/vm-state-worker1/tmp.HF8Hg2fLQB', fmt=raw size=1073741824 worker1 # mke2fs 1.47.4 (6-Mar-2025) worker1 # Discarding device blocks: 0/262144 done worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1: QEMU running (pid 51) worker1 # Filesystem UUID: 69078a81-8b9f-412b-ab7e-fd25acca65d4 worker1 # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 worker1 # worker1 # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done worker1 # Creating journal (8192 blocks): done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # worker1 # Virtualisation disk image created. worker2 # Disk image does not exist, creating the virtualisation disk image... worker2 # Formatting '/build/vm-state-worker2/tmp.eR6CEbyeyf', fmt=raw size=1073741824 worker2 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Discarding device blocks: 0/262144 done worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Filesystem UUID: a2eb04b8-245c-4270-8a4f-96b8e59e5161 worker2 # Superblock backups stored on blocks: worker2 # 32768, 98304, 163840, 229376 worker2 # worker2 # Allocating group tables: 0/8 done worker2 # Writing inode tables: 0/8 done worker2 # Creating journal (8192 blocks): done worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # worker2 # Virtualisation disk image created. worker2: QEMU running (pid 53) (finished: start all VMs, in 3.23 seconds) client: waiting for unit network-addresses-eth1.service client: waiting for the VM to finish booting client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] KASLR enabled client # [ 0.000000] random: crng init done client # [ 0.000000] Machine model: linux,dummy-virt client # [ 0.000000] efi: UEFI not found. client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] Zone ranges: client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] DMA32 empty client # [ 0.000000] Normal empty client # [ 0.000000] Device empty client # [ 0.000000] Movable zone start for each node client # [ 0.000000] Early memory node ranges client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 client # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/a8gc22jhjd6rmf0wand1fsy50rgzy95i-nixos-system-client-test/init regInfo=/nix/store/wd1ka8jlsww7njwm410558vz4bsfdhn5-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/wd1ka8jlsww7njwm410558vz4bsfdhn5-closure-info/registration", will be passed to user space. client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 client # [ 0.000000] Policy zone: DMA client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000050] arm-pv: using stolen time PV client # [ 0.001015] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.001224] Console: colour dummy device 80x25 client # [ 0.001235] printk: legacy console [tty0] enabled client # [ 0.001446] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.001453] pid_max: default: 32768 minimum: 301 client # [ 0.001537] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.001777] landlock: Up and running. client # [ 0.001780] Yama: becoming mindful. client # [ 0.002766] LSM support for eBPF active client # [ 0.003040] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.003073] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.005109] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.005900] rcu: Hierarchical SRCU implementation. client # [ 0.005904] rcu: Max phase no-delay instances is 1000. client # [ 0.007182] fsl-mc MSI: its@8080000 domain created client # [ 0.007283] EFI services will not be available. client # [ 0.007418] smp: Bringing up secondary CPUs ... client # [ 0.007428] smp: Brought up 1 node, 1 CPU client # [ 0.007432] SMP: Total of 1 processors activated. client # [ 0.007437] CPU: All CPU(s) started at EL1 client # [ 0.007453] CPU features: detected: Branch Target Identification client # [ 0.007458] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.007461] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.007465] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.007469] CPU features: detected: Common not Private translations client # [ 0.007472] CPU features: detected: CRC32 instructions client # [ 0.007474] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.007478] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.007482] CPU features: detected: Data independent timing control (DIT) client # [ 0.007485] CPU features: detected: E0PD client # [ 0.007487] CPU features: detected: Enhanced Counter Virtualization client # [ 0.007490] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.007493] CPU features: detected: Enhanced Virtualization Traps client # [ 0.007496] CPU features: detected: Fine Grained Traps client # [ 0.007500] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.007506] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.007509] CPU features: detected: LSE atomic instructions client # [ 0.007512] CPU features: detected: Privileged Access Never client # [ 0.007514] CPU features: detected: PMUv3 client # [ 0.007517] CPU features: detected: RAS Extension Support client # [ 0.007520] CPU features: detected: RASv1p1 Extension Support client # [ 0.007522] CPU features: detected: Random Number Generator client # [ 0.007525] CPU features: detected: Speculation barrier (SB) client # [ 0.007528] CPU features: detected: Stage-2 Force Write-Back client # [ 0.007531] CPU features: detected: TLB range maintenance instructions client # [ 0.007536] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.007578] alternatives: applying system-wide alternatives client # [ 0.010734] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.010910] Memory: 1406512K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) client # [ 0.011678] devtmpfs: initialized client # [ 0.013556] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.013586] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.013826] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.013831] 0 pages in range for non-PLT usage client # [ 0.013832] 508288 pages in range for PLT usage client # [ 0.013942] pinctrl core: initialized pinctrl subsystem client # [ 0.014850] DMI not present or invalid. client # [ 0.018970] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.021434] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.021656] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.021871] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.021908] audit: initializing netlink subsys (disabled) client # [ 0.022620] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.022623] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.022627] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.022632] thermal_sys: Registered thermal governor 'user_space' client # [ 0.022635] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.022673] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.022684] cpuidle: using governor ladder client # [ 0.022689] cpuidle: using governor menu client # [ 0.022915] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.022955] ASID allocator initialised with 65536 entries client # [ 0.024393] Serial: AMBA PL011 UART driver client # [ 0.029988] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.030174] printk: console [ttyAMA0] enabled client # [ 0.159705] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.159733] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.159738] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.159743] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.159747] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.159751] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.159755] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.159759] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.237551] fbcon: Taking over console client # [ 0.237590] ACPI: Interpreter disabled. client # [ 0.239655] iommu: Default domain type: Translated client # [ 0.239669] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.241477] SCSI subsystem initialized client # [ 0.268576] usbcore: registered new interface driver usbfs client # [ 0.268638] usbcore: registered new interface driver hub client # [ 0.268666] usbcore: registered new device driver usb client # [ 0.269065] pps_core: LinuxPPS API ver. 1 registered client # [ 0.269072] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.269083] PTP clock support registered client # [ 0.269134] EDAC MC: Ver: 3.0.0 client # [ 0.282238] scmi_core: SCMI protocol bus registered client # [ 0.283515] FPGA manager framework client # [ 0.284609] vgaarb: loaded client # [ 0.285328] clocksource: Switched to clocksource arch_sys_counter client # [ 0.286075] VFS: Disk quotas dquot_6.6.0 client # [ 0.286112] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.291028] netfs: FS-Cache loaded client # [ 0.291196] pnp: PnP ACPI: disabled client # [ 0.295590] NET: Registered PF_INET protocol family client # [ 0.295908] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 client # [ 0.330984] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.000000] KASLR enabled lb # [ 0.000000] random: crng init done client # [ 0.331053] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] efi: UEFI not found. client # [ 0.331087] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.331181] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.331325] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] Zone ranges: client # [ 0.331430] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.331472] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.000000] DMA32 empty lb # [ 0.000000] Normal empty lb # [ 0.000000] Device empty client # [ 0.331513] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.000000] Movable zone start for each node client # [ 0.331616] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.000000] Early memory node ranges client # [ 0.331643] NET: Registered PF_XDP protocol family lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.331662] PCI: CLS 0 bytes, default 64 client # [ 0.331931] Trying to unpack rootfs image as initramfs... lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.347946] kvm [1]: HYP mode not available lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test/init regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration", will be passed to user space. lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000000] Policy zone: DMA lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups lb # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] rcu: RCU event tracing is enabled. lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] Rude variant of Tasks RCU enabled. lb # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.000050] arm-pv: using stolen time PV lb # [ 0.001260] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.001489] Console: colour dummy device 80x25 lb # [ 0.001497] printk: legacy console [tty0] enabled lb # [ 0.001700] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.001708] pid_max: default: 32768 minimum: 301 lb # [ 0.001790] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.001996] landlock: Up and running. lb # [ 0.001999] Yama: becoming mindful. lb # [ 0.002914] LSM support for eBPF active lb # [ 0.003182] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.003219] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.004569] cacheinfo: Unable to detect cache hierarchy for CPU 0 lb # [ 0.005440] rcu: Hierarchical SRCU implementation. lb # [ 0.005446] rcu: Max phase no-delay instances is 1000. lb # [ 0.006996] fsl-mc MSI: its@8080000 domain created lb # [ 0.007103] EFI services will not be available. lb # [ 0.007206] smp: Bringing up secondary CPUs ... lb # [ 0.007216] smp: Brought up 1 node, 1 CPU lb # [ 0.007219] SMP: Total of 1 processors activated. lb # [ 0.007226] CPU: All CPU(s) started at EL1 lb # [ 0.007239] CPU features: detected: Branch Target Identification lb # [ 0.007244] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.007247] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.007251] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.007254] CPU features: detected: Common not Private translations lb # [ 0.007258] CPU features: detected: CRC32 instructions lb # [ 0.007261] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.007265] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.007269] CPU features: detected: Data independent timing control (DIT) lb # [ 0.007272] CPU features: detected: E0PD lb # [ 0.007275] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.007278] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.007281] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.007284] CPU features: detected: Fine Grained Traps lb # [ 0.007288] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.007294] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.007297] CPU features: detected: LSE atomic instructions lb # [ 0.007300] CPU features: detected: Privileged Access Never lb # [ 0.007303] CPU features: detected: PMUv3 lb # [ 0.007306] CPU features: detected: RAS Extension Support lb # [ 0.007309] CPU features: detected: RASv1p1 Extension Support lb # [ 0.007311] CPU features: detected: Random Number Generator lb # [ 0.007314] CPU features: detected: Speculation barrier (SB) lb # [ 0.007317] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.007320] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.007325] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.007372] alternatives: applying system-wide alternatives worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] KASLR enabled lb # [ 0.010818] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.000000] random: crng init done worker1 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] efi: UEFI not found. lb # [ 0.015295] Memory: 1406516K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) lb # [ 0.017447] devtmpfs: initialized worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.019490] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] Zone ranges: lb # [ 0.019516] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.019903] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.000000] DMA32 empty worker1 # [ 0.000000] Normal empty lb # [ 0.019909] 0 pages in range for non-PLT usage worker1 # [ 0.000000] Device empty lb # [ 0.019910] 508288 pages in range for PLT usage worker1 # [ 0.000000] Movable zone start for each node lb # [ 0.020051] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.000000] Early memory node ranges lb # [ 0.020902] DMI not present or invalid. worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.026095] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.028494] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.029098] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.030625] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.030670] audit: initializing netlink subsys (disabled) worker1 # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.031679] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.031917] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.031918] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.031925] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.031927] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 lb # [ 0.031930] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.031957] cpuidle: using governor ladder worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.031965] cpuidle: using governor menu worker1 # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.032172] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.032192] ASID allocator initialised with 65536 entries lb # [ 0.033526] Serial: AMBA PL011 UART driver lb # [ 0.039158] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.039353] printk: console [ttyAMA0] enabled worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zwgirfamq9cjz73mhvx6r4x90a72kbbz-nixos-system-worker1-test/init regInfo=/nix/store/8vxdl5gm74j84gimba2hrvfgq4533bsm-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/8vxdl5gm74j84gimba2hrvfgq4533bsm-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.160756] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.160783] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.160789] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.160793] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.000000] Policy zone: DMA lb # [ 0.160797] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.160802] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.160806] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.160810] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.182141] fbcon: Taking over console worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.182178] ACPI: Interpreter disabled. worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.184220] iommu: Default domain type: Translated worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.184233] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.186040] SCSI subsystem initialized lb # [ 0.186778] usbcore: registered new interface driver usbfs lb # [ 0.186820] usbcore: registered new interface driver hub lb # [ 0.186850] usbcore: registered new device driver usb lb # [ 0.187168] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.187174] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.187185] PTP clock support registered lb # [ 0.187241] EDAC MC: Ver: 3.0.0 worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.192084] scmi_core: SCMI protocol bus registered worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.193127] FPGA manager framework lb # [ 0.194248] vgaarb: loaded worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.197954] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000036] arm-pv: using stolen time PV lb # [ 0.203894] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.000762] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.000945] Console: colour dummy device 80x25 worker1 # [ 0.000953] printk: legacy console [tty0] enabled lb # [ 0.203967] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.001154] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.001161] pid_max: default: 32768 minimum: 301 worker1 # [ 0.001252] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.001461] landlock: Up and running. worker1 # [ 0.001464] Yama: becoming mindful. worker1 # [ 0.002137] LSM support for eBPF active lb # [ 0.209950] netfs: FS-Cache loaded worker1 # [ 0.002295] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.210161] pnp: PnP ACPI: disabled worker1 # [ 0.002330] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.003497] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.005220] rcu: Hierarchical SRCU implementation. worker1 # [ 0.005227] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.006526] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.006696] EFI services will not be available. worker1 # [ 0.006777] smp: Bringing up secondary CPUs ... worker1 # [ 0.006788] smp: Brought up 1 node, 1 CPU lb # [ 0.215115] NET: Registered PF_INET protocol family lb # [ 0.215399] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.006792] SMP: Total of 1 processors activated. worker1 # [ 0.006798] CPU: All CPU(s) started at EL1 worker1 # [ 0.006811] CPU features: detected: Branch Target Identification worker1 # [ 0.006816] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.006819] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.006823] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.006826] CPU features: detected: Common not Private translations worker1 # [ 0.006829] CPU features: detected: CRC32 instructions worker1 # [ 0.006832] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.006836] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.006839] CPU features: detected: Data independent timing control (DIT) worker1 # [ 0.006842] CPU features: detected: E0PD worker1 # [ 0.006845] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.006848] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.006851] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.006854] CPU features: detected: Fine Grained Traps worker1 # [ 0.006858] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.006863] CPU features: detected: RCpc load-acquire (LDAPR) worker1 # [ 0.006867] CPU features: detected: LSE atomic instructions worker1 # [ 0.006870] CPU features: detected: Privileged Access Never worker1 # [ 0.006872] CPU features: detected: PMUv3 worker1 # [ 0.006875] CPU features: detected: RAS Extension Support worker1 # [ 0.006878] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.006880] CPU features: detected: Random Number Generator worker1 # [ 0.006883] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.006886] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.006889] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.006894] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.006942] alternatives: applying system-wide alternatives worker1 # [ 0.010282] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.010530] Memory: 1406544K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker1 # [ 0.011395] devtmpfs: initialized worker1 # [ 0.013370] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.013396] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.013632] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.013637] 0 pages in range for non-PLT usage worker1 # [ 0.013638] 508288 pages in range for PLT usage worker1 # [ 0.013770] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.014731] DMI not present or invalid. worker1 # [ 0.018429] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.021447] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.021671] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.021903] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.021942] audit: initializing netlink subsys (disabled) worker1 # [ 0.022345] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.022708] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.022710] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.022717] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.022720] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.022723] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.022746] cpuidle: using governor ladder worker1 # [ 0.022753] cpuidle: using governor menu lb # [ 0.250513] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.022962] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.022981] ASID allocator initialised with 65536 entries lb # [ 0.250584] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.024297] Serial: AMBA PL011 UART driver lb # [ 0.250625] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.029809] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.029973] printk: console [ttyAMA0] enabled lb # [ 0.250726] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.250874] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.250987] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.251196] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.251245] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.251547] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.251690] NET: Registered PF_XDP protocol family lb # [ 0.251716] PCI: CLS 0 bytes, default 64 lb # [ 0.251990] Trying to unpack rootfs image as initramfs... worker1 # [ 0.182813] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.182840] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.182846] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.182851] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.278021] kvm [1]: HYP mode not available worker1 # [ 0.182855] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.182859] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.182864] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.182868] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.192084] fbcon: Taking over console worker1 # [ 0.192108] ACPI: Interpreter disabled. worker1 # [ 0.194045] iommu: Default domain type: Translated worker1 # [ 0.194058] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.197099] SCSI subsystem initialized worker1 # [ 0.197858] usbcore: registered new interface driver usbfs worker1 # [ 0.197894] usbcore: registered new interface driver hub worker1 # [ 0.197914] usbcore: registered new device driver usb worker1 # [ 0.198229] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.198237] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.198247] PTP clock support registered worker1 # [ 0.198302] EDAC MC: Ver: 3.0.0 client # [ 0.597958] Initialise system trusted keyrings worker1 # [ 0.203125] scmi_core: SCMI protocol bus registered worker1 # [ 0.204190] FPGA manager framework worker1 # [ 0.205247] vgaarb: loaded worker1 # [ 0.205968] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.206762] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.206800] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.598757] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.211674] netfs: FS-Cache loaded worker1 # [ 0.211814] pnp: PnP ACPI: disabled client # [ 0.609681] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.610494] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.216051] NET: Registered PF_INET protocol family worker1 # [ 0.216341] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.251147] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.649552] Key type asymmetric registered client # [ 0.649589] Asymmetric key parser 'x509' registered client # [ 0.649687] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.651854] io scheduler mq-deadline registered client # [ 0.651870] io scheduler kyber registered worker1 # [ 0.251215] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.251250] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.251347] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.251492] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.251595] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.251637] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.251676] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.251776] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.251799] NET: Registered PF_XDP protocol family worker1 # [ 0.251820] PCI: CLS 0 bytes, default 64 worker1 # [ 0.252127] Trying to unpack rootfs image as initramfs... worker1 # [ 0.267843] kvm [1]: HYP mode not available client # [ 0.665566] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.675107] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.675873] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.675901] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.675916] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.675924] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.675947] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.675979] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.676074] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 0.676083] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.676090] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.676095] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.676100] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.676220] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.676680] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.676872] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] client # [ 0.676889] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.676919] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.676935] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.697667] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.697878] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.697897] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.697927] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.698504] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.698691] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] client # [ 0.698707] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.698737] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.699226] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.699405] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.699422] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.699454] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.699913] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.700093] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.700109] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.700138] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.700593] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.700778] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.700794] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.700824] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.701276] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.737589] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.737635] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.737665] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.737683] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.738282] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.738481] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.738511] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.743174] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.743400] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.743432] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.743933] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.744120] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.744384] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.744634] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.744651] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.744681] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.745151] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.759625] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.759651] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.759680] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.760325] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.760338] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.760344] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.760391] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.760439] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.760487] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.760535] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.760583] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.760632] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.760680] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.760729] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.760775] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.760855] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.760901] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.760923] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.760945] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.760966] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned client # [ 0.760991] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned client # [ 0.761013] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.761036] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned client # [ 0.761058] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.761081] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.761103] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned client # [ 0.761127] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.761156] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.761178] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.761200] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.494820] Initialise system trusted keyrings client # [ 0.761221] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.761242] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.495687] workingset: timestamp_bits=42 max_order=19 bucket_order=0 client # [ 0.761264] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.761286] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.761308] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.761352] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.761373] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.761400] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.761410] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.761415] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.502431] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.762577] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.503351] 9p: Installing v9fs 9p2000 file system support lb # [ 0.536348] Key type asymmetric registered lb # [ 0.536386] Asymmetric key parser 'x509' registered lb # [ 0.536490] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.538991] io scheduler mq-deadline registered lb # [ 0.539013] io scheduler kyber registered client # [ 0.842369] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.545116] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.488943] Initialise system trusted keyrings worker1 # [ 0.489790] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.491308] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.491372] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.511442] Key type asymmetric registered worker1 # [ 0.511482] Asymmetric key parser 'x509' registered worker1 # [ 0.511578] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.513693] io scheduler mq-deadline registered client # [ 0.894715] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.513707] io scheduler kyber registered client # [ 0.898720] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.901900] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.904230] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.906869] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) lb # [ 0.614037] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.614800] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.614828] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.614842] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.614851] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.614878] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.614914] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.615016] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.615026] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.615032] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] lb # [ 0.615037] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.528416] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.615043] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.529813] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.615143] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.615622] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.914713] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.531222] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.531247] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.615831] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.615850] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.531260] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.615882] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.531269] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.615899] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.531294] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.616377] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.616564] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.531320] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.616580] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.531432] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.616613] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.531443] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.617126] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.617328] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.531449] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.531454] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.617346] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.531460] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.617381] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.531580] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.932741] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) lb # [ 0.617877] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.532069] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.939434] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.532279] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.532297] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.532328] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.532345] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.943432] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.532816] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.533001] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.533018] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.533048] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.533510] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.947169] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.533693] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.533709] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.533739] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.654185] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.654279] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.654399] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.655029] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.655228] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.655246] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.562401] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.961851] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.562659] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.562679] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.562714] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.563219] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.563405] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.655276] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.655753] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.656040] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.656059] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.656089] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.656592] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.656777] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.656793] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.656823] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.563423] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.563453] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.563913] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.564107] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.564126] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.656839] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.564158] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.657391] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.564649] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.564846] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.657581] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.971103] msm_serial: driver initialized worker1 # [ 0.564863] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.657611] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.971295] SuperH (H)SCI(F) driver initialized client # [ 0.971350] STM32 USART driver initialized worker1 # [ 0.564894] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.658107] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.564910] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.658309] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.565431] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.658340] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.565623] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.565655] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.658741] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.659076] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.659341] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.659597] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.659615] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.659645] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.660230] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.660422] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.660438] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.660468] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.661186] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.586300] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.661197] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.586555] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.661203] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.586588] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.661254] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.587024] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.587212] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.661305] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.587482] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.661355] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.587744] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.587763] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.661405] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.587793] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.661452] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.588275] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.661501] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.588613] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.588632] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.588663] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.589302] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.589316] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.661550] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.661603] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.661720] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.661815] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.589322] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.661863] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.589371] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned lb # [ 0.661886] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.589420] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.661908] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.589470] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.661931] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.589519] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.589568] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.589618] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.589671] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.589720] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.706706] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.706744] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.589770] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] KASLR enabled lb # [ 0.706767] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.589865] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.000000] random: crng init done worker2 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.589915] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.000000] efi: UEFI not found. worker1 # [ 0.589939] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.589961] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] Zone ranges: worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.706791] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.000000] DMA32 empty worker2 # [ 0.000000] Normal empty lb # [ 0.706814] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.000000] Device empty worker2 # [ 0.000000] Movable zone start for each node lb # [ 0.706837] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.706861] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.706885] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 1.014215] loop: module loaded client # [ 1.014493] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 1.015379] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.706907] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.706929] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.706952] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.706974] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.706997] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.707020] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.707043] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.707066] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.622107] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.707088] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.622141] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.707124] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.622166] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.622191] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.622215] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.622241] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.622266] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.622291] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 1.022257] megasas: 07.734.00.00-rc1 worker1 # [ 0.622317] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.707133] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.707138] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.622341] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.708528] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.622364] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0r31wjlygcn47dyyzl916b35v9f3ng6k-nixos-system-worker2-test/init regInfo=/nix/store/ik3fad33q44if18fhw4ncajdi342n3lv-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.622386] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.622408] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 1.028173] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/ik3fad33q44if18fhw4ncajdi342n3lv-closure-info/registration", will be passed to user space. worker1 # [ 0.622431] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.622455] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.622498] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.622521] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.622544] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.622583] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.622594] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.622599] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] Policy zone: DMA worker1 # [ 0.623815] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 1.045705] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 1.045818] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 1.049069] Using buffer write method worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 1.049191] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000 worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker2 # [ 0.000039] arm-pv: using stolen time PV worker2 # [ 0.000866] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.001085] Console: colour dummy device 80x25 worker2 # [ 0.001093] printk: legacy console [tty0] enabled worker2 # [ 0.001288] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.001295] pid_max: default: 32768 minimum: 301 worker2 # [ 0.001384] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.001605] landlock: Up and running. client # [ 1.070938] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.001608] Yama: becoming mindful. worker2 # [ 0.002547] LSM support for eBPF active client # [ 1.071022] Intel/Sharp Extended Query Table at 0x0031 client # [ 1.075508] Using buffer write method worker1 # [ 0.674325] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.002787] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 1.075548] Concatenating MTD devices: client # [ 1.075552] (0): "0.flash" worker1 # [ 0.677665] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.002823] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 1.075556] (1): "0.flash" client # [ 1.075559] into device "0.flash" worker2 # [ 0.004160] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.004971] rcu: Hierarchical SRCU implementation. worker2 # [ 0.004977] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.006278] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.006398] EFI services will not be available. worker2 # [ 0.006503] smp: Bringing up secondary CPUs ... worker2 # [ 0.006514] smp: Brought up 1 node, 1 CPU worker2 # [ 0.006517] SMP: Total of 1 processors activated. worker2 # [ 0.006523] CPU: All CPU(s) started at EL1 worker2 # [ 0.006537] CPU features: detected: Branch Target Identification worker2 # [ 0.006542] CPU features: detected: ARMv8.4 Translation Table Level worker2 # [ 0.006546] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.006549] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.688048] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.006553] CPU features: detected: Common not Private translations lb # [ 0.788317] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.006556] CPU features: detected: CRC32 instructions worker2 # [ 0.006559] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.006563] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.006566] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.006569] CPU features: detected: E0PD lb # [ 0.792948] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.691236] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.006572] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.693601] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.006575] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.006578] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.006581] CPU features: detected: Fine Grained Traps worker2 # [ 0.006586] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.006591] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.006594] CPU features: detected: LSE atomic instructions worker2 # [ 0.006597] CPU features: detected: Privileged Access Never worker2 # [ 0.006600] CPU features: detected: PMUv3 worker2 # [ 0.006603] CPU features: detected: RAS Extension Support worker2 # [ 0.006605] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.006608] CPU features: detected: Random Number Generator worker2 # [ 0.006611] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.006614] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.006617] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.006623] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.006667] alternatives: applying system-wide alternatives worker2 # [ 0.010281] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.010531] Memory: 1406768K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker2 # [ 0.011809] devtmpfs: initialized worker2 # [ 0.013764] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.013789] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.014033] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.014039] 0 pages in range for non-PLT usage worker2 # [ 0.014040] 508288 pages in range for PLT usage worker2 # [ 0.014174] pinctrl core: initialized pinctrl subsystem lb # [ 0.807803] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.015134] DMI not present or invalid. worker1 # [ 0.711790] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.019704] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.022278] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.022505] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.022735] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.022773] audit: initializing netlink subsys (disabled) worker2 # [ 0.024610] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.024613] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.024618] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.024625] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.024628] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.024667] audit: type=2000 audit(0.020:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.024680] cpuidle: using governor ladder worker2 # [ 0.024686] cpuidle: using governor menu worker2 # [ 0.024936] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.024958] ASID allocator initialised with 65536 entries worker2 # [ 0.026273] Serial: AMBA PL011 UART driver lb # [ 0.822670] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.031960] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.032162] printk: console [ttyAMA0] enabled worker1 # [ 0.715430] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.718068] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.720582] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.837326] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.160149] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.160177] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.160183] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker2 # [ 0.160188] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.160192] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.160197] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.160201] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.160206] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.167892] fbcon: Taking over console worker2 # [ 0.167913] ACPI: Interpreter disabled. lb # [ 0.849395] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.748152] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.176512] iommu: Default domain type: Translated worker2 # [ 0.176529] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.178381] SCSI subsystem initialized worker2 # [ 0.179133] usbcore: registered new interface driver usbfs worker2 # [ 0.179167] usbcore: registered new interface driver hub worker2 # [ 0.179186] usbcore: registered new device driver usb worker2 # [ 0.179548] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.179556] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.179567] PTP clock support registered worker2 # [ 0.179635] EDAC MC: Ver: 3.0.0 worker2 # [ 0.184450] scmi_core: SCMI protocol bus registered worker2 # [ 0.185514] FPGA manager framework worker2 # [ 0.186527] vgaarb: loaded worker2 # [ 0.187281] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.852711] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 0.192111] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.192184] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.193896] netfs: FS-Cache loaded worker2 # [ 0.194055] pnp: PnP ACPI: disabled worker1 # [ 0.767668] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.198146] NET: Registered PF_INET protocol family worker2 # [ 0.198442] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.887821] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.801742] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.804743] msm_serial: driver initialized worker1 # [ 0.804897] SuperH (H)SCI(F) driver initialized worker1 # [ 0.804955] STM32 USART driver initialized lb # [ 0.912563] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.238423] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.923475] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.238491] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.238530] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.238631] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.238775] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.238891] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.238936] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.238977] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.239091] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.239117] NET: Registered PF_XDP protocol family worker2 # [ 0.239139] PCI: CLS 0 bytes, default 64 worker2 # [ 0.239406] Trying to unpack rootfs image as initramfs... lb # [ 0.934143] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.258668] kvm [1]: HYP mode not available worker1 # [ 0.848364] loop: module loaded worker1 # [ 0.848644] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.849622] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.953135] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.956699] msm_serial: driver initialized lb # [ 0.956901] SuperH (H)SCI(F) driver initialized lb # [ 0.956959] STM32 USART driver initialized worker1 # [ 0.858990] megasas: 07.734.00.00-rc1 worker1 # [ 0.859995] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 1.005482] loop: module loaded lb # [ 1.005736] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.907699] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.907770] Intel/Sharp Extended Query Table at 0x0031 lb # [ 1.015058] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.918925] Using buffer write method worker1 # [ 0.919058] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 1.018841] megasas: 07.734.00.00-rc1 lb # [ 1.019690] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.921169] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.921286] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.955715] Using buffer write method worker1 # [ 0.955779] Concatenating MTD devices: worker1 # [ 0.955784] (0): "0.flash" worker1 # [ 0.955789] (1): "0.flash" worker1 # [ 0.955792] into device "0.flash" lb # [ 1.057884] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 1.059202] Intel/Sharp Extended Query Table at 0x0031 lb # [ 1.083030] Using buffer write method lb # [ 1.083190] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 1.104137] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 1.104256] Intel/Sharp Extended Query Table at 0x0031 lb # [ 1.128384] Using buffer write method lb # [ 1.128442] Concatenating MTD devices: lb # [ 1.128447] (0): "0.flash" lb # [ 1.128452] (1): "0.flash" lb # [ 1.128455] into device "0.flash" worker2 # [ 0.540757] Initialise system trusted keyrings worker2 # [ 0.541550] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.542884] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.543655] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.581325] Key type asymmetric registered worker2 # [ 0.581364] Asymmetric key parser 'x509' registered worker2 # [ 0.581515] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker2 # [ 0.583968] io scheduler mq-deadline registered worker2 # [ 0.583982] io scheduler kyber registered worker2 # [ 0.599509] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.601335] ledtrig-cpu: registered to indicate activity on CPUs client # [ 1.603932] Freeing initrd memory: 26160K client # [ 1.612312] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.627859] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.627914] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 1.617477] thunder_xcv, ver 1.0 client # [ 1.617536] thunder_bgx, ver 1.0 client # [ 1.617559] nicpf, ver 1.0 client # [ 1.618148] e1000: Intel(R) PRO/1000 Network Driver client # [ 1.618156] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 1.618183] e1000e: Intel(R) PRO/1000 Network Driver client # [ 1.618194] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 1.618225] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 1.618231] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.643314] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 1.618256] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.643328] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 1.618262] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 1.618401] sky2: driver version 1.30 worker2 # [ 0.643396] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 1.620319] usbcore: registered new interface driver usb-storage client # [ 1.620454] usbcore: registered new interface driver usbserial_generic client # [ 1.620471] usbserial: USB Serial support registered for generic client # [ 1.621108] hv_vmbus: registering driver hyperv_keyboard client # [ 1.622278] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 1.622323] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.643432] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 1.622585] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker2 # [ 0.643611] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 1.633668] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.643623] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 1.634161] hub 1-0:1.0: USB hub found client # [ 1.634224] hub 1-0:1.0: 6 ports detected worker2 # [ 0.643630] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 1.639411] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 1.639459] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:20:54 UTC (1789906854) client # [ 1.639820] i2c_dev: i2c /dev entries driver worker2 # [ 0.643635] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.643641] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.643741] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 1.645066] sdhci: Secure Digital Host Controller Interface driver client # [ 1.645083] sdhci: Copyright(c) Pierre Ossman client # [ 1.646735] Synopsys Designware Multimedia Card Interface Driver client # [ 1.650288] sdhci-pltfm: SDHCI platform and OF driver helper client # [ 1.652576] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.679250] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 1.652900] usbcore: registered new interface driver usbhid client # [ 1.652909] usbhid: USB HID core driver client # [ 1.667979] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.696279] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.696327] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.696357] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.696374] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 1.677953] drop_monitor: Initializing network drop monitor service client # [ 1.678271] NET: Registered PF_INET6 protocol family worker2 # [ 0.696992] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.697179] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 1.684576] Segment Routing with IPv6 worker2 # [ 0.697196] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 1.684615] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.697225] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 1.684677] NET: Registered PF_PACKET protocol family worker2 # [ 0.697695] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.697879] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.697895] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.697924] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.698380] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.698563] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.698579] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.698616] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.699084] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 1.686460] 9pnet: Installing 9P2000 support worker2 # [ 0.699265] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 1.696468] Key type dns_resolver registered worker2 # [ 0.699296] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.699324] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.699788] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 1.708351] registered taskstats version 1 client # [ 1.708569] Loading compiled-in X.509 certificates worker2 # [ 0.734597] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.734647] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.734677] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.735333] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.735528] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.735545] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.735574] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.735590] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.737417] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.737613] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 1.723142] Demotion targets for Node 0: null client # [ 1.723334] Key type .fscrypt registered client # [ 1.723344] Key type fscrypt-provisioning registered client # [ 1.723464] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.737643] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 1.723487] ima: Allocated hash algorithm: sha1 client # [ 1.723517] ima: No architecture policies found worker2 # [ 0.738129] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.738317] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 1.729437] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 0.738347] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.738737] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.738918] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 1.756755] clk: Disabling unused clocks client # [ 1.756802] PM: genpd: Disabling unused power domains client # [ 1.761747] Freeing unused kernel memory: 4736K client # [ 1.762172] Run /init as init process client # [ 1.780822] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.511203] Freeing initrd memory: 26140K lb # [ 1.518082] tun: Universal TUN/TAP device driver, 1.6 lb # [ 1.522688] thunder_xcv, ver 1.0 lb # [ 1.522747] thunder_bgx, ver 1.0 lb # [ 1.522770] nicpf, ver 1.0 lb # [ 1.523359] e1000: Intel(R) PRO/1000 Network Driver lb # [ 1.523367] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 1.523393] e1000e: Intel(R) PRO/1000 Network Driver lb # [ 1.523403] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 1.523432] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 1.523439] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 1.523462] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 1.523468] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 1.523610] sky2: driver version 1.30 lb # [ 1.525301] usbcore: registered new interface driver usb-storage lb # [ 1.525411] usbcore: registered new interface driver usbserial_generic lb # [ 1.525426] usbserial: USB Serial support registered for generic lb # [ 1.527336] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 1.527406] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 lb # [ 1.527647] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 1.538492] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 1.544434] hub 1-0:1.0: USB hub found lb # [ 1.544468] hub 1-0:1.0: 6 ports detected lb # [ 1.546365] hv_vmbus: registering driver hyperv_keyboard lb # [ 1.548161] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 1.548203] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:20:54 UTC (1789906854) lb # [ 1.548567] i2c_dev: i2c /dev entries driver lb # [ 1.553808] sdhci: Secure Digital Host Controller Interface driver lb # [ 1.553825] sdhci: Copyright(c) Pierre Ossman lb # [ 1.555463] Synopsys Designware Multimedia Card Interface Driver lb # [ 1.555863] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 1.557779] hid: raw HID events driver (C) Jiri Kosina lb # [ 1.560238] usbcore: registered new interface driver usbhid lb # [ 1.560250] usbhid: USB HID core driver lb # [ 1.562675] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 1.463982] Freeing initrd memory: 26148K lb # [ 1.564324] drop_monitor: Initializing network drop monitor service lb # [ 1.564534] NET: Registered PF_INET6 protocol family lb # [ 1.568213] Segment Routing with IPv6 lb # [ 1.568246] In-situ OAM (IOAM) with IPv6 lb # [ 1.568284] NET: Registered PF_PACKET protocol family worker1 # [ 1.471668] tun: Universal TUN/TAP device driver, 1.6 lb # [ 1.570079] 9pnet: Installing 9P2000 support lb # [ 1.572711] Key type dns_resolver registered worker1 # [ 1.476206] thunder_xcv, ver 1.0 worker1 # [ 1.476273] thunder_bgx, ver 1.0 worker1 # [ 1.476299] nicpf, ver 1.0 worker1 # [ 1.477225] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 1.477240] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 1.477267] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 1.477280] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 1.477311] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 1.580228] registered taskstats version 1 lb # [ 1.580412] Loading compiled-in X.509 certificates worker1 # [ 1.477317] igb: Copyright (c) 2007-2014 Intel Corporation. worker1 # [ 1.477341] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 1.477347] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 1.477485] sky2: driver version 1.30 client # [ 1.885767] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.487904] usbcore: registered new interface driver usb-storage lb # [ 1.593170] Demotion targets for Node 0: null worker1 # [ 1.488071] usbcore: registered new interface driver usbserial_generic lb # [ 1.593367] Key type .fscrypt registered worker1 # [ 1.488087] usbserial: USB Serial support registered for generic lb # [ 1.593376] Key type fscrypt-provisioning registered worker1 # [ 1.488900] hv_vmbus: registering driver hyperv_keyboard lb # [ 1.593502] ima: No TPM chip found, activating TPM-bypass! lb # [ 1.593525] ima: Allocated hash algorithm: sha1 worker1 # [ 1.490743] ehci-pci 0000:00:0a.0: EHCI Host Controller worker1 # [ 1.490784] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 lb # [ 1.593551] ima: No architecture policies found worker1 # [ 1.491171] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 1.598996] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 1.499407] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 1.499462] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:20:54 UTC (1789906854) worker1 # [ 1.499972] i2c_dev: i2c /dev entries driver worker1 # [ 1.503611] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 1.504082] hub 1-0:1.0: USB hub found worker1 # [ 1.504107] hub 1-0:1.0: 6 ports detected worker1 # [ 1.509044] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 1.509071] sdhci: Copyright(c) Pierre Ossman worker1 # [ 1.509342] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 1.509721] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 1.515169] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 1.515445] usbcore: registered new interface driver usbhid worker1 # [ 1.515454] usbhid: USB HID core driver worker2 # [ 0.928179] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 1.518877] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 1.522050] drop_monitor: Initializing network drop monitor service worker1 # [ 1.522352] NET: Registered PF_INET6 protocol family worker2 # [ 0.928481] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.928504] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.928533] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 1.526431] Segment Routing with IPv6 worker1 # [ 1.526494] In-situ OAM (IOAM) with IPv6 worker1 # [ 1.526537] NET: Registered PF_PACKET protocol family worker1 # [ 1.528296] 9pnet: Installing 9P2000 support lb # [ 1.629295] clk: Disabling unused clocks lb # [ 1.629349] PM: genpd: Disabling unused power domains worker2 # [ 0.929150] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.929336] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 1.634320] Freeing unused kernel memory: 4736K lb # [ 1.634600] Run /init as init process worker2 # [ 0.929352] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.929381] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.930000] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.930013] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.930019] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.930068] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 1.552129] Key type dns_resolver registered lb # [ 1.654735] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.559754] registered taskstats version 1 worker2 # [ 0.930118] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 1.559945] Loading compiled-in X.509 certificates worker2 # [ 0.930167] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker2 # [ 0.930217] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 1.570804] Demotion targets for Node 0: null worker1 # [ 1.570968] Key type .fscrypt registered worker1 # [ 1.570976] Key type fscrypt-provisioning registered worker1 # [ 1.571102] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.930267] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 1.571123] ima: Allocated hash algorithm: sha1 worker2 # [ 0.930319] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 1.571153] ima: No architecture policies found worker2 # [ 0.930370] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.930418] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.930467] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.930529] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.930574] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.930596] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.930619] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.930641] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.930665] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.930688] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.930710] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.930732] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 1.591126] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 0.930754] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.930776] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.930800] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.930822] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.930843] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.930864] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.930885] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker2 # [ 0.930907] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.930928] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.930949] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker2 # [ 0.930971] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker2 # [ 0.930993] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 2.035618] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 0.931014] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 1.643544] clk: Disabling unused clocks worker2 # [ 0.931040] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.931050] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 1.643609] PM: genpd: Disabling unused power domains worker2 # [ 0.931055] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.937499] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 1.650208] Freeing unused kernel memory: 4736K worker1 # [ 1.650558] Run /init as init process worker1 # [ 1.673339] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.091163] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 1.790114] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.109256] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 1.116887] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 2.105654] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.131545] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 1.134134] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 2.115934] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 2.120556] systemd[1]: Detected virtualization qemu. client # [ 2.121309] systemd[1]: Detected architecture arm64. client # [ 2.122004] systemd[1]: Running in initrd. client # [ 2.123019] systemd[1]: Initializing machine ID from random generator. client # [ 2.124008] systemd[1]: Hostname set to . worker2 # [ 1.154748] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 1.750601] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.164988] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 1.185114] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 1.191634] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 1.209744] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 1.237981] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 2.229557] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.940046] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.268766] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 1.271905] msm_serial: driver initialized worker2 # [ 1.277179] SuperH (H)SCI(F) driver initialized worker2 # [ 1.277262] STM32 USART driver initialized lb # [ 1.989890] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.994349] systemd[1]: Detected virtualization qemu. lb # [ 1.995018] systemd[1]: Detected architecture arm64. lb # [ 1.995628] systemd[1]: Running in initrd. lb # [ 1.996585] systemd[1]: Initializing machine ID from random generator. lb # [ 1.997508] systemd[1]: Hostname set to . worker1 # [ 1.901644] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.331096] loop: module loaded worker2 # [ 1.332130] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 1.333067] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 1.346433] megasas: 07.734.00.00-rc1 lb # [ 2.030381] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.356222] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 1.361581] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 1.361639] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 1.367356] Using buffer write method worker2 # [ 1.367455] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 1.384191] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 1.384261] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 1.386205] Using buffer write method worker2 # [ 1.386256] Concatenating MTD devices: worker2 # [ 1.386260] (0): "0.flash" worker2 # [ 1.386264] (1): "0.flash" worker2 # [ 1.386267] into device "0.flash" worker1 # [ 1.974376] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 2.392612] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 2.394687] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 2.416443] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 2.013011] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 2.023577] systemd[1]: Detected virtualization qemu. worker1 # [ 2.024315] systemd[1]: Detected architecture arm64. worker1 # [ 2.024966] systemd[1]: Running in initrd. worker1 # [ 2.026025] systemd[1]: Initializing machine ID from random generator. worker1 # [ 2.029647] systemd[1]: Hostname set to . lb # [ 2.150110] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 2.488392] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 2.098060] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 2.503613] systemd[1]: Created slice Slice /system/modprobe. client # [ 2.504730] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 2.505915] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 2.505956] systemd[1]: Reached target Path Units. client # [ 2.505973] systemd[1]: Reached target Slice Units. client # [ 2.505991] systemd[1]: Reached target Swaps. client # [ 2.506007] systemd[1]: Reached target Timer Units. client # [ 2.506250] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 2.506383] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 2.506506] systemd[1]: Listening on Journal Sockets. client # [ 2.506617] systemd[1]: Listening on udev Control Socket. client # [ 2.506716] systemd[1]: Listening on udev Kernel Socket. client # [ 2.506731] systemd[1]: Reached target Socket Units. client # [ 2.516468] systemd[1]: Starting Create List of Static Device Nodes... client # [ 2.529710] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 2.530739] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 2.537111] systemd[1]: Mounting Kernel Configuration File System... lb # [ 2.259095] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 2.565992] systemd[1]: Starting Journal Service... client # [ 2.577739] systemd[1]: Starting Load Kernel Modules... client # [ 2.577961] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 2.308477] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 2.608256] systemd-journald[73]: Collecting audit messages is disabled. client # [ 2.609545] systemd[1]: Starting Coldplug All udev Devices... lb # [ 2.311176] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 2.612066] systemd[1]: Finished Create List of Static Device Nodes. client # [ 2.614555] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 2.632076] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 2.251475] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 2.651155] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 2.652581] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 2.255719] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 lb # [ 2.356101] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 2.368769] systemd[1]: Created slice Slice /system/modprobe. lb # [ 2.369893] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 2.371190] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 2.371235] systemd[1]: Reached target Path Units. lb # [ 2.371254] systemd[1]: Reached target Slice Units. lb # [ 2.371275] systemd[1]: Reached target Swaps. lb # [ 2.371295] systemd[1]: Reached target Timer Units. lb # [ 2.371506] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 2.371653] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 2.371776] systemd[1]: Listening on Journal Sockets. lb # [ 2.371897] systemd[1]: Listening on udev Control Socket. lb # [ 2.372005] systemd[1]: Listening on udev Kernel Socket. lb # [ 2.372027] systemd[1]: Reached target Socket Units. lb # [ 2.385886] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 2.399720] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 2.399849] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 2.703656] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 2.414435] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 2.321534] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 2.434868] systemd[1]: Starting Journal Service... client # [ 2.729492] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 2.736056] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 2.736335] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 2.736348] [drm] features: -context_init client # [ 2.737181] [drm] number of scanouts: 1 client # [ 2.737203] [drm] number of cap sets: 0 lb # [ 2.454387] systemd[1]: Starting Load Kernel Modules... lb # [ 2.455385] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 2.754254] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 2.758217] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 2.473128] systemd[1]: Starting Coldplug All udev Devices... client # [ 2.769575] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 2.769611] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 2.393410] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 2.404761] systemd[1]: Created slice Slice /system/modprobe. lb # [ 2.510367] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 2.511880] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 2.512278] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 2.512666] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 2.415703] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 2.415767] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 2.702359] systemd-modules-load[75]: Inserted module 'dm_mod' worker1 # [ 2.415807] systemd[1]: Reached target Path Units. worker1 # [ 2.415824] systemd[1]: Reached target Slice Units. client # [ 2.817215] systemd[1]: Started Journal Service. worker1 # [ 2.415840] systemd[1]: Reached target Swaps. worker1 # [ 2.415857] systemd[1]: Reached target Timer Units. worker1 # [ 2.417037] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 2.425118] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 2.426186] systemd[1]: Listening on Journal Sockets. worker1 # [ 2.427436] systemd[1]: Listening on udev Control Socket. worker1 # [ 2.428302] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 2.429020] systemd[1]: Reached target Socket Units. lb # [ 2.530715] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 2.431871] systemd[1]: Starting Create List of Static Device Nodes... client # [ 2.823161] Console: switching to colour frame buffer device 160x50 client # [ 2.825078] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 2.714132] systemd-modules-load[75]: Module 'virtio_balloon' is built in client # [ 2.724563] systemd-modules-load[75]: Module 'virtio_console' is built in worker1 # [ 2.440200] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 2.447726] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 2.731733] systemd-modules-load[75]: Inserted module 'virtio_gpu' client # [ 2.741531] systemd-modules-load[75]: Module 'virtio_rng' is built in client # [ 2.746669] systemd[1]: Finished Load Kernel Modules. client # [ 2.756997] systemd[1]: Starting Apply Kernel Variables... client # [ 2.759333] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 2.470780] systemd[1]: Mounting Kernel Configuration File System... lb # [ 2.579469] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 2.583743] systemd-journald[73]: Collecting audit messages is disabled. client # [ 2.775675] systemd[1]: Reached target Preparation for Local File Systems. client # [ 2.784594] systemd[1]: Reached target Local File Systems. worker1 # [ 2.504370] systemd[1]: Starting Journal Service... lb # [ 2.602076] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 2.607961] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 2.608244] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 2.608257] [drm] features: -context_init lb # [ 2.609065] [drm] number of scanouts: 1 lb # [ 2.609087] [drm] number of cap sets: 0 client # [ 2.796226] systemd[1]: Starting Create System Files and Directories... lb # [ 2.618899] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 2.522866] systemd[1]: Starting Load Kernel Modules... worker1 # [ 2.524045] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 2.810523] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 2.626536] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 2.634740] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 2.634774] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 client # [ 2.834226] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.974595] Freeing initrd memory: 26148K worker2 # [ 1.981534] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 1.986874] thunder_xcv, ver 1.0 worker2 # [ 1.986940] thunder_bgx, ver 1.0 worker2 # [ 1.986965] nicpf, ver 1.0 worker2 # [ 1.988857] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 1.988871] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 1.988897] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 1.988906] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 1.988939] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 1.988945] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 1.988968] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 1.988975] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 1.989111] sky2: driver version 1.30 worker2 # [ 1.990812] usbcore: registered new interface driver usb-storage worker2 # [ 1.990951] usbcore: registered new interface driver usbserial_generic worker2 # [ 1.990967] usbserial: USB Serial support registered for generic worker2 # [ 2.000096] hv_vmbus: registering driver hyperv_keyboard lb # [ 2.673663] Console: switching to colour frame buffer device 160x50 worker2 # [ 2.002282] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 2.002326] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 2.002574] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 2.582320] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 2.584997] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 2.006014] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 2.006104] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:20:55 UTC (1789906855) worker1 # [ 2.587383] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 2.006847] i2c_dev: i2c /dev entries driver client # [ 2.873360] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.013551] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 2.013576] sdhci: Copyright(c) Pierre Ossman worker2 # [ 2.013861] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 2.014233] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 2.019221] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 2.020763] hub 1-0:1.0: USB hub found lb # [ 2.699203] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 2.021503] hub 1-0:1.0: 6 ports detected worker1 # [ 2.602806] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 2.024024] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.024325] usbcore: registered new interface driver usbhid lb # [ 2.704937] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 2.024333] usbhid: USB HID core driver lb # [ 2.706457] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 2.028102] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 2.607166] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 2.029844] drop_monitor: Initializing network drop monitor service worker2 # [ 2.030063] NET: Registered PF_INET6 protocol family lb # [ 2.708342] systemd[1]: Reached target Local File Systems. worker2 # [ 2.033354] Segment Routing with IPv6 worker2 # [ 2.033381] In-situ OAM (IOAM) with IPv6 worker2 # [ 2.033416] NET: Registered PF_PACKET protocol family worker1 # [ 2.612437] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 2.035428] 9pnet: Installing 9P2000 support worker2 # [ 2.038107] Key type dns_resolver registered client # [ 2.907483] systemd-udevd[88]: Using default interface naming scheme 'v261'. worker2 # [ 2.045414] registered taskstats version 1 worker2 # [ 2.045624] Loading compiled-in X.509 certificates worker1 # [ 2.627969] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 2.054853] Demotion targets for Node 0: null worker2 # [ 2.055034] Key type .fscrypt registered worker2 # [ 2.055044] Key type fscrypt-provisioning registered worker2 # [ 2.055166] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 2.055191] ima: Allocated hash algorithm: sha1 worker2 # [ 2.055221] ima: No architecture policies found lb # [ 2.730931] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 2.060383] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 2.640673] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 2.645689] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 2.943450] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.659543] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 2.759173] systemd[1]: Finished Load Kernel Modules. worker1 # [ 2.659835] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 2.659847] [drm] features: -context_init worker1 # [ 2.660688] [drm] number of scanouts: 1 worker1 # [ 2.660710] [drm] number of cap sets: 0 worker2 # [ 2.093290] clk: Disabling unused clocks worker2 # [ 2.093339] PM: genpd: Disabling unused power domains worker2 # [ 2.099632] Freeing unused kernel memory: 4736K worker2 # [ 2.099867] Run /init as init process lb # [ 2.799080] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 2.695317] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker2 # [ 2.119470] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 2.695357] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 2.746321] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 3.036256] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.753255] Console: switching to colour frame buffer device 160x50 worker1 # [ 2.761081] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 2.791989] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 2.803091] systemd[1]: Finished Load Kernel Modules. client # [ 3.096719] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.820594] systemd[1]: Starting Apply Kernel Variables... client # [ 3.116955] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.267413] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.876312] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 2.881679] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 2.984436] systemd[1]: Started Journal Service. lb # [ 2.972606] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.981090] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.983019] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 2.900223] systemd[1]: Reached target Local File Systems. worker1 # [ 2.903687] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 2.905997] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 3.018096] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.911897] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.944731] systemd[1]: Started Journal Service. lb # [ 3.028305] systemd-modules-load[74]: Module 'virtio_rng' is built in worker1 # [ 2.932539] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 2.935606] systemd-modules-load[74]: Inserted module 'virtio_gpu' lb # [ 3.044525] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.944818] systemd-modules-load[74]: Module 'virtio_rng' is built in worker1 # [ 2.946550] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.947869] systemd[1]: Starting Create System Files and Directories... lb # [ 3.056875] systemd[1]: Finished Apply Kernel Variables. lb # [ 3.096613] systemd-udevd[79]: Using default interface naming scheme 'v261'. lb # [ 3.099681] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.438716] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 3.005354] systemd-udevd[81]: Using default interface naming scheme 'v261'. lb # [ 3.126627] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 3.021381] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.456609] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 3.045969] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.491365] systemd[1]: Detected virtualization qemu. worker2 # [ 2.500303] systemd[1]: Detected architecture arm64. worker2 # [ 2.500934] systemd[1]: Running in initrd. worker2 # [ 2.507854] systemd[1]: Initializing machine ID from random generator. worker2 # [ 2.509071] systemd[1]: Hostname set to . lb # [ 3.200836] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.538805] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 3.136985] systemd[1]: Starting Virtual Console Setup... lb # [ 3.264808] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 3.270042] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.667398] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 3.224710] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 3.229966] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.815938] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 2.821993] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 2.946021] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 3.014253] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 3.026121] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 3.027703] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.029261] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 3.030387] systemd[1]: Reached target Path Units. worker2 # [ 3.031339] systemd[1]: Reached target Slice Units. worker2 # [ 3.032247] systemd[1]: Reached target Swaps. worker2 # [ 3.033031] systemd[1]: Reached target Timer Units. worker2 # [ 3.034136] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 3.035628] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 3.035757] systemd[1]: Listening on Journal Sockets. worker2 # [ 3.035873] systemd[1]: Listening on udev Control Socket. worker2 # [ 3.036027] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 3.036047] systemd[1]: Reached target Socket Units. worker2 # [ 3.042672] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 3.051533] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.051637] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 3.063551] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 3.090120] systemd[1]: Starting Journal Service... worker2 # [ 3.096890] systemd[1]: Starting Load Kernel Modules... worker2 # [ 3.098290] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 3.964418] systemd[1]: Finished Coldplug All udev Devices. client # [ 3.966543] systemd[1]: Reached target System Initialization. client # [ 3.967916] systemd[1]: Reached target Basic System. worker2 # [ 3.110374] systemd[1]: Starting Coldplug All udev Devices... client # [ 4.144353] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. client # [ 4.199540] (udev-worker)[99]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 4.209360] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line. client # [ 4.303630] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 4.305990] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.991885] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 4.001353] systemd[1]: Reached target System Initialization. worker1 # [ 4.002386] systemd[1]: Reached target Basic System. client # [ 4.313485] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 4.384451] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 4.398242] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 4.416679] systemd[1]: Mounting /sysroot... client # [ 4.562494] EXT4-fs (vda): mounted filesystem 32f2a617-6fbd-4a16-9ba5-91b9449d1caa r/w with ordered data mode. Quota mode: none. client # [ 4.461188] systemd[1]: Mounted /sysroot. client # [ 4.463110] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.514928] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 3.521046] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 3.522173] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 3.522536] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.522915] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 3.531792] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 3.612212] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 4.492343] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 4.528191] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 4.535202] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 4.552369] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.628542] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker2 # [ 3.628919] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 3.628929] [drm] features: -context_init worker2 # [ 3.629723] [drm] number of scanouts: 1 worker2 # [ 3.629741] [drm] number of cap sets: 0 worker2 # [ 3.665300] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker2 # [ 3.665339] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 3.676051] Console: switching to colour frame buffer device 160x50 client # [ 4.568816] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.676712] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 4.364499] systemd[1]: Finished Coldplug All udev Devices. lb # [ 4.365543] systemd[1]: Reached target System Initialization. lb # [ 4.366330] systemd[1]: Reached target Basic System. worker2 # [ 3.756285] systemd[1]: Finished Load Kernel Modules. worker2 # [ 3.796494] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 3.801502] systemd[1]: Starting Apply Kernel Variables... client # [ 4.676188] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 4.701955] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 4.712481] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 4.715107] systemd[1]: Reloading... worker2 # [ 3.823522] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 4.410295] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 4.465318] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 4.520417] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 4.524759] systemd[1]: Reached target Initrd Root Device. worker1 # [ 4.529231] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.980211] systemd[1]: Finished Apply Kernel Variables. lb # [ 4.647335] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.992266] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 3.992561] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 4.654945] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.992604] systemd[1]: Reached target Local File Systems. lb # [ 4.666777] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 4.011604] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 4.588719] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 4.614540] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 4.056384] systemd-journald[73]: Collecting audit messages is disabled. worker1 # [ 4.623501] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 4.637364] systemd[1]: Mounting /sysroot... lb # [ 4.752408] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 4.755037] systemd[1]: Reached target Initrd Root Device. lb # [ 4.760155] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 4.741888] EXT4-fs (vda): mounted filesystem 69078a81-8b9f-412b-ab7e-fd25acca65d4 r/w with ordered data mode. Quota mode: none. lb # [ 4.830204] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 4.177265] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 4.727858] systemd[1]: Mounted /sysroot. worker1 # [ 4.731559] systemd[1]: Reached target Initrd Root File System. lb # [ 4.844130] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 4.742209] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 4.853129] systemd[1]: Mounting /sysroot... worker2 # [ 4.199569] systemd[1]: Started Journal Service. worker2 # [ 4.184468] systemd-modules-load[74]: Inserted module 'dm_mod' worker2 # [ 4.190051] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 4.760896] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 4.204773] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 4.775797] systemd[1]: Mounting /sysroot/run... worker2 # [ 4.206667] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker2 # [ 4.221301] systemd-modules-load[74]: Module 'virtio_rng' is built in worker2 # [ 4.222902] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 4.923027] EXT4-fs (vda): mounted filesystem fa3e8856-a0fc-4d3d-b184-d1a9aa0fd7fb r/w with ordered data mode. Quota mode: none. lb # [ 4.909724] systemd[1]: Mounted /sysroot. worker1 # [ 4.802717] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 4.234697] systemd[1]: Starting Create System Files and Directories... lb # [ 4.913764] systemd[1]: Reached target Initrd Root File System. lb # [ 4.924285] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 4.953186] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 4.960132] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 4.966527] systemd[1]: Reloading... worker2 # [ 4.296553] systemd[1]: Finished Create System Files and Directories. client # [ 5.188231] systemd[1]: Reloading finished in 471 ms. worker2 # [ 4.325487] systemd[1]: Starting Virtual Console Setup... client # [ 5.226232] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... client # [ 5.234842] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 5.237979] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 4.924229] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 5.241612] systemd[1]: Mounted /sysroot/run. client # [ 5.247317] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 5.249862] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 4.941196] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 5.266806] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker2 # [ 4.392771] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 5.274832] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.280714] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 4.402216] systemd[1]: Finished Virtual Console Setup. client # [ 5.287798] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 5.035809] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 5.038982] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 5.370267] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 5.061232] systemd[1]: Mounted /sysroot/run. worker1 # [ 5.075568] systemd-sysroot-fstab-check[125]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 5.390416] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.392395] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.402973] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 5.131242] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 5.136859] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 5.457190] systemd[1]: Mounted /sysroot/nix/store. client # [ 5.460166] systemd[1]: Reached target Initrd File Systems. worker1 # [ 5.164121] systemd[1]: Reload requested from client PID 125 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 5.166310] systemd[1]: Reloading... client # [ 5.515373] systemd[1]: Starting Find NixOS closure... client # [ 5.518263] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 5.568208] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 5.570264] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 5.628394] systemd[1]: Finished Find NixOS closure. client # [ 5.633628] systemd[1]: Reached target Initrd Default Target. client # [ 5.641359] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 5.698766] systemd[1]: Stopped target Initrd Default Target. client # [ 5.701082] systemd[1]: Stopped target Basic System. client # [ 5.704531] systemd[1]: Stopped target Initrd Root Device. lb # [ 5.499876] systemd[1]: Reloading finished in 539 ms. client # [ 5.712394] systemd[1]: Stopped target Path Units. client # [ 5.715677] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.721304] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 5.729291] systemd[1]: Stopped target Slice Units. client # [ 5.732112] systemd[1]: Stopped target Socket Units. client # [ 5.734839] systemd[1]: Stopped target System Initialization. client # [ 5.738673] systemd[1]: Stopped target Swaps. client # [ 5.742933] systemd[1]: Stopped target Timer Units. client # [ 5.745767] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.750894] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 5.757721] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.759541] systemd[1]: Stopped Find NixOS closure. lb # [ 5.558069] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace... client # [ 5.765320] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 5.563839] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace... client # [ 5.776264] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.464774] systemd[1]: Reloading finished in 295 ms. lb # [ 5.566965] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 5.779085] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.781922] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.897277] systemd[1]: Finished Coldplug All udev Devices. lb # [ 5.585475] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 4.912454] systemd[1]: Reached target System Initialization. worker2 # [ 4.914114] systemd[1]: Reached target Basic System. lb # [ 5.589594] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 5.793690] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 5.800390] systemd[1]: Stopped Load Kernel Modules. client # [ 5.804380] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.809771] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 5.596482] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 5.821097] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.508216] systemd-sysroot-fstab-check[125]: Requesting initrd-fs.target/start/replace... worker1 # [ 5.516312] systemd-sysroot-fstab-check[125]: Requesting swap.target/start/replace... client # [ 5.828560] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.524255] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 5.638241] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.641542] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 5.535281] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 5.848708] systemd[1]: Stopped target Local File Systems. client # [ 5.850368] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.538410] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 5.851993] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 5.853698] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.854874] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 5.545421] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 5.860425] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.862207] systemd[1]: Stopped Virtual Console Setup. client # [ 5.862953] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.863905] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.872558] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 5.875271] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.878549] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.881284] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.886834] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.891502] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.892948] systemd[1]: systemd-udevd.service: Consumed 1.245s CPU time over 3.078s wall clock time, 15.5M memory peak. client # [ 5.894421] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.895381] systemd[1]: Closed udev Control Socket. client # [ 5.900980] systemd[1]: Starting Cleanup udev Database... worker1 # [ 5.589141] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.902568] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 5.905471] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.906875] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.910774] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.911957] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.913176] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 5.611721] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.943497] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 5.632339] systemd[1]: Mounting /sysroot/nix/store... client # [ 5.946829] systemd[1]: Finished Cleanup udev Database. client # [ 5.950369] systemd[1]: Reached target Switch Root. client # [ 5.952444] systemd[1]: Starting NixOS Activation... worker2 # [ 5.117729] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 5.692180] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 5.695819] systemd[1]: Reached target Initrd File Systems. lb # [ 5.807538] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 5.812143] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 5.137849] (udev-worker)[85]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 5.705085] systemd[1]: Starting Find NixOS closure... lb # [ 5.820402] systemd[1]: Mounting /sysroot/run... worker2 # [ 5.141907] (udev-worker)[85]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 5.712694] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 5.850557] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 5.803695] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 5.830791] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 5.840166] systemd[1]: Finished Find NixOS closure. worker1 # [ 5.841753] systemd[1]: Reached target Initrd Default Target. worker1 # [ 5.870953] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 5.989517] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 6.006284] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 5.333631] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 5.337078] systemd[1]: Reached target Initrd Root Device. lb # [ 6.015756] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 5.344291] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 5.922855] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 5.927498] systemd[1]: Stopped target Basic System. worker1 # [ 5.932831] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 5.936219] systemd[1]: Stopped target Path Units. lb # [ 6.056976] systemd[1]: Mounted /sysroot/run. lb # [ 6.059132] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 5.947754] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 5.954973] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 6.065429] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.957943] systemd[1]: Stopped target Slice Units. worker1 # [ 5.960290] systemd[1]: Stopped target Socket Units. worker1 # [ 5.964338] systemd[1]: Stopped target System Initialization. worker1 # [ 5.967090] systemd[1]: Stopped target Swaps. worker1 # [ 5.989354] systemd[1]: Stopped target Timer Units. worker2 # [ 5.423893] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 6.102162] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 5.995863] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 5.997549] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 6.000421] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 5.439874] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 6.119452] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 5.445359] systemd[1]: Mounting /sysroot... worker1 # [ 6.014109] systemd[1]: Stopped Find NixOS closure. worker1 # [ 6.015806] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 6.127451] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 6.131834] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 6.024329] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 6.029658] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 6.031646] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 6.039585] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 6.046536] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 6.068911] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 6.071425] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 5.521747] EXT4-fs (vda): mounted filesystem a2eb04b8-245c-4270-8a4f-96b8e59e5161 r/w with ordered data mode. Quota mode: none. worker2 # [ 5.511671] systemd[1]: Mounted /sysroot. worker2 # [ 5.515600] systemd[1]: Reached target Initrd Root File System. worker1 # [ 6.085935] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 6.096536] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 6.098642] systemd[1]: Stopped target Local File Systems. worker1 # [ 6.102109] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 6.104563] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 6.108244] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 6.111175] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 6.115559] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 6.119034] systemd[1]: Stopped Virtual Console Setup. lb # [ 6.230278] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 6.122083] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 6.231760] systemd[1]: Reached target Initrd File Systems. worker1 # [ 6.125317] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 6.235336] systemd[1]: Starting Find NixOS closure... worker1 # [ 6.128549] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 6.132324] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 6.136335] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 6.137980] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 5.584193] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 6.259024] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 5.599606] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 6.193020] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 6.194285] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 5.628198] systemd[1]: Mounting /sysroot/run... worker1 # [ 6.195386] systemd[1]: systemd-udevd.service: Consumed 1.364s CPU time over 3.304s wall clock time, 15.3M memory peak. worker1 # [ 6.198545] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 6.306743] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 6.201922] systemd[1]: Closed udev Control Socket. worker2 # [ 5.634947] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 6.205435] systemd[1]: Starting Cleanup udev Database... worker1 # [ 6.208259] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 6.212286] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 6.216385] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 6.220350] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 6.222141] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 6.223589] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 6.351071] systemd[1]: Finished Find NixOS closure. lb # [ 6.354385] systemd[1]: Reached target Initrd Default Target. lb # [ 6.359923] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 5.686660] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 6.261286] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 6.264941] systemd[1]: Finished Cleanup udev Database. worker1 # [ 6.268973] systemd[1]: Reached target Switch Root. worker1 # [ 6.273170] systemd[1]: Starting NixOS Activation... client # [ 6.606521] initrd-nixos-activation-start[173]: booting system configuration /nix/store/a8gc22jhjd6rmf0wand1fsy50rgzy95i-nixos-system-client-test lb # [ 6.446792] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 5.773730] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 6.452281] systemd[1]: Stopped target Basic System. lb # [ 6.455548] systemd[1]: Stopped target Initrd Root Device. lb # [ 6.460620] systemd[1]: Stopped target Path Units. lb # [ 6.462442] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 6.465776] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 6.471827] systemd[1]: Stopped target Slice Units. lb # [ 6.477553] systemd[1]: Stopped target Socket Units. lb # [ 6.478926] systemd[1]: Stopped target System Initialization. lb # [ 6.484423] systemd[1]: Stopped target Swaps. lb # [ 6.486009] systemd[1]: Stopped target Timer Units. lb # [ 6.489732] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 5.815445] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 6.492809] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 6.499892] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 6.504598] systemd[1]: Stopped Find NixOS closure. lb # [ 6.506763] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 6.517315] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 6.518899] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 6.533352] systemd[1]: Stopped Apply Kernel Variables. lb # [ 6.534620] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 5.870342] systemd[1]: Mounted /sysroot/run. worker2 # [ 5.888784] systemd-sysroot-fstab-check[124]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 5.898746] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 6.594660] systemd[1]: Stopped Load Kernel Modules. lb # [ 6.598171] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 6.601957] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 5.926694] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 6.606358] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 6.612613] systemd[1]: Stopped Create System Files and Directories. lb # [ 6.614314] systemd[1]: Stopped target Local File Systems. worker2 # [ 5.940214] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 6.615587] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 6.620461] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 6.622116] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 6.624195] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 6.628304] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 6.828457] initrd-nixos-activation-start[173]: running activation script... lb # [ 6.631878] systemd[1]: Stopped Virtual Console Setup. lb # [ 6.636698] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 5.961957] systemd[1]: Reload requested from client PID 124 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 6.638423] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 6.647205] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 6.649226] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 6.650644] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 5.976254] systemd[1]: Reloading... lb # [ 6.662245] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 6.665047] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 6.672779] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 6.676551] systemd[1]: systemd-udevd.service: Consumed 1.480s CPU time over 3.962s wall clock time, 18.2M memory peak. lb # [ 6.684437] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 6.685714] systemd[1]: Closed udev Control Socket. lb # [ 6.686453] systemd[1]: Starting Cleanup udev Database... lb # [ 6.687218] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 6.691001] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 6.695162] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 6.697515] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 6.699157] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 6.701135] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 6.736849] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 6.738751] systemd[1]: Finished Cleanup udev Database. lb # [ 6.743598] systemd[1]: Reached target Switch Root. lb # [ 6.748329] systemd[1]: Starting NixOS Activation... worker1 # [ 6.666020] initrd-nixos-activation-start[170]: booting system configuration /nix/store/zwgirfamq9cjz73mhvx6r4x90a72kbbz-nixos-system-worker1-test worker1 # [ 6.877776] initrd-nixos-activation-start[170]: running activation script... worker2 # [ 6.435410] systemd[1]: Reloading finished in 468 ms. worker2 # [ 6.467176] systemd-sysroot-fstab-check[124]: Requesting initrd-fs.target/start/replace... worker2 # [ 6.475574] systemd-sysroot-fstab-check[124]: Requesting swap.target/start/replace... worker2 # [ 6.480902] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 6.498838] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 7.183110] initrd-nixos-activation-start[183]: booting system configuration /nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test worker2 # [ 6.514065] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 6.517077] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 6.573345] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 6.576175] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 6.595197] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 6.656979] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 6.661533] systemd[1]: Reached target Initrd File Systems. worker2 # [ 6.665566] systemd[1]: Starting Find NixOS closure... worker2 # [ 6.676269] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 7.391422] initrd-nixos-activation-start[183]: running activation script... worker2 # [ 6.728319] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 6.735763] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 6.759501] systemd[1]: Finished Find NixOS closure. worker2 # [ 6.777217] systemd[1]: Reached target Initrd Default Target. worker2 # [ 6.788170] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 6.851422] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 6.853654] systemd[1]: Stopped target Basic System. worker2 # [ 6.861097] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 6.863768] systemd[1]: Stopped target Path Units. worker2 # [ 6.866980] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 6.872305] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 6.877082] systemd[1]: Stopped target Slice Units. worker2 # [ 6.880984] systemd[1]: Stopped target Socket Units. worker2 # [ 6.884940] systemd[1]: Stopped target System Initialization. worker2 # [ 6.889181] systemd[1]: Stopped target Swaps. worker2 # [ 6.892284] systemd[1]: Stopped target Timer Units. worker2 # [ 6.898012] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 6.901734] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 6.907835] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 6.913692] systemd[1]: Stopped Find NixOS closure. worker2 # [ 6.916234] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 6.926933] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 6.932677] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 6.937200] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 6.945670] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 6.948269] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 6.957159] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 6.968274] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 6.973532] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 7.021475] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 7.024476] systemd[1]: Stopped target Local File Systems. worker2 # [ 7.028361] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 7.032341] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 7.034201] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 7.038543] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 7.040681] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 7.050490] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 7.051484] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 7.052654] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 7.053999] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 7.055467] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 7.056830] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 7.058227] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 7.067736] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 7.070663] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 7.960708] initrd-nixos-activation-start[196]: setting up /etc... worker2 # [ 7.124638] systemd[1]: systemd-udevd.service: Consumed 1.261s CPU time over 3.077s wall clock time, 15.2M memory peak. worker2 # [ 7.157876] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 7.160376] systemd[1]: Closed udev Control Socket. worker2 # [ 7.163900] systemd[1]: Starting Cleanup udev Database... worker2 # [ 7.165277] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 7.167256] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 7.172454] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 7.175009] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 7.176185] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 7.180233] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 7.316743] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 7.320379] systemd[1]: Finished Cleanup udev Database. worker2 # [ 7.322693] systemd[1]: Reached target Switch Root. worker2 # [ 7.324421] systemd[1]: Starting NixOS Activation... worker1 # [ 8.003133] initrd-nixos-activation-start[193]: setting up /etc... worker2 # [ 7.807746] initrd-nixos-activation-start[169]: booting system configuration /nix/store/0r31wjlygcn47dyyzl916b35v9f3ng6k-nixos-system-worker2-test worker2 # [ 7.931456] initrd-nixos-activation-start[169]: running activation script... client # [ 8.956558] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 8.960124] systemd[1]: Finished NixOS Activation. client # [ 8.966856] systemd[1]: Starting Switch Root... client # [ 9.004075] systemd[1]: Switching root. lb # [ 8.878396] initrd-nixos-activation-start[206]: setting up /etc... client # [ 9.324583] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 8.936820] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 8.938787] systemd[1]: Finished NixOS Activation. worker1 # [ 8.966041] systemd[1]: Starting Switch Root... worker1 # [ 9.012279] systemd[1]: Switching root. worker1 # [ 9.247599] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 9.641027] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 9.644429] systemd[1]: Finished NixOS Activation. lb # [ 9.647360] systemd[1]: Starting Switch Root... lb # [ 9.679944] systemd[1]: Switching root. client # [ 10.121188] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 10.127933] systemd[1]: Detected virtualization qemu. client # [ 10.130148] systemd[1]: Detected architecture arm64. client # [ 10.133772] systemd[1]: Detected first boot. client # [ 10.140133] systemd[1]: Initializing machine ID from random generator. lb # [ 9.916743] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 9.234490] initrd-nixos-activation-start[192]: setting up /etc... client # [ 10.506228] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 10.295017] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 10.300856] systemd[1]: Detected virtualization qemu. worker1 # [ 10.302704] systemd[1]: Detected architecture arm64. worker1 # [ 10.308883] systemd[1]: Detected first boot. worker1 # [ 10.317567] systemd[1]: Initializing machine ID from random generator. client # [ 11.135259] systemd[1]: Applying preset policy. worker1 # [ 10.761529] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 11.082110] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 11.087166] systemd[1]: Detected virtualization qemu. lb # [ 11.089066] systemd[1]: Detected architecture arm64. lb # [ 11.091905] systemd[1]: Detected first boot. lb # [ 11.104816] systemd[1]: Initializing machine ID from random generator. worker1 # [ 11.203795] systemd[1]: Applying preset policy. worker2 # [ 10.637096] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 10.639760] systemd[1]: Finished NixOS Activation. worker2 # [ 10.641301] systemd[1]: initrd-nixos-activation.service: Consumed 1.206s CPU time over 3.315s wall clock time, 22.7M memory peak. worker2 # [ 10.646031] systemd[1]: Starting Switch Root... worker2 # [ 10.694902] systemd[1]: Switching root. worker2 # [ 10.898370] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 11.844957] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 12.469404] systemd[1]: Applying preset policy. worker2 # [ 12.126349] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 12.131558] systemd[1]: Detected virtualization qemu. worker2 # [ 12.137848] systemd[1]: Detected architecture arm64. worker2 # [ 12.138748] systemd[1]: Detected first boot. worker2 # [ 12.153434] systemd[1]: Initializing machine ID from random generator. client # [ 13.169607] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 12.989849] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 12.623940] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 13.018086] systemd[1]: Applying preset policy. lb # [ 14.403332] systemd[1]: Populated /etc with preset unit settings. client # [ 15.919349] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 15.921612] systemd[1]: Stopped initrd-switch-root.service. client # [ 15.926017] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 15.940375] systemd[1]: Created slice Slice /system/getty. client # [ 15.945481] systemd[1]: Created slice User and Session Slice. client # [ 15.945699] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 15.945815] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 15.945867] systemd[1]: Expecting device /dev/hvc0... client # [ 15.945892] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 15.945926] systemd[1]: Reached target Local Encrypted Volumes. client # [ 15.945968] systemd[1]: Stopped target initrd-fs.target. client # [ 15.945997] systemd[1]: Stopped target initrd-root-fs.target. client # [ 15.946554] systemd[1]: Stopped target initrd-switch-root.target. client # [ 15.947057] systemd[1]: Reached target Virtual Machines and Containers. client # [ 15.947443] systemd[1]: Reached target Path Units. client # [ 15.947758] systemd[1]: Reached target Remote File Systems. client # [ 15.948048] systemd[1]: Reached target Slice Units. client # [ 15.948338] systemd[1]: Reached target Swaps. client # [ 15.978940] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 16.017907] systemd[1]: Listening on Process Core Dump Socket. client # [ 16.034313] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 16.042598] systemd[1]: Listening on Factory Reset Management. client # [ 16.045821] systemd[1]: Listening on Hostname Service Socket. client # [ 16.083972] systemd[1]: Starting Journal Log Access Socket... client # [ 16.088161] systemd[1]: Listening on Journal Audit Socket. client # [ 16.105648] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 16.118310] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 16.124777] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 16.129218] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 16.150944] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 16.156146] systemd[1]: Listening on udev Control Socket. client # [ 16.162745] systemd[1]: Listening on udev Varlink Socket. client # [ 16.177990] systemd[1]: Mounting Huge Pages File System... client # [ 16.194223] systemd[1]: Mounting POSIX Message Queue File System... client # [ 16.221576] systemd[1]: Mounting Kernel Debug File System... client # [ 16.230350] systemd[1]: Mounting Kernel Trace File System... client # [ 16.256816] systemd[1]: Starting Create List of Static Device Nodes... client # [ 16.285190] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 16.292505] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 16.305045] systemd[1]: Mounting Kernel Configuration File System... client # [ 16.315277] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 16.326245] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 16.377947] systemd[1]: Starting Load Kernel Module fuse... client # [ 16.383024] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 15.416803] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 16.026846] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 16.029031] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 16.033048] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 16.044280] systemd[1]: Created slice Slice /system/getty. worker1 # [ 16.047767] systemd[1]: Created slice User and Session Slice. worker1 # [ 16.049893] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 16.052821] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 16.056218] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 16.058929] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 16.062128] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 16.063907] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 16.067146] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 16.070050] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 16.072729] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 16.075564] systemd[1]: Reached target Path Units. worker1 # [ 16.076904] systemd[1]: Reached target Remote File Systems. worker1 # [ 16.078362] systemd[1]: Reached target Slice Units. worker1 # [ 16.086741] systemd[1]: Reached target Swaps. client # [ 16.485051] systemd[1]: Starting Journal Service... worker1 # [ 16.096507] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 16.109273] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 16.118524] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 16.136390] systemd[1]: Listening on Factory Reset Management. worker1 # [ 16.143934] systemd[1]: Listening on Hostname Service Socket. client # [ 16.540355] systemd[1]: Starting Load Kernel Modules... worker1 # [ 16.159724] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 16.169113] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 16.183393] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 16.188175] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 16.191813] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 16.589834] fuse: init (API version 7.45) worker1 # [ 16.198402] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 16.601786] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 16.624058] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 16.629585] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 16.650052] systemd[1]: Starting Coldplug All udev Devices... client # [ 16.664172] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 16.280070] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 16.280950] systemd[1]: Listening on udev Control Socket. worker1 # [ 16.281466] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 16.299431] systemd[1]: Mounting Huge Pages File System... worker1 # [ 16.305570] systemd[1]: Mounting POSIX Message Queue File System... client # [ 16.716006] systemd[1]: Mounted Huge Pages File System. client # [ 16.716696] systemd[1]: Mounted POSIX Message Queue File System. client # [ 16.717191] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 16.319839] systemd[1]: Mounting Kernel Debug File System... client # [ 16.722863] systemd[1]: Mounted Kernel Trace File System. client # [ 16.724138] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 16.330772] systemd[1]: Mounting Kernel Trace File System... client # [ 16.730387] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 16.735409] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 16.739773] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 16.744335] systemd[1]: Finished Load Kernel Module fuse. worker1 # [ 16.362262] systemd[1]: Starting Create List of Static Device Nodes... client # [ 16.771218] systemd[1]: Mounting FUSE Control File System... worker1 # [ 16.384701] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 16.391336] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 16.495171] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 16.498537] systemd[1]: Stopped initrd-switch-root.service. lb # [ 16.504721] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 16.407103] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 16.415924] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 16.517609] systemd[1]: Created slice Slice /system/getty. worker1 # [ 16.419904] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 16.844071] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 16.460469] systemd[1]: Starting Load Kernel Module fuse... client # [ 16.862978] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 16.467001] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 16.595252] systemd[1]: Created slice User and Session Slice. lb # [ 16.597758] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 16.602418] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 16.605604] systemd[1]: Expecting device /dev/hvc0... client # [ 16.902472] EXT4-fs (vda): re-mounted 32f2a617-6fbd-4a16-9ba5-91b9449d1caa. lb # [ 16.609085] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 16.611994] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 16.615027] systemd[1]: Stopped target initrd-fs.target. lb # [ 16.617703] systemd[1]: Stopped target initrd-root-fs.target. client # [ 16.909890] systemd-journald[268]: Collecting audit messages is enabled. lb # [ 16.620452] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 16.623377] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 16.522946] systemd[1]: Starting Journal Service... lb # [ 16.627852] systemd[1]: Reached target Path Units. lb # [ 16.630815] systemd[1]: Reached target Remote File Systems. lb # [ 16.633304] systemd[1]: Reached target Slice Units. lb # [ 16.635445] systemd[1]: Reached target Swaps. lb # [ 16.647139] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 16.656508] systemd[1]: Listening on Process Core Dump Socket. lb # [ 16.662028] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 16.668440] systemd[1]: Listening on Factory Reset Management. client # [ 16.824997] systemd[1]: Queued start job for default target Multi-User System. lb # [ 16.671924] systemd[1]: Listening on Hostname Service Socket. client # [ 16.973318] systemd[1]: Started Journal Service. lb # [ 16.685012] systemd[1]: Starting Journal Log Access Socket... lb # [ 16.689097] systemd[1]: Listening on Journal Audit Socket. lb # [ 16.700005] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 16.703235] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 16.706530] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 16.710751] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 16.629556] systemd[1]: Starting Load Kernel Modules... lb # [ 16.764139] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 16.767964] systemd[1]: Listening on udev Control Socket. lb # [ 16.770194] systemd[1]: Listening on udev Varlink Socket. lb # [ 16.784125] systemd[1]: Mounting Huge Pages File System... lb # [ 16.791399] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 16.805738] systemd[1]: Mounting Kernel Debug File System... lb # [ 16.830334] systemd[1]: Mounting Kernel Trace File System... lb # [ 16.859861] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 16.776316] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 16.882654] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 16.885370] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 16.900555] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 16.804163] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 16.806611] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 16.914023] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 16.916600] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 16.824638] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 16.832550] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 16.842785] systemd[1]: Mounted Huge Pages File System. worker1 # [ 16.847945] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 16.850089] systemd[1]: Mounted Kernel Debug File System. lb # [ 16.950235] systemd[1]: Starting Load Kernel Module fuse... lb # [ 16.953740] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 16.854866] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 16.860074] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 16.910547] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 16.922960] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 17.116939] systemd[1]: Starting Journal Service... worker1 # [ 17.030306] EXT4-fs (vda): re-mounted 69078a81-8b9f-412b-ab7e-fd25acca65d4. worker1 # [ 17.069097] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 17.073396] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 17.074298] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 17.177764] systemd[1]: Starting Load Kernel Modules... worker1 # [ 17.088510] systemd-journald[265]: Collecting audit messages is enabled. lb # [ 17.199738] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 17.092481] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 17.104786] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 17.137524] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 17.138846] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 17.245297] fuse: init (API version 7.45) worker1 # [ 17.150504] systemd[1]: Started Journal Service. lb # [ 17.251964] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 17.132828] systemd[1]: Queued start job for default target Multi-User System. lb # [ 17.265001] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 17.139603] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 17.291571] systemd[1]: Starting Coldplug All udev Devices... client # [ 16.858679] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 17.167545] systemd-oomd[267]: No swap; memory pressure usage will be degraded client # [ 17.594831] systemd-journald[268]: Received client request to flush runtime journal. worker1 # [ 17.196109] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 17.327935] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 17.205967] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 17.353158] systemd[1]: Mounted Huge Pages File System. worker1 # [ 17.255917] fuse: init (API version 7.45) worker1 # [ 17.231243] systemd-modules-load[266]: Module 'atkbd' is built in lb # [ 17.363182] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 17.371544] systemd[1]: Mounted Kernel Debug File System. client # [ 17.559522] systemd-oomd[270]: No swap; memory pressure usage will be degraded worker1 # [ 17.249072] systemd-modules-load[266]: Module 'loop' is built in lb # [ 17.379077] systemd[1]: Mounted Kernel Trace File System. client # [ 17.570688] systemd-modules-load[269]: Module 'atkbd' is built in client # [ 17.574494] systemd-modules-load[269]: Module 'loop' is built in lb # [ 17.394733] systemd[1]: Finished Create List of Static Device Nodes. client # [ 17.580520] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 17.268551] systemd[1]: Finished Load Kernel Modules. client # [ 17.587292] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 17.403376] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 17.277046] systemd[1]: Starting Firewall... client # [ 17.594211] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 17.409830] systemd-journald[278]: Collecting audit messages is enabled. client # [ 17.600132] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 17.301345] systemd[1]: Starting Apply Kernel Variables... client # [ 17.614732] systemd[1]: Starting Load/Save OS Random Seed... client # [ 17.620237] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 17.628210] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 17.632349] systemd[1]: Finished Load Kernel Modules. worker1 # [ 17.318506] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 17.639688] systemd[1]: Starting Apply Kernel Variables... client # [ 17.648116] systemd[1]: Mounted FUSE Control File System. client # [ 17.652455] systemd[1]: Finished Load/Save OS Random Seed. client # [ 17.654241] systemd[1]: Reached target First Boot Complete. worker1 # [ 17.343765] systemd[1]: Finished Load Kernel Module fuse. client # [ 17.660658] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 17.669682] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 17.360408] systemd[1]: Mounting FUSE Control File System... client # [ 17.676487] systemd[1]: Finished Apply Kernel Variables. client # [ 17.680321] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 17.681871] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 17.684654] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 17.375078] systemd[1]: Mounted FUSE Control File System. worker1 # [ 17.380984] systemd[1]: Finished Load/Save OS Random Seed. client # [ 17.694837] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 17.422396] systemd-journald[265]: Received client request to flush runtime journal. lb # [ 17.507092] systemd[1]: Queued start job for default target Multi-User System. lb # [ 17.516015] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 17.516967] systemd[1]: Mounted Kernel Configuration File System. lb # [ 17.517678] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 17.522651] systemd[1]: Finished Load Kernel Module fuse. lb # [ 17.545940] systemd[1]: Mounting FUSE Control File System... lb # [ 17.584892] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 16.919143] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 16.922637] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 16.929698] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 17.609677] systemd[1]: Started Journal Service. worker2 # [ 16.937344] systemd[1]: Created slice Slice /system/getty. worker2 # [ 16.941755] systemd[1]: Created slice User and Session Slice. worker1 # [ 17.493087] systemd[1]: Reached target First Boot Complete. lb # [ 17.615853] EXT4-fs (vda): re-mounted fa3e8856-a0fc-4d3d-b184-d1a9aa0fd7fb. worker2 # [ 16.946790] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 16.950306] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 16.952407] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 16.953506] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 17.504338] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 16.958192] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 16.961521] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 16.964625] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 17.517720] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 16.968000] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 16.971574] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 16.973587] systemd[1]: Reached target Path Units. worker2 # [ 16.975520] systemd[1]: Reached target Remote File Systems. worker1 # [ 17.526039] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 16.978924] systemd[1]: Reached target Slice Units. worker2 # [ 16.980528] systemd[1]: Reached target Swaps. worker2 # [ 16.990262] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 17.010211] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 17.566395] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 17.018831] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 17.028545] systemd[1]: Listening on Factory Reset Management. client # [ 17.891846] systemd[1]: Mounting /run/wrappers... worker2 # [ 17.030819] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 17.041098] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 17.044529] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 17.058090] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 17.062310] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 17.103479] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 17.104002] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 17.988836] systemd[1]: Mounted /run/wrappers. worker2 # [ 17.144357] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 18.010258] systemd[1]: Reached target Local File Systems. worker2 # [ 17.147907] systemd[1]: Listening on udev Control Socket. worker2 # [ 17.153615] systemd[1]: Listening on udev Varlink Socket. client # [ 18.023295] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 17.166257] systemd[1]: Mounting Huge Pages File System... client # [ 18.046401] systemd[1]: Starting register-nix-paths.service... worker1 # [ 17.742617] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 17.744757] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 17.752344] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 17.206407] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 17.235279] systemd[1]: Mounting Kernel Debug File System... client # [ 18.112808] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 18.118533] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 18.125542] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 17.274208] systemd[1]: Mounting Kernel Trace File System... client # [ 18.151801] systemd-udevd[295]: Using default interface naming scheme 'v261'. worker2 # [ 17.307687] systemd[1]: Starting Create List of Static Device Nodes... client # [ 18.196324] systemd[1]: Starting Create System Files and Directories... worker2 # [ 17.366464] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 17.370090] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 17.384299] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 17.384855] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 17.385234] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 17.410340] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 17.419996] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 17.441418] systemd[1]: Starting Journal Service... worker2 # [ 17.454856] systemd[1]: Starting Load Kernel Modules... client # [ 18.302177] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 18.018425] systemd[1]: Mounting /run/wrappers... client # [ 18.334943] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 17.481414] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 17.522441] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 18.168314] systemd-journald[278]: Received client request to flush runtime journal. worker2 # [ 17.516605] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 17.530682] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 18.110211] systemd[1]: Mounted /run/wrappers. worker1 # [ 18.111678] systemd[1]: Reached target Local File Systems. worker2 # [ 17.566685] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 18.124132] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 18.236814] systemd-modules-load[279]: Module 'atkbd' is built in worker1 # [ 18.132120] systemd[1]: Starting register-nix-paths.service... lb # [ 18.244751] systemd-modules-load[279]: Module 'loop' is built in worker2 # [ 17.586447] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 17.592353] systemd[1]: Mounted Huge Pages File System. worker2 # [ 17.597797] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 18.254501] systemd-oomd[280]: No swap; memory pressure usage will be degraded worker2 # [ 17.599488] systemd[1]: Mounted Kernel Debug File System. lb # [ 18.268661] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 17.612403] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 17.616072] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 18.176564] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 18.181495] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 18.292462] systemd[1]: Finished Load Kernel Modules. lb # [ 18.298142] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 18.527248] systemd[1]: Finished Create System Files and Directories. worker1 # [ 18.216993] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 18.324895] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 18.336228] systemd[1]: Starting Firewall... client # [ 18.539700] systemd[1]: Starting Rebuild Journal Catalog... client # [ 18.553515] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 18.349408] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 18.235653] systemd[1]: Starting Create System Files and Directories... lb # [ 18.358932] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 18.373320] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 18.379049] systemd[1]: Starting Apply Kernel Variables... lb # [ 18.391296] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 18.616302] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 18.413195] systemd[1]: Mounted FUSE Control File System. lb # [ 18.416942] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 18.633168] systemd[1]: Finished Coldplug All udev Devices. lb # [ 18.429301] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 18.432994] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 18.440675] systemd[1]: Reached target First Boot Complete. lb # [ 18.445424] systemd[1]: Finished Apply Kernel Variables. lb # [ 18.456879] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 18.458751] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 17.801116] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 18.460992] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 18.470244] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 17.815880] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 18.719801] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 18.418986] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 18.433775] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 18.443911] systemd-udevd[303]: Using default interface naming scheme 'v261'. lb # [ 18.596417] systemd-udevd[300]: Using default interface naming scheme 'v261'. lb # [ 18.620764] systemd[1]: Mounting /run/wrappers... client # [ 18.827679] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 17.971755] EXT4-fs (vda): re-mounted a2eb04b8-245c-4270-8a4f-96b8e59e5161. client # [ 18.844976] systemd[1]: Starting Update is Completed... worker2 # [ 17.997807] systemd-journald[264]: Collecting audit messages is enabled. worker2 # [ 18.016076] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 18.568268] systemd[1]: Finished Create System Files and Directories. worker2 # [ 18.023505] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 18.579923] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 18.029324] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 18.037321] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 18.039542] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 18.592749] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 18.031330] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 18.036732] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 18.715945] systemd[1]: Mounted /run/wrappers. worker2 # [ 18.064904] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 18.067129] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 18.053094] systemd-modules-load[265]: Module 'atkbd' is built in lb # [ 18.725402] systemd[1]: Reached target Local File Systems. worker2 # [ 18.074383] systemd[1]: Started Journal Service. client # [ 18.952550] systemd[1]: Finished Update is Completed. worker2 # [ 18.073951] systemd-modules-load[265]: Module 'loop' is built in lb # [ 18.752677] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 18.077717] systemd-oomd[266]: No swap; memory pressure usage will be degraded worker2 # [ 18.107361] systemd[1]: Finished Load Kernel Modules. worker2 # [ 18.121480] systemd[1]: Starting Firewall... worker2 # [ 18.142742] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 18.152363] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 18.185284] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 18.882915] systemd[1]: Starting register-nix-paths.service... worker2 # [ 18.304203] fuse: init (API version 7.45) worker1 # [ 18.857186] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 18.896993] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 18.902475] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 19.042970] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 18.384176] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker2 # [ 18.386989] systemd[1]: Finished Load Kernel Module fuse. lb # [ 19.060495] systemd[1]: Starting Create System Files and Directories... worker2 # [ 18.405126] systemd[1]: Mounting FUSE Control File System... lb # [ 19.163127] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 19.182936] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 18.511299] systemd[1]: Mounted FUSE Control File System. worker2 # [ 18.536391] systemd-journald[264]: Received client request to flush runtime journal. worker1 # [ 19.090006] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 19.097485] systemd[1]: Starting Update is Completed... worker1 # [ 19.187733] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 18.636621] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 18.647255] systemd[1]: Reached target First Boot Complete. worker2 # [ 18.654146] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 18.657860] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 19.230456] systemd[1]: Finished Update is Completed. lb # [ 19.342728] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 18.667380] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 18.674492] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 19.372536] systemd[1]: Finished Create System Files and Directories. lb # [ 19.390219] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 19.428359] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 19.361563] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 18.844337] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 18.845472] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 18.848334] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 19.799337] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 19.801571] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 19.635578] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 18.971090] systemd[1]: Mounting /run/wrappers... worker2 # [ 19.059001] systemd[1]: Mounted /run/wrappers. worker2 # [ 19.078742] systemd[1]: Reached target Local File Systems. worker2 # [ 19.084623] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 19.097603] systemd[1]: Starting register-nix-paths.service... worker2 # [ 19.106298] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 19.116788] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 19.799646] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 19.132601] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 19.807734] systemd[1]: Starting Update is Completed... worker2 # [ 19.144880] systemd[1]: Starting Create System Files and Directories... lb # [ 20.059494] systemd[1]: Finished Update is Completed. lb # [ 20.126090] systemd[1]: Finished Coldplug All udev Devices. client # [ 20.638543] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker2 # [ 19.720588] systemd-udevd[307]: Using default interface naming scheme 'v261'. worker2 # [ 19.769212] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 19.776463] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 20.415524] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 20.419798] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 19.904182] systemd[1]: Finished Create System Files and Directories. worker2 # [ 19.920441] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 19.930950] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 20.093850] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 20.121711] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 20.215981] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 20.944561] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 20.948340] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 20.274875] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 20.294061] systemd[1]: Starting Update is Completed... client # [ 21.216617] systemd[1]: Starting Virtual Console Setup... worker2 # [ 20.426868] systemd[1]: Finished Update is Completed. client # [ 21.483952] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 21.226266] systemd[1]: Finished Firewall. worker1 # [ 21.438429] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 21.613071] systemd[1]: Finished register-nix-paths.service. lb # [ 21.618172] systemd[1]: Reached target System Initialization. lb # [ 21.622045] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 21.627613] systemd[1]: Started niks3 garbage collection timer. client # [ 21.842605] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 21.635062] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 21.643981] systemd[1]: Reached target Timer Units. lb # [ 21.650469] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 21.658236] systemd[1]: Listening on niks3 server socket. lb # [ 21.663202] systemd[1]: Listening on Nix Daemon Socket. lb # [ 21.669456] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 21.673049] systemd[1]: Reached target Socket Units. lb # [ 21.681494] systemd[1]: Reached target Basic System. lb # [ 21.688930] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 21.696860] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 21.719916] systemd[1]: Starting Post-Boot Actions... client # [ 21.927704] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 21.765925] systemd[1]: Started Reset console on configuration changes. client # [ 22.011277] systemd[1]: Finished register-nix-paths.service. lb # [ 21.821807] systemd[1]: Starting resolvconf update... client # [ 22.049644] (udev-worker)[394]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 22.062518] (udev-worker)[394]: Network interface NamePolicy= disabled on kernel command line. lb # [ 21.873832] systemd[1]: Started rustfs.service. lb # [ 21.941291] systemd[1]: Starting rustfs-bucket.service... client # [ 22.201364] (udev-worker)[399]: Network interface NamePolicy= disabled on kernel command line. lb # [ 22.003077] systemd[1]: Finished Post-Boot Actions. lb # [ 22.047573] nsncd[494]: Sep 20 12:21:15.020 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 22.066289] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 21.393370] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 22.069997] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 21.396343] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 22.076358] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 22.078027] systemd[1]: Reached target User and Group Name Lookups. client # [ 22.308594] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 22.313227] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 22.320693] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 22.323621] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 22.327135] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 22.338283] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 22.339891] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 22.343378] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 22.390236] systemd-vconsole-setup[392]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 22.396419] systemd[1]: Finished Virtual Console Setup. lb # [ 22.158550] systemd[1]: Starting User Login Management... client # [ 22.648049] mousedev: PS/2 mouse device common for all mice lb # [ 22.446413] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 22.538206] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 22.724687] systemd[1]: Finished Firewall. lb # [ 22.732591] systemd-logind[527]: New seat seat0. lb # [ 22.778401] systemd[1]: Started User Login Management. worker1 # [ 22.690237] systemd[1]: Starting Virtual Console Setup... lb # [ 22.799806] systemd[1]: Starting linger-users.service... lb # [ 22.857204] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 22.859479] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 22.753473] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 22.755866] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 22.201999] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 22.868551] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 22.874166] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 22.768953] systemd[1]: Starting Virtual Console Setup... lb # [ 22.888878] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 22.897053] systemd[1]: nscd.service: Deactivated successfully. lb # [ 22.907100] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 22.934054] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 22.273251] systemd[1]: Finished Firewall. lb # [ 22.998075] dbus-broker-launch[526]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 23.031328] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 23.044787] dbus-broker-launch[526]: NSS returned no entry for 'systemd-timesync' lb # [ 23.054557] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 23.062317] systemd[1]: Finished linger-users.service. lb # [ 23.063954] dbus-broker-launch[526]: Invalid user-name in /nix/store/r3k08synkldj3yxnxmc97ljig0y68d44-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 22.983377] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 23.026579] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 23.064351] (udev-worker)[488]: Network interface NamePolicy= disabled on kernel command line. lb # [ 23.173597] nsncd[599]: Sep 20 12:21:16.144 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 23.180634] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 23.074835] (udev-worker)[487]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 23.189390] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 23.084367] (udev-worker)[487]: Network interface NamePolicy= disabled on kernel command line. lb # [ 23.192918] systemd[1]: Reached target User and Group Name Lookups. lb # [ 23.206700] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 23.185742] systemd[1]: Finished register-nix-paths.service. lb # [ 23.330723] systemd[1]: Finished resolvconf update. lb # [ 23.333124] dbus-broker-launch[526]: Ready lb # [ 23.340802] systemd[1]: Reached target Preparation for Network. lb # [ 23.350486] systemd[1]: Starting DHCP Client... lb # [ 23.369579] systemd[1]: Starting Extra networking commands.... worker1 # [ 23.369992] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 23.383762] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 23.397887] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 23.401319] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 23.408648] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 23.420480] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 23.426503] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 23.432228] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 23.971904] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 23.974679] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 23.977565] systemd[1]: Reached target System Initialization. client # [ 23.979651] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 23.983737] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 23.987785] systemd[1]: Reached target Timer Units. client # [ 23.993274] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 23.997697] systemd[1]: Listening on Nix Daemon Socket. client # [ 24.001101] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 24.005143] systemd[1]: Reached target Socket Units. client # [ 24.007807] systemd[1]: Reached target Basic System. client # [ 24.012706] systemd[1]: Started backdoor.service. worker2 # [ 23.132967] systemd[1]: Starting Virtual Console Setup... client # [ 24.018714] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 24.042698] systemd[1]: Starting nftables firewall... worker2 # [ 23.142956] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 24.059068] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 24.140528] systemd[1]: Starting Post-Boot Actions... client # [ 24.148907] systemd[1]: Started Reset console on configuration changes. worker1 # [ 23.882204] mousedev: PS/2 mouse device common for all mice client # [ 24.180523] systemd[1]: Starting resolvconf update... client # [ 24.253459] systemd[1]: Starting D-Bus System Message Bus... lb # [ 24.161422] dhcpcd[632]: dhcpcd-10.3.2 starting lb # [ 24.245595] dhcpcd[655]: dev: loaded udev client # connecting to host... client # [ 24.493920] nsncd[474]: Sep 20 12:21:17.462 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 24.508554] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 23.637409] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 24.322352] dhcpcd[655]: no valid interfaces found lb # [ 24.323355] dhcpcd[655]: no valid interfaces found client # [ 24.521225] systemd[1]: Finished Post-Boot Actions. lb # [ 24.330376] dhcpcd[655]: libudev: received NULL device lb # [ 24.331620] dhcpcd[655]: libudev: received NULL device worker2 # [ 23.663247] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 24.231843] systemd-vconsole-setup[500]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 24.549877] systemd[1]: Reached target Host and Network Name Lookups. client # [ 24.552422] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 24.243422] systemd[1]: Finished Virtual Console Setup. client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 24.587974] systemd[1]: Starting User Login Management... client: connected to guest root shell client: (connecting took 24.93 seconds) client: (finished: waiting for the VM to finish booting, in 24.93 seconds) client # [ 24.686761] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 23.828426] systemd[1]: Finished register-nix-paths.service. lb # [ 24.530526] systemd[1]: Finished Extra networking commands.. lb # [ 24.539178] systemd[1]: Reached target Network. worker2 # [ 23.870002] (udev-worker)[491]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 23.882002] (udev-worker)[491]: Network interface NamePolicy= disabled on kernel command line. lb # [ 24.557511] systemd[1]: Starting PostgreSQL Server... worker2 # [ 23.886204] (udev-worker)[494]: Network interface NamePolicy= disabled on kernel command line. lb # [ 24.574177] systemd[1]: Starting Permit User Sessions... lb # [ 24.627715] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 24.654625] systemd[1]: Starting Virtual Console Setup... client # [ 24.886339] dbus-broker-launch[480]: Looking up NSS user entry for 'systemd-timesync'... client # [ 24.898839] systemd-logind[507]: New seat seat0. lb # [ 24.721845] systemd[1]: Finished Permit User Sessions. client # [ 24.919234] systemd-logind[507]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 24.935216] systemd-logind[507]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 24.953844] systemd[1]: Started User Login Management. lb # [ 24.757331] systemd[1]: Started Getty on tty1. lb # [ 24.765441] systemd[1]: Reached target Login Prompts. client # [ 24.960344] dbus-broker-launch[480]: NSS returned no entry for 'systemd-timesync' lb # [ 24.774271] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 24.978160] dbus-broker-launch[480]: Invalid user-name in /nix/store/i87y3v12qnxz4jgnndbs0w0ih92vmmjw-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 24.988777] systemd[1]: Starting linger-users.service... lb # [ 24.784560] systemd[1]: Stopped Virtual Console Setup. lb # [ 24.824446] systemd[1]: Starting Virtual Console Setup... worker2 # [ 24.169781] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 24.182539] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 24.193380] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 24.203229] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 24.207539] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 24.217321] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 25.103471] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 24.222488] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 24.230338] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 25.172566] systemd[1]: linger-users.service: Deactivated successfully. client # [ 25.180863] systemd[1]: Finished linger-users.service. worker1 # [ 24.874416] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 24.879038] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 24.885180] systemd[1]: Reached target System Initialization. worker1 # [ 24.887846] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 24.892349] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 25.191011] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 25.210409] systemd[1]: Stopping Host and Network Name Lookups... client # [ 25.211776] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 24.899107] systemd[1]: Reached target Timer Units. worker1 # [ 24.903399] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 24.909578] systemd[1]: Listening on Nix Daemon Socket. client # [ 25.219843] systemd[1]: Stopping User and Group Name Lookups... client # [ 25.227427] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 25.236962] dbus-broker-launch[480]: Ready client # [ 25.238103] systemd[1]: nscd.service: Deactivated successfully. client # [ 25.239095] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 24.919206] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 24.928348] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 24.936904] systemd[1]: Reached target Socket Units. worker1 # [ 24.951521] systemd[1]: Reached target Basic System. worker1 # [ 24.954983] systemd[1]: Started backdoor.service. worker1 # [ 24.966670] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 24.983892] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 25.301807] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 24.998968] systemd[1]: Starting Post-Boot Actions... worker1 # [ 25.009823] systemd[1]: Started Reset console on configuration changes. worker1 # [ 25.038938] systemd[1]: Starting resolvconf update... worker1 # [ 25.061462] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 24.535905] mousedev: PS/2 mouse device common for all mice worker2 # [ 24.569735] systemd-vconsole-setup[499]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 25.456859] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 25.460392] nsncd[580]: Sep 20 12:21:18.428 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 25.468923] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 24.591599] systemd[1]: Finished Virtual Console Setup. client # [ 25.476750] systemd[1]: Reached target User and Group Name Lookups. client # [ 25.536262] systemd[1]: Finished resolvconf update. client # [ 25.547398] systemd[1]: Starting DHCP Client... worker1 # [ 25.265686] systemd[1]: Finished Post-Boot Actions. worker1 # [ 25.338658] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 25.377814] nsncd[582]: Sep 20 12:21:18.367 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # connecting to host... worker1 # [ 25.399375] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 25.408752] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 25.418744] systemd[1]: Starting User Login Management... worker1 # [ 25.435299] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 25.716601] postgresql-pre-start[707]: The files belonging to this database system will be owned by user "postgres". lb # [ 25.719754] postgresql-pre-start[707]: This user must also own the server process. lb # [ 25.744686] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 25.968559] dhcpcd[616]: dhcpcd-10.3.2 starting lb # [ 25.757680] postgresql-pre-start[707]: The database cluster will be initialized with locale "en_US.UTF-8". worker1 # [ 25.672435] dbus-broker-launch[586]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 25.768513] postgresql-pre-start[707]: The default database encoding has accordingly been set to "UTF8". lb # [ 25.800872] postgresql-pre-start[707]: The default text search configuration will be set to "english". lb # [ 25.802893] postgresql-pre-start[707]: Data page checksums are enabled. lb # [ 25.809229] postgresql-pre-start[707]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 25.818017] postgresql-pre-start[707]: creating subdirectories ... ok client # [ 26.027027] dhcpcd[623]: dev: loaded udev lb # [ 25.819469] postgresql-pre-start[707]: selecting dynamic shared memory implementation ... posix worker1 # [ 25.728180] dbus-broker-launch[586]: NSS returned no entry for 'systemd-timesync' worker1 # [ 25.736316] dbus-broker-launch[586]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 26.204556] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 25.816840] systemd-logind[596]: New seat seat0. worker1 # [ 25.824619] systemd-logind[596]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 25.834188] systemd-logind[596]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 25.838036] systemd[1]: Started User Login Management. worker1 # [ 25.842435] systemd[1]: Starting linger-users.service... worker1 # [ 25.888638] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 25.939797] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 25.948534] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 25.967274] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 25.970491] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 25.979789] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 25.993373] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 25.994798] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 26.008363] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 26.020781] dbus-broker-launch[586]: Ready lb # [ 26.151899] (udev-worker)[711]: Network interface NamePolicy= disabled on kernel command line. client # [ 26.484658] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 26.069576] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 26.071313] systemd[1]: Finished linger-users.service. lb # [ 26.198967] postgresql-pre-start[707]: selecting default "max_connections" ... 100 lb # [ 26.204591] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 26.220950] (udev-worker)[718]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 26.231646] (udev-worker)[718]: Network interface NamePolicy= disabled on kernel command line. lb # [ 26.268812] 8021q: 802.1Q VLAN Support v1.8 lb # [ 26.252099] systemd[1]: Started backdoor.service. worker1 # [ 26.147309] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 26.151351] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 26.156807] nsncd[654]: Sep 20 12:21:19.179 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 26.580430] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 26.581020] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 26.159877] systemd[1]: Reached target User and Group Name Lookups. client # [ 26.591881] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 26.592338] cfg80211: failed to load regulatory.db client # [ 26.523993] systemd[1]: Finished nftables firewall. client # [ 26.528487] systemd[1]: Reached target Preparation for Network. client # [ 26.544269] systemd[1]: Starting Address configuration of eth1... worker2 # [ 25.671731] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 25.674289] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 25.680839] systemd[1]: Reached target System Initialization. worker2 # [ 25.682894] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 25.686563] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 26.256450] systemd[1]: Finished resolvconf update. worker2 # [ 25.688920] systemd[1]: Reached target Timer Units. worker2 # [ 25.690056] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 25.691461] systemd[1]: Listening on Nix Daemon Socket. client # [ 26.576055] systemd[1]: Starting Extra networking commands.... worker1 # [ 26.259061] systemd[1]: Reached target Preparation for Network. worker2 # [ 25.696171] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 26.265019] systemd[1]: Starting DHCP Client... worker2 # [ 25.698912] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 25.701265] systemd[1]: Reached target Socket Units. worker2 # [ 25.702642] systemd[1]: Reached target Basic System. worker1 # [ 26.271297] systemd[1]: Starting Address configuration of eth1... worker2 # [ 25.711947] systemd[1]: Started backdoor.service. worker2 # [ 25.722245] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 26.282595] systemd[1]: Starting Extra networking commands.... worker2 # [ 25.732672] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 25.739735] systemd[1]: Starting Post-Boot Actions... worker2 # [ 25.751722] systemd[1]: Started Reset console on configuration changes. worker2 # [ 25.762518] systemd[1]: Starting resolvconf update... worker2 # [ 25.783867] systemd[1]: Starting D-Bus System Message Bus... client # [ 26.723598] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 26.727039] systemd[1]: Stopped Virtual Console Setup. client # [ 26.733611] systemd[1]: Stopping Virtual Console Setup... client # [ 26.749948] systemd[1]: Starting Virtual Console Setup... client # [ 26.864930] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 26.760593] dhcpcd[623]: eth0: waiting for carrier client # [ 26.776382] dhcpcd[623]: libudev: received NULL device client # [ 26.777830] dhcpcd[623]: libudev: received NULL device client # [ 26.782374] dhcpcd[623]: eth0: carrier acquired client # [ 26.831526] dhcpcd[623]: DUID 00:01:00:01:32:42:8c:3f:52:54:00:12:34:56 client # [ 26.835701] dhcpcd[623]: eth0: IAID 00:12:34:56 client # [ 26.840319] dhcpcd[623]: eth0: adding address fe80::5054:ff:fe12:3456 lb # connecting to host... lb # [ 26.688167] postgresql-pre-start[707]: selecting default "shared_buffers" ... 128MB client # [ 27.020593] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 26.026807] systemd[1]: Finished Post-Boot Actions. client # [ 26.921702] systemd-logind[507]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 26.761719] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 26.956991] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 26.971427] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 26.977343] systemd[1]: Stopped Virtual Console Setup. client # [ 26.994188] network-addresses-eth1-start[651]: adding address 192.168.1.1/24... done worker1 # [ 26.707603] network-addresses-eth1-start[682]: adding address 192.168.1.3/24... done client # [ 27.026164] systemd[1]: Starting Virtual Console Setup... client # [ 27.074713] network-addresses-eth1-start[651]: adding address 2001:db8:1::1/64... done worker1 # [ 26.760161] network-addresses-eth1-start[682]: adding address 2001:db8:1::3/64... done worker1 # [ 26.771070] dhcpcd[689]: dhcpcd-10.3.2 starting worker2 # connecting to host... lb # [ 26.980281] systemd-logind[527]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 26.324397] nsncd[570]: Sep 20 12:21:19.832 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 26.327654] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 27.015898] systemd-vconsole-setup[697]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 26.912541] systemd[1]: Finished Address configuration of eth1. worker2 # [ 26.345835] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 27.025899] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 26.919610] dhcpcd[722]: dev: loaded udev worker2 # [ 26.347442] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 26.361356] systemd[1]: Starting User Login Management... lb # [ 27.058232] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 27.058917] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 26.369603] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 27.066204] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 27.066671] cfg80211: failed to load regulatory.db lb # [ 27.049696] systemd[1]: Finished Virtual Console Setup. worker1 # [ 26.997749] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 27.002783] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 27.082272] systemd[1]: Starting Address configuration of eth1... client # [ 27.294714] systemd[1]: Finished Address configuration of eth1. client # [ 27.351997] systemd[1]: Finished Extra networking commands.. client # [ 27.361263] systemd[1]: Reached target Network. client # [ 27.368952] systemd[1]: Starting Permit User Sessions... client # [ 27.442603] systemd[1]: Finished Permit User Sessions. client # [ 27.451499] systemd[1]: Started Getty on tty1. client # [ 27.456372] systemd[1]: Reached target Login Prompts. worker1 # [ 27.182131] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 27.196176] systemd[1]: Finished Extra networking commands.. worker1 # [ 27.197279] systemd[1]: Reached target Network. worker1 # [ 27.204524] systemd[1]: Starting Permit User Sessions... lb # [ 27.343081] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 27.248429] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 27.249030] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 27.354485] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 27.255469] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 27.255897] cfg80211: failed to load regulatory.db lb # [ 27.338756] dhcpcd[655]: eth0: waiting for carrier lb # [ 27.348824] dhcpcd[655]: eth0: carrier acquired lb # [ 27.392027] mousedev: PS/2 mouse device common for all mice lb # [ 27.407582] dhcpcd[655]: DUID 00:01:00:01:32:42:8c:40:52:54:00:12:34:56 lb # [ 27.409629] dhcpcd[655]: eth0: IAID 00:12:34:56 lb # [ 27.417798] dhcpcd[655]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 27.419910] network-addresses-eth1-start[745]: adding address 192.168.1.2/24... done worker1 # [ 27.333323] systemd[1]: Finished Permit User Sessions. worker1 # [ 27.341724] systemd[1]: Started Getty on tty1. worker1 # [ 27.342556] systemd[1]: Reached target Login Prompts. lb # [ 27.493885] network-addresses-eth1-start[745]: adding address 2001:db8:1::2/64... done client: (finished: waiting for unit network-addresses-eth1.service, in 28.03 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } lb # [ 27.563902] systemd-logind[527]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 26.898062] dbus-broker-launch[574]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 27.593247] systemd[1]: Finished Address configuration of eth1. worker1 # [ 27.527199] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 27.506317] dhcpcd[722]: eth0: waiting for carrier worker1 # [ 27.512193] dhcpcd[722]: libudev: received NULL device worker1 # [ 27.516803] dhcpcd[722]: libudev: received NULL device worker1 # [ 27.518433] dhcpcd[722]: eth0: carrier acquired worker2 # [ 26.998815] systemd-logind[598]: New seat seat0. client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.14 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 27.572097] dhcpcd[722]: DUID 00:01:00:01:32:42:8c:40:52:54:00:12:34:56 worker1 # [ 27.574780] dhcpcd[722]: eth0: IAID 00:12:34:56 worker2 # [ 27.007162] dbus-broker-launch[574]: NSS returned no entry for 'systemd-timesync' worker1 # [ 27.575826] dhcpcd[722]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 27.018264] dbus-broker-launch[574]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 27.064447] systemd-logind[598]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 27.089435] systemd-logind[598]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 27.112362] systemd[1]: Started User Login Management. worker2 # [ 27.139988] systemd[1]: Starting linger-users.service... worker2 # [ 27.162627] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 27.169921] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 27.171462] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 27.176278] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 27.178812] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb: (finished: waiting for unit network-addresses-eth1.service, in 0.19 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } worker2 # [ 27.196983] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 27.220675] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 27.225517] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 27.821626] dhcpcd[722]: eth0: soliciting a DHCP lease worker1 # [ 27.829925] dhcpcd[722]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 27.836389] dhcpcd[722]: eth0: probing address 10.0.2.15/24 worker2 # [ 27.274620] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 27.372297] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 27.374149] systemd[1]: Finished linger-users.service. worker2 # [ 27.401503] dbus-broker-launch[574]: Ready worker1 # [ 28.011587] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 28.019034] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 28.021620] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 28.022903] systemd[1]: Starting Virtual Console Setup... worker1 # [ 28.030584] systemd-logind[596]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.31 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 28.068509] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 28.382767] dhcpcd[623]: eth0: soliciting a DHCP lease client # [ 28.388697] dhcpcd[623]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 28.079538] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 28.082416] systemd[1]: Starting Virtual Console Setup... client # [ 28.406496] dhcpcd[623]: eth0: probing address 10.0.2.15/24 client # [ 28.409630] dhcpcd[623]: eth0: soliciting an IPv6 router client # [ 28.410944] dhcpcd[623]: eth0: Router Advertisement from fe80::2 client # [ 28.412235] dhcpcd[623]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 28.413752] dhcpcd[623]: eth0: adding route to fec0::/64 client # [ 28.415322] dhcpcd[623]: eth0: adding default route via fe80::2 lb # [ 28.218486] dhcpcd[655]: eth0: soliciting a DHCP lease lb # [ 28.224746] dhcpcd[655]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 28.236387] dhcpcd[655]: eth0: probing address 10.0.2.15/24 worker1 # [ 28.137935] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 27.575590] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 27.577416] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 27.578743] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 27.581504] nsncd[653]: Sep 20 12:21:21.093 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 28.583657] systemd-vconsole-setup[685]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 28.611477] systemd[1]: Finished Virtual Console Setup. worker2 # [ 27.816728] systemd[1]: Finished resolvconf update. worker2 # [ 27.817647] systemd[1]: Reached target Preparation for Network. worker2 # [ 27.824277] systemd[1]: Starting DHCP Client... worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.34 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker2 # [ 27.832513] systemd[1]: Starting Address configuration of eth1... worker2 # [ 27.845854] systemd[1]: Starting Extra networking commands.... worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.09 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2 # [ 28.230104] network-addresses-eth1-start[683]: adding address 192.168.1.4/24... done worker1 # [ 28.816939] systemd-vconsole-setup[784]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 28.253461] network-addresses-eth1-start[683]: adding address 2001:db8:1::4/64... done worker1 # [ 28.821772] systemd[1]: Finished Virtual Console Setup. worker2 # [ 28.319049] systemd[1]: Finished Address configuration of eth1. worker2 # [ 28.437173] dhcpcd[696]: dhcpcd-10.3.2 starting worker2 # [ 28.458925] dhcpcd[746]: dev: loaded udev worker2 # [ 28.540633] systemd[1]: Finished Extra networking commands.. worker2 # [ 28.549588] systemd[1]: Reached target Network. worker2 # [ 28.559835] systemd[1]: Starting Permit User Sessions... worker2 # [ 28.584098] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 28.584549] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 28.652436] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 28.654772] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 28.655906] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 28.674624] systemd[1]: Starting Virtual Console Setup... worker2 # [ 28.730353] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 28.762436] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 28.774511] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 28.786377] systemd[1]: Starting Virtual Console Setup... lb # [ 29.464391] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 28.808181] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 28.808778] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 29.466889] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 28.813960] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 29.473297] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 28.814431] cfg80211: failed to load regulatory.db lb # [ 29.479588] systemd[1]: Starting Virtual Console Setup... worker1 # [ 29.387805] dhcpcd[722]: eth0: soliciting an IPv6 router worker1 # [ 29.389515] dhcpcd[722]: eth0: Router Advertisement from fe80::2 worker1 # [ 29.390911] dhcpcd[722]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 29.392225] dhcpcd[722]: eth0: adding route to fec0::/64 worker1 # [ 29.393322] dhcpcd[722]: eth0: adding default route via fe80::2 lb # [ 29.531519] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 29.536293] systemd[1]: Stopped Virtual Console Setup. lb # [ 29.543391] dhcpcd[655]: eth0: soliciting an IPv6 router lb # [ 29.548316] dhcpcd[655]: eth0: Router Advertisement from fe80::2 lb # [ 29.552280] dhcpcd[655]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 29.557301] systemd[1]: Starting Virtual Console Setup... lb # [ 29.559263] dhcpcd[655]: eth0: adding route to fec0::/64 lb # [ 29.562643] dhcpcd[655]: eth0: adding default route via fe80::2 worker2 # [ 28.903077] systemd[1]: Finished Permit User Sessions. worker2 # [ 28.909235] systemd[1]: Started Getty on tty1. worker2 # [ 28.910842] systemd[1]: Reached target Login Prompts. lb # [ 29.581633] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 29.701087] systemd-logind[527]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 29.064828] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 29.047839] dhcpcd[746]: eth0: waiting for carrier worker2 # [ 29.050379] dhcpcd[746]: libudev: received NULL device worker2 # [ 29.051551] dhcpcd[746]: libudev: received NULL device worker2 # [ 29.055271] dhcpcd[746]: eth0: carrier acquired worker2 # [ 29.073532] dhcpcd[746]: DUID 00:01:00:01:32:42:8c:42:52:54:00:12:34:56 worker2 # [ 29.076334] dhcpcd[746]: eth0: IAID 00:12:34:56 worker2 # [ 29.077926] dhcpcd[746]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 29.168924] systemd-logind[598]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 29.177693] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2: (finished: waiting for unit network-addresses-eth1.service, in 1.31 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit niks3.service lb # [ 30.196959] systemd-vconsole-setup[792]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 30.209638] systemd[1]: Finished Virtual Console Setup. worker2 # [ 29.658230] systemd-vconsole-setup[763]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 29.666538] systemd[1]: Finished Virtual Console Setup. worker2 # [ 30.304840] dhcpcd[746]: eth0: soliciting a DHCP lease worker2 # [ 30.330060] dhcpcd[746]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 30.340777] dhcpcd[746]: eth0: probing address 10.0.2.15/24 worker2 # [ 30.342224] dhcpcd[746]: eth0: soliciting an IPv6 router worker2 # [ 30.343937] dhcpcd[746]: eth0: Router Advertisement from fe80::2 worker2 # [ 30.345512] dhcpcd[746]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 30.346788] dhcpcd[746]: eth0: adding route to fec0::/64 worker2 # [ 30.347814] dhcpcd[746]: eth0: adding default route via fe80::2 worker1 # [ 32.628406] dhcpcd[722]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 32.630727] dhcpcd[722]: eth0: adding route to 10.0.2.0/24 worker1 # [ 32.633036] dhcpcd[722]: eth0: adding default route via 10.0.2.2 lb # [ 32.764683] dhcpcd[655]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 32.767578] dhcpcd[655]: eth0: adding route to 10.0.2.0/24 lb # [ 32.775170] dhcpcd[655]: eth0: adding default route via 10.0.2.2 worker1 # [ 32.812338] systemd[1]: Started DHCP Client. worker1 # [ 32.815373] systemd[1]: Reached target Multi-User System. worker1 # [ 32.817523] systemd[1]: Startup finished in 1.628s (kernel) + 7.931s (initrd) + 23.255s (userspace) = 32.815s. lb # [ 33.074961] systemd[1]: Started DHCP Client. lb # [ 33.078329] systemd[1]: Reached target Network is Online. lb # [ 33.105910] systemd[1]: Started Envoy reverse proxy. lb # [ 33.125696] systemd[1]: Started mock-oidc.service. client # [ 33.440780] dhcpcd[623]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 33.442887] dhcpcd[623]: eth0: adding route to 10.0.2.0/24 client # [ 33.444537] dhcpcd[623]: eth0: adding default route via 10.0.2.2 client # [ 33.813822] systemd[1]: Started DHCP Client. lb # [ 33.624387] mock-oidc-server[883]: Mock OIDC Server running lb # [ 33.626741] mock-oidc-server[883]: OIDC Address: 192.168.1.2:8080 lb # [ 33.629853] mock-oidc-server[883]: Issue Address: 0.0.0.0:8081 client # [ 33.843342] systemd[1]: Reached target Multi-User System. client # [ 33.844942] systemd[1]: Startup finished in 1.654s (kernel) + 7.750s (initrd) + 24.406s (userspace) = 33.811s. lb # [ 33.640895] mock-oidc-server[883]: Issuer: http://192.168.1.2:8080/oidc lb # [ 33.651523] mock-oidc-server[883]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 33.660721] mock-oidc-server[883]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 33.669264] mock-oidc-server[883]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 33.726581] postgresql-pre-start[707]: selecting default time zone ... UTC lb # [ 33.749218] postgresql-pre-start[707]: creating configuration files ... ok lb # [ 34.607359] postgresql-pre-start[707]: running bootstrap script ... ok lb # [ 35.181319] envoy[882]: [2026-09-20 12:21:28.154][882][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 35.185175] envoy[882]: [2026-09-20 12:21:28.157][882][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 35.188883] envoy[882]: [2026-09-20 12:21:28.157][882][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 35.204177] envoy[882]: [2026-09-20 12:21:28.157][882][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 35.206216] envoy[882]: [2026-09-20 12:21:28.157][882][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 35.212497] envoy[882]: [2026-09-20 12:21:28.157][882][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 35.224210] envoy[882]: [2026-09-20 12:21:28.157][882][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 35.226004] envoy[882]: [2026-09-20 12:21:28.157][882][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 35.230288] envoy[882]: [2026-09-20 12:21:28.157][882][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 35.236201] envoy[882]: [2026-09-20 12:21:28.157][882][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 35.238985] envoy[882]: [2026-09-20 12:21:28.157][882][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 35.245433] envoy[882]: [2026-09-20 12:21:28.157][882][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 35.274399] envoy[882]: [2026-09-20 12:21:28.157][882][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 35.282877] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 35.292648] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 35.303226] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 35.329175] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 35.336352] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 35.344273] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 35.351662] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 35.366276] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 35.373559] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 35.385385] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 35.392549] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 35.403548] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 35.407286] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 35.414142] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 35.420587] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 35.425244] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 35.429009] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 35.433731] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 35.438751] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 35.447902] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 35.452789] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 35.455497] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 35.458824] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 35.464774] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 35.466937] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 35.471136] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 35.476270] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 35.484554] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 35.492446] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 35.494698] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 35.507645] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 35.515760] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle worker1 # [ 35.419356] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 35.524678] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 35.561063] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 35.636465] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 35.638843] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 35.648214] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 35.651244] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 35.656176] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 35.658112] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 35.659929] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 35.666276] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 35.672177] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 35.674135] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 35.680175] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 35.696230] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 35.698929] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 35.713412] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 35.715853] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 35.724387] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 35.727083] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 35.736214] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 35.738979] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 35.748183] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 35.750552] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 35.756179] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 35.759140] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 35.768242] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 35.770665] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options worker2 # [ 35.099437] dhcpcd[746]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 35.780175] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche worker2 # [ 35.103597] dhcpcd[746]: eth0: adding route to 10.0.2.0/24 lb # [ 35.782169] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso worker2 # [ 35.106654] dhcpcd[746]: eth0: adding default route via 10.0.2.2 worker1 # [ 35.679867] nix-grpc-daemon[855]: ts=2026-09-20T12:21:28Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" lb # [ 35.788265] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 35.800249] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default worker1 # [ 35.693452] nix-grpc-daemon[855]: ts=2026-09-20T12:21:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc lb # [ 35.802298] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json worker1 # [ 35.695927] nix-grpc-daemon[855]: ts=2026-09-20T12:21:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 35.808326] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 35.810387] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 35.820222] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 35.822952] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 35.840224] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 35.842111] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default worker1 # [ 35.736156] nix-grpc-daemon[855]: ts=2026-09-20T12:21:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 35.843615] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default worker1 # [ 35.742639] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 35.852308] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 35.868820] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 35.880210] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 35.882001] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 35.892276] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 35.922233] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 35.926427] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input worker1 # [ 35.823957] nix-grpc-daemon[855]: ts=2026-09-20T12:21:28Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 35.934103] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 35.944273] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 35.946245] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 35.947916] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 35.953783] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 35.957390] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 35.960987] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 35.971742] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 35.976913] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 35.978800] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 35.981028] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default worker2 # [ 35.306514] systemd[1]: Started DHCP Client. lb # [ 35.982823] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder worker2 # [ 35.311617] systemd[1]: Reached target Multi-User System. worker2 # [ 35.313674] systemd[1]: Reached target Network is Online. lb # [ 35.985373] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 35.990778] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor worker2 # [ 35.317599] systemd[1]: Starting scheduler-token.service... lb # [ 35.993649] envoy[882]: [2026-09-20 12:21:28.158][882][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 35.996963] envoy[882]: [2026-09-20 12:21:28.193][882][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 35.998596] envoy[882]: [2026-09-20 12:21:28.203][882][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 36.014639] envoy[882]: [2026-09-20 12:21:28.203][882][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 36.016319] envoy[882]: [2026-09-20 12:21:28.203][882][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 36.025320] envoy[882]: [2026-09-20 12:21:28.203][882][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 36.027068] envoy[882]: [2026-09-20 12:21:28.334][882][info][main] [source/server/server.cc:968] runtime: {} lb # [ 36.029123] envoy[882]: [2026-09-20 12:21:28.346][882][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 36.031003] envoy[882]: [2026-09-20 12:21:28.346][882][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 36.032865] envoy[882]: [2026-09-20 12:21:28.346][882][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 36.034581] envoy[882]: [2026-09-20 12:21:28.353][882][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 36.039634] envoy[882]: [2026-09-20 12:21:28.353][882][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 36.041602] envoy[882]: [2026-09-20 12:21:28.354][882][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 36.043151] envoy[882]: [2026-09-20 12:21:28.510][882][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 36.045371] envoy[882]: [2026-09-20 12:21:28.585][882][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 36.053082] envoy[882]: [2026-09-20 12:21:28.586][882][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 36.061266] envoy[882]: [2026-09-20 12:21:28.586][882][info][main] [source/server/server.cc:1077] starting main dispatch loop lb # [ 36.062725] envoy[882]: [2026-09-20 12:21:28.906][882][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 36.068591] envoy[882]: [2026-09-20 12:21:28.906][882][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 36.070385] envoy[882]: [2026-09-20 12:21:28.906][882][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 36.076903] envoy[882]: [2026-09-20 12:21:28.906][882][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers lb # [ 36.083097] postgresql-pre-start[707]: performing post-bootstrap initialization ... ok worker2 # [ 35.428102] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 35.432660] systemd[1]: Finished scheduler-token.service. worker2 # [ 35.433630] systemd[1]: scheduler-token.service: Consumed 37ms CPU time over 112ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 35.439654] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 36.025505] nix-grpc-daemon[855]: ts=2026-09-20T12:21:29Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 36.201725] postgresql-pre-start[707]: syncing data to disk ... ok lb # [ 36.204529] postgresql-pre-start[707]: initdb: warning: enabling "trust" authentication for local connections lb # [ 36.205999] postgresql-pre-start[707]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 36.208187] postgresql-pre-start[707]: Success. You can now start the database server using: lb # [ 36.209497] postgresql-pre-start[707]: pg_ctl -D /var/lib/postgresql/18 -l logfile start worker2 # [ 35.673584] nix-grpc-daemon[862]: ts=2026-09-20T12:21:29Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 35.689101] nix-grpc-daemon[862]: ts=2026-09-20T12:21:29Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 35.691657] nix-grpc-daemon[862]: ts=2026-09-20T12:21:29Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 36.382601] postgres[924]: [924] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 36.387427] postgres[924]: [924] LOG: listening on IPv6 address "::1", port 5432 lb # [ 36.388992] postgres[924]: [924] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 36.391292] postgres[924]: [924] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" worker2 # [ 35.732292] nix-grpc-daemon[862]: ts=2026-09-20T12:21:29Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 35.734278] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 36.412695] postgres[933]: [933] LOG: database system was shut down at 2026-09-20 12:21:28 GMT worker2 # [ 35.741170] systemd[1]: Startup finished in 2.086s (kernel) + 9.265s (initrd) + 24.383s (userspace) = 35.735s. lb # [ 36.420497] postgres[924]: [924] LOG: database system is ready to accept connections lb # [ 36.431926] systemd[1]: Started PostgreSQL Server. lb # [ 36.447505] systemd[1]: Starting PostgreSQL Setup Scripts... worker2 # [ 35.785751] nix-grpc-daemon[862]: ts=2026-09-20T12:21:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.789601] nix-grpc-daemon[862]: ts=2026-09-20T12:21:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.425807] nix-grpc-daemon[855]: ts=2026-09-20T12:21:29Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 35.991713] nix-grpc-daemon[862]: ts=2026-09-20T12:21:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.999352] nix-grpc-daemon[862]: ts=2026-09-20T12:21:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 36.802864] postgresql-setup-start[944]: CREATE DATABASE lb # [ 36.864144] postgresql-setup-start[958]: CREATE ROLE worker2 # [ 36.201001] nix-grpc-daemon[862]: ts=2026-09-20T12:21:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.206993] nix-grpc-daemon[862]: ts=2026-09-20T12:21:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 36.901071] postgresql-setup-start[960]: ALTER DATABASE lb # [ 36.910318] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 36.912614] systemd[1]: Reached target PostgreSQL. worker2 # [ 36.408496] nix-grpc-daemon[862]: ts=2026-09-20T12:21:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.416516] nix-grpc-daemon[862]: ts=2026-09-20T12:21:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.617871] nix-grpc-daemon[862]: ts=2026-09-20T12:21:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.625766] nix-grpc-daemon[862]: ts=2026-09-20T12:21:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.227886] nix-grpc-daemon[855]: ts=2026-09-20T12:21:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.230789] nix-grpc-daemon[855]: ts=2026-09-20T12:21:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.828597] nix-grpc-daemon[862]: ts=2026-09-20T12:21:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.834099] nix-grpc-daemon[862]: ts=2026-09-20T12:21:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.431788] nix-grpc-daemon[855]: ts=2026-09-20T12:21:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.434481] nix-grpc-daemon[855]: ts=2026-09-20T12:21:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.034842] nix-grpc-daemon[862]: ts=2026-09-20T12:21:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.038162] nix-grpc-daemon[862]: ts=2026-09-20T12:21:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.635446] nix-grpc-daemon[855]: ts=2026-09-20T12:21:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.637874] nix-grpc-daemon[855]: ts=2026-09-20T12:21:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.239554] nix-grpc-daemon[862]: ts=2026-09-20T12:21:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.246707] nix-grpc-daemon[862]: ts=2026-09-20T12:21:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.839216] nix-grpc-daemon[855]: ts=2026-09-20T12:21:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.845898] nix-grpc-daemon[855]: ts=2026-09-20T12:21:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.448601] nix-grpc-daemon[862]: ts=2026-09-20T12:21:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.456430] nix-grpc-daemon[862]: ts=2026-09-20T12:21:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.047440] nix-grpc-daemon[855]: ts=2026-09-20T12:21:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.055719] nix-grpc-daemon[855]: ts=2026-09-20T12:21:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.657322] nix-grpc-daemon[862]: ts=2026-09-20T12:21:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.660584] nix-grpc-daemon[862]: ts=2026-09-20T12:21:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.258915] nix-grpc-daemon[855]: ts=2026-09-20T12:21:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.265375] nix-grpc-daemon[855]: ts=2026-09-20T12:21:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.865722] nix-grpc-daemon[862]: ts=2026-09-20T12:21:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.871788] nix-grpc-daemon[862]: ts=2026-09-20T12:21:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.460079] nix-grpc-daemon[855]: ts=2026-09-20T12:21:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.467241] nix-grpc-daemon[855]: ts=2026-09-20T12:21:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.066465] nix-grpc-daemon[862]: ts=2026-09-20T12:21:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.073815] nix-grpc-daemon[862]: ts=2026-09-20T12:21:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.663039] nix-grpc-daemon[855]: ts=2026-09-20T12:21:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.671475] nix-grpc-daemon[855]: ts=2026-09-20T12:21:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.274972] nix-grpc-daemon[862]: ts=2026-09-20T12:21:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.283053] nix-grpc-daemon[862]: ts=2026-09-20T12:21:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.872445] nix-grpc-daemon[855]: ts=2026-09-20T12:21:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.879970] nix-grpc-daemon[855]: ts=2026-09-20T12:21:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.484476] nix-grpc-daemon[862]: ts=2026-09-20T12:21:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.489071] nix-grpc-daemon[862]: ts=2026-09-20T12:21:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.081056] nix-grpc-daemon[855]: ts=2026-09-20T12:21:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.086552] nix-grpc-daemon[855]: ts=2026-09-20T12:21:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.690846] nix-grpc-daemon[862]: ts=2026-09-20T12:21:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.695631] nix-grpc-daemon[862]: ts=2026-09-20T12:21:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.288344] nix-grpc-daemon[855]: ts=2026-09-20T12:21:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.292769] nix-grpc-daemon[855]: ts=2026-09-20T12:21:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.897681] nix-grpc-daemon[862]: ts=2026-09-20T12:21:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.902227] nix-grpc-daemon[862]: ts=2026-09-20T12:21:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.493553] nix-grpc-daemon[855]: ts=2026-09-20T12:21:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.496400] nix-grpc-daemon[855]: ts=2026-09-20T12:21:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.104061] nix-grpc-daemon[862]: ts=2026-09-20T12:21:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.106708] nix-grpc-daemon[862]: ts=2026-09-20T12:21:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.697812] nix-grpc-daemon[855]: ts=2026-09-20T12:21:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.703951] nix-grpc-daemon[855]: ts=2026-09-20T12:21:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.307928] nix-grpc-daemon[862]: ts=2026-09-20T12:21:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.312594] nix-grpc-daemon[862]: ts=2026-09-20T12:21:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.904818] nix-grpc-daemon[855]: ts=2026-09-20T12:21:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.910427] nix-grpc-daemon[855]: ts=2026-09-20T12:21:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.514108] nix-grpc-daemon[862]: ts=2026-09-20T12:21:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.522243] nix-grpc-daemon[862]: ts=2026-09-20T12:21:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.114335] nix-grpc-daemon[855]: ts=2026-09-20T12:21:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.126757] nix-grpc-daemon[855]: ts=2026-09-20T12:21:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.722788] nix-grpc-daemon[862]: ts=2026-09-20T12:21:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.727188] nix-grpc-daemon[862]: ts=2026-09-20T12:21:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.330614] nix-grpc-daemon[855]: ts=2026-09-20T12:21:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.335359] nix-grpc-daemon[855]: ts=2026-09-20T12:21:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.930499] nix-grpc-daemon[862]: ts=2026-09-20T12:21:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.938674] nix-grpc-daemon[862]: ts=2026-09-20T12:21:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.530794] nix-grpc-daemon[855]: ts=2026-09-20T12:21:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.535363] nix-grpc-daemon[855]: ts=2026-09-20T12:21:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.140578] nix-grpc-daemon[862]: ts=2026-09-20T12:21:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.148544] nix-grpc-daemon[862]: ts=2026-09-20T12:21:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.735112] nix-grpc-daemon[855]: ts=2026-09-20T12:21:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.741549] nix-grpc-daemon[855]: ts=2026-09-20T12:21:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.349909] nix-grpc-daemon[862]: ts=2026-09-20T12:21:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.356276] nix-grpc-daemon[862]: ts=2026-09-20T12:21:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.942582] nix-grpc-daemon[855]: ts=2026-09-20T12:21:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.946053] nix-grpc-daemon[855]: ts=2026-09-20T12:21:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.558502] nix-grpc-daemon[862]: ts=2026-09-20T12:21:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.565436] nix-grpc-daemon[862]: ts=2026-09-20T12:21:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 41.146989] nix-grpc-daemon[855]: ts=2026-09-20T12:21:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 41.150003] nix-grpc-daemon[855]: ts=2026-09-20T12:21:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.766772] nix-grpc-daemon[862]: ts=2026-09-20T12:21:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.772950] nix-grpc-daemon[862]: ts=2026-09-20T12:21:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 41.353497] nix-grpc-daemon[855]: ts=2026-09-20T12:21:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 41.355734] nix-grpc-daemon[855]: ts=2026-09-20T12:21:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.976442] nix-grpc-daemon[862]: ts=2026-09-20T12:21:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.982788] nix-grpc-daemon[862]: ts=2026-09-20T12:21:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 41.554230] nix-grpc-daemon[855]: ts=2026-09-20T12:21:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 41.562349] nix-grpc-daemon[855]: ts=2026-09-20T12:21:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.180647] nix-grpc-daemon[862]: ts=2026-09-20T12:21:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.187671] nix-grpc-daemon[862]: ts=2026-09-20T12:21:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 41.763674] nix-grpc-daemon[855]: ts=2026-09-20T12:21:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 41.770222] nix-grpc-daemon[855]: ts=2026-09-20T12:21:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.390687] nix-grpc-daemon[862]: ts=2026-09-20T12:21:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.397306] nix-grpc-daemon[862]: ts=2026-09-20T12:21:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 41.970978] nix-grpc-daemon[855]: ts=2026-09-20T12:21:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 41.977705] nix-grpc-daemon[855]: ts=2026-09-20T12:21:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.599193] nix-grpc-daemon[862]: ts=2026-09-20T12:21:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.605850] nix-grpc-daemon[862]: ts=2026-09-20T12:21:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 42.178540] nix-grpc-daemon[855]: ts=2026-09-20T12:21:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 42.182348] nix-grpc-daemon[855]: ts=2026-09-20T12:21:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.807471] nix-grpc-daemon[862]: ts=2026-09-20T12:21:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 42.385030] nix-grpc-daemon[855]: ts=2026-09-20T12:21:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.819906] nix-grpc-daemon[862]: ts=2026-09-20T12:21:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 42.390652] nix-grpc-daemon[855]: ts=2026-09-20T12:21:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 42.022834] nix-grpc-daemon[862]: ts=2026-09-20T12:21:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 42.592430] nix-grpc-daemon[855]: ts=2026-09-20T12:21:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 42.598273] nix-grpc-daemon[855]: ts=2026-09-20T12:21:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 42.033091] nix-grpc-daemon[862]: ts=2026-09-20T12:21:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 42.228066] nix-grpc-daemon[862]: ts=2026-09-20T12:21:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 42.231337] nix-grpc-daemon[862]: ts=2026-09-20T12:21:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 42.799093] nix-grpc-daemon[855]: ts=2026-09-20T12:21:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 42.802979] nix-grpc-daemon[855]: ts=2026-09-20T12:21:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 42.432478] nix-grpc-daemon[862]: ts=2026-09-20T12:21:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 42.436680] nix-grpc-daemon[862]: ts=2026-09-20T12:21:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 43.005199] nix-grpc-daemon[855]: ts=2026-09-20T12:21:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 43.009705] nix-grpc-daemon[855]: ts=2026-09-20T12:21:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 43.206047] nix-grpc-daemon[855]: ts=2026-09-20T12:21:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 42.637937] nix-grpc-daemon[862]: ts=2026-09-20T12:21:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 43.209987] nix-grpc-daemon[855]: ts=2026-09-20T12:21:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 42.646249] nix-grpc-daemon[862]: ts=2026-09-20T12:21:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 43.412242] nix-grpc-daemon[855]: ts=2026-09-20T12:21:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 43.414542] nix-grpc-daemon[855]: ts=2026-09-20T12:21:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 42.849433] nix-grpc-daemon[862]: ts=2026-09-20T12:21:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 42.857089] nix-grpc-daemon[862]: ts=2026-09-20T12:21:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 43.615828] nix-grpc-daemon[855]: ts=2026-09-20T12:21:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 43.621995] nix-grpc-daemon[855]: ts=2026-09-20T12:21:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 43.061383] nix-grpc-daemon[862]: ts=2026-09-20T12:21:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 43.067357] nix-grpc-daemon[862]: ts=2026-09-20T12:21:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 43.824587] nix-grpc-daemon[855]: ts=2026-09-20T12:21:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 43.827813] nix-grpc-daemon[855]: ts=2026-09-20T12:21:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 43.261862] nix-grpc-daemon[862]: ts=2026-09-20T12:21:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 43.268606] nix-grpc-daemon[862]: ts=2026-09-20T12:21:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 44.025464] nix-grpc-daemon[855]: ts=2026-09-20T12:21:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 44.028085] nix-grpc-daemon[855]: ts=2026-09-20T12:21:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 43.470165] nix-grpc-daemon[862]: ts=2026-09-20T12:21:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 43.476821] nix-grpc-daemon[862]: ts=2026-09-20T12:21:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 44.229570] nix-grpc-daemon[855]: ts=2026-09-20T12:21:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 44.235513] nix-grpc-daemon[855]: ts=2026-09-20T12:21:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 43.677903] nix-grpc-daemon[862]: ts=2026-09-20T12:21:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 43.682373] nix-grpc-daemon[862]: ts=2026-09-20T12:21:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 44.438741] nix-grpc-daemon[855]: ts=2026-09-20T12:21:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 44.444377] nix-grpc-daemon[855]: ts=2026-09-20T12:21:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 43.884571] nix-grpc-daemon[862]: ts=2026-09-20T12:21:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 43.890634] nix-grpc-daemon[862]: ts=2026-09-20T12:21:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 44.639557] nix-grpc-daemon[855]: ts=2026-09-20T12:21:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 44.647937] nix-grpc-daemon[855]: ts=2026-09-20T12:21:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 44.095437] nix-grpc-daemon[862]: ts=2026-09-20T12:21:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 44.100365] nix-grpc-daemon[862]: ts=2026-09-20T12:21:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 44.849234] nix-grpc-daemon[855]: ts=2026-09-20T12:21:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 44.858174] nix-grpc-daemon[855]: ts=2026-09-20T12:21:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 44.297050] nix-grpc-daemon[862]: ts=2026-09-20T12:21:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 44.303684] nix-grpc-daemon[862]: ts=2026-09-20T12:21:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 45.059185] nix-grpc-daemon[855]: ts=2026-09-20T12:21:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 45.067975] nix-grpc-daemon[855]: ts=2026-09-20T12:21:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 44.505639] nix-grpc-daemon[862]: ts=2026-09-20T12:21:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 44.513387] nix-grpc-daemon[862]: ts=2026-09-20T12:21:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 45.269511] nix-grpc-daemon[855]: ts=2026-09-20T12:21:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 45.276522] nix-grpc-daemon[855]: ts=2026-09-20T12:21:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 44.713905] nix-grpc-daemon[862]: ts=2026-09-20T12:21:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 44.717083] nix-grpc-daemon[862]: ts=2026-09-20T12:21:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 45.479321] nix-grpc-daemon[855]: ts=2026-09-20T12:21:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 45.483933] nix-grpc-daemon[855]: ts=2026-09-20T12:21:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 44.918412] nix-grpc-daemon[862]: ts=2026-09-20T12:21:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 44.923431] nix-grpc-daemon[862]: ts=2026-09-20T12:21:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 45.680301] nix-grpc-daemon[855]: ts=2026-09-20T12:21:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 45.685980] nix-grpc-daemon[855]: ts=2026-09-20T12:21:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 45.125393] nix-grpc-daemon[862]: ts=2026-09-20T12:21:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 45.127826] nix-grpc-daemon[862]: ts=2026-09-20T12:21:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 45.887519] nix-grpc-daemon[855]: ts=2026-09-20T12:21:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 45.327796] nix-grpc-daemon[862]: ts=2026-09-20T12:21:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 45.895049] nix-grpc-daemon[855]: ts=2026-09-20T12:21:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 45.335085] nix-grpc-daemon[862]: ts=2026-09-20T12:21:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 46.095610] nix-grpc-daemon[855]: ts=2026-09-20T12:21:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 46.099652] nix-grpc-daemon[855]: ts=2026-09-20T12:21:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 45.536419] nix-grpc-daemon[862]: ts=2026-09-20T12:21:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 45.542554] nix-grpc-daemon[862]: ts=2026-09-20T12:21:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 46.300898] nix-grpc-daemon[855]: ts=2026-09-20T12:21:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 46.307047] nix-grpc-daemon[855]: ts=2026-09-20T12:21:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 45.743934] nix-grpc-daemon[862]: ts=2026-09-20T12:21:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 45.750420] nix-grpc-daemon[862]: ts=2026-09-20T12:21:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 46.509646] nix-grpc-daemon[855]: ts=2026-09-20T12:21:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 46.515530] nix-grpc-daemon[855]: ts=2026-09-20T12:21:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 45.952060] nix-grpc-daemon[862]: ts=2026-09-20T12:21:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 45.958047] nix-grpc-daemon[862]: ts=2026-09-20T12:21:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 46.716600] nix-grpc-daemon[855]: ts=2026-09-20T12:21:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 46.722221] nix-grpc-daemon[855]: ts=2026-09-20T12:21:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 46.161268] nix-grpc-daemon[862]: ts=2026-09-20T12:21:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 46.166394] nix-grpc-daemon[862]: ts=2026-09-20T12:21:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 46.923085] nix-grpc-daemon[855]: ts=2026-09-20T12:21:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 46.928803] nix-grpc-daemon[855]: ts=2026-09-20T12:21:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 46.367227] nix-grpc-daemon[862]: ts=2026-09-20T12:21:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 46.369648] nix-grpc-daemon[862]: ts=2026-09-20T12:21:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 47.129620] nix-grpc-daemon[855]: ts=2026-09-20T12:21:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 47.137898] nix-grpc-daemon[855]: ts=2026-09-20T12:21:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 46.570536] nix-grpc-daemon[862]: ts=2026-09-20T12:21:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 46.581401] nix-grpc-daemon[862]: ts=2026-09-20T12:21:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 47.335080] nix-grpc-daemon[855]: ts=2026-09-20T12:21:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 47.340948] nix-grpc-daemon[855]: ts=2026-09-20T12:21:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 46.783019] nix-grpc-daemon[862]: ts=2026-09-20T12:21:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 46.789033] nix-grpc-daemon[862]: ts=2026-09-20T12:21:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 47.542379] nix-grpc-daemon[855]: ts=2026-09-20T12:21:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 47.545340] nix-grpc-daemon[855]: ts=2026-09-20T12:21:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 46.990540] nix-grpc-daemon[862]: ts=2026-09-20T12:21:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 46.996575] nix-grpc-daemon[862]: ts=2026-09-20T12:21:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 47.746474] nix-grpc-daemon[855]: ts=2026-09-20T12:21:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 47.753334] nix-grpc-daemon[855]: ts=2026-09-20T12:21:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 47.200713] nix-grpc-daemon[862]: ts=2026-09-20T12:21:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 47.205863] nix-grpc-daemon[862]: ts=2026-09-20T12:21:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 47.954282] nix-grpc-daemon[855]: ts=2026-09-20T12:21:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 47.960936] nix-grpc-daemon[855]: ts=2026-09-20T12:21:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 47.400904] nix-grpc-daemon[862]: ts=2026-09-20T12:21:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 47.404378] nix-grpc-daemon[862]: ts=2026-09-20T12:21:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 48.161227] nix-grpc-daemon[855]: ts=2026-09-20T12:21:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 48.164464] nix-grpc-daemon[855]: ts=2026-09-20T12:21:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 47.606143] nix-grpc-daemon[862]: ts=2026-09-20T12:21:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 47.612300] nix-grpc-daemon[862]: ts=2026-09-20T12:21:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 48.365856] nix-grpc-daemon[855]: ts=2026-09-20T12:21:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 48.371969] nix-grpc-daemon[855]: ts=2026-09-20T12:21:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 47.812975] nix-grpc-daemon[862]: ts=2026-09-20T12:21:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 47.821479] nix-grpc-daemon[862]: ts=2026-09-20T12:21:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 48.575348] nix-grpc-daemon[855]: ts=2026-09-20T12:21:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 48.580580] nix-grpc-daemon[855]: ts=2026-09-20T12:21:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 48.023527] nix-grpc-daemon[862]: ts=2026-09-20T12:21:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 48.029795] nix-grpc-daemon[862]: ts=2026-09-20T12:21:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 48.776444] nix-grpc-daemon[855]: ts=2026-09-20T12:21:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 48.779613] nix-grpc-daemon[855]: ts=2026-09-20T12:21:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 48.233991] nix-grpc-daemon[862]: ts=2026-09-20T12:21:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 48.238712] nix-grpc-daemon[862]: ts=2026-09-20T12:21:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 48.980415] nix-grpc-daemon[855]: ts=2026-09-20T12:21:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 48.983458] nix-grpc-daemon[855]: ts=2026-09-20T12:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 48.435136] nix-grpc-daemon[862]: ts=2026-09-20T12:21:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 48.437698] nix-grpc-daemon[862]: ts=2026-09-20T12:21:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 49.184815] nix-grpc-daemon[855]: ts=2026-09-20T12:21:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 49.191096] nix-grpc-daemon[855]: ts=2026-09-20T12:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 48.640933] nix-grpc-daemon[862]: ts=2026-09-20T12:21:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 48.643142] nix-grpc-daemon[862]: ts=2026-09-20T12:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 49.391591] nix-grpc-daemon[855]: ts=2026-09-20T12:21:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 49.395055] nix-grpc-daemon[855]: ts=2026-09-20T12:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 48.842792] nix-grpc-daemon[862]: ts=2026-09-20T12:21:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 48.848864] nix-grpc-daemon[862]: ts=2026-09-20T12:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 49.597726] nix-grpc-daemon[855]: ts=2026-09-20T12:21:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 49.604375] nix-grpc-daemon[855]: ts=2026-09-20T12:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 49.049820] nix-grpc-daemon[862]: ts=2026-09-20T12:21:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 49.053201] nix-grpc-daemon[862]: ts=2026-09-20T12:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 49.805547] nix-grpc-daemon[855]: ts=2026-09-20T12:21:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 49.813631] nix-grpc-daemon[855]: ts=2026-09-20T12:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 49.257849] nix-grpc-daemon[862]: ts=2026-09-20T12:21:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 49.263257] nix-grpc-daemon[862]: ts=2026-09-20T12:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 50.015289] nix-grpc-daemon[855]: ts=2026-09-20T12:21:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 50.023001] nix-grpc-daemon[855]: ts=2026-09-20T12:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 49.459194] nix-grpc-daemon[862]: ts=2026-09-20T12:21:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 49.465837] nix-grpc-daemon[862]: ts=2026-09-20T12:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 50.224641] nix-grpc-daemon[855]: ts=2026-09-20T12:21:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 50.231413] nix-grpc-daemon[855]: ts=2026-09-20T12:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 49.668355] nix-grpc-daemon[862]: ts=2026-09-20T12:21:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 49.673838] nix-grpc-daemon[862]: ts=2026-09-20T12:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 50.439173] nix-grpc-daemon[855]: ts=2026-09-20T12:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 49.876071] nix-grpc-daemon[862]: ts=2026-09-20T12:21:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 49.882441] nix-grpc-daemon[862]: ts=2026-09-20T12:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 50.084701] nix-grpc-daemon[862]: ts=2026-09-20T12:21:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 50.099815] nix-grpc-daemon[862]: ts=2026-09-20T12:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 50.846562] nix-grpc-daemon[855]: ts=2026-09-20T12:21:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 50.851549] nix-grpc-daemon[855]: ts=2026-09-20T12:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 50.317318] nix-grpc-daemon[862]: ts=2026-09-20T12:21:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 50.329881] nix-grpc-daemon[862]: ts=2026-09-20T12:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 51.046675] nix-grpc-daemon[855]: ts=2026-09-20T12:21:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 51.056202] nix-grpc-daemon[855]: ts=2026-09-20T12:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 50.519780] nix-grpc-daemon[862]: ts=2026-09-20T12:21:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 50.535740] nix-grpc-daemon[862]: ts=2026-09-20T12:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 51.265919] nix-grpc-daemon[855]: ts=2026-09-20T12:21:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 51.275574] nix-grpc-daemon[855]: ts=2026-09-20T12:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 50.743071] nix-grpc-daemon[862]: ts=2026-09-20T12:21:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 50.749807] nix-grpc-daemon[862]: ts=2026-09-20T12:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 51.478119] nix-grpc-daemon[855]: ts=2026-09-20T12:21:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 51.489169] nix-grpc-daemon[855]: ts=2026-09-20T12:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 50.952514] nix-grpc-daemon[862]: ts=2026-09-20T12:21:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 50.959414] nix-grpc-daemon[862]: ts=2026-09-20T12:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 51.691785] nix-grpc-daemon[855]: ts=2026-09-20T12:21:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 51.705265] nix-grpc-daemon[855]: ts=2026-09-20T12:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 51.162059] nix-grpc-daemon[862]: ts=2026-09-20T12:21:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 51.174169] nix-grpc-daemon[862]: ts=2026-09-20T12:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 51.910871] nix-grpc-daemon[855]: ts=2026-09-20T12:21:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 51.915949] nix-grpc-daemon[855]: ts=2026-09-20T12:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 51.388697] nix-grpc-daemon[862]: ts=2026-09-20T12:21:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 51.394472] nix-grpc-daemon[862]: ts=2026-09-20T12:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 52.115847] nix-grpc-daemon[855]: ts=2026-09-20T12:21:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 52.121857] nix-grpc-daemon[855]: ts=2026-09-20T12:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 51.585648] nix-grpc-daemon[862]: ts=2026-09-20T12:21:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 51.593993] nix-grpc-daemon[862]: ts=2026-09-20T12:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 52.318827] nix-grpc-daemon[855]: ts=2026-09-20T12:21:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 52.327796] nix-grpc-daemon[855]: ts=2026-09-20T12:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 51.796146] nix-grpc-daemon[862]: ts=2026-09-20T12:21:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 51.803512] nix-grpc-daemon[862]: ts=2026-09-20T12:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 52.530493] nix-grpc-daemon[855]: ts=2026-09-20T12:21:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 52.537765] nix-grpc-daemon[855]: ts=2026-09-20T12:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 52.006268] nix-grpc-daemon[862]: ts=2026-09-20T12:21:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 52.016269] nix-grpc-daemon[862]: ts=2026-09-20T12:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 52.739207] nix-grpc-daemon[855]: ts=2026-09-20T12:21:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 52.746151] nix-grpc-daemon[855]: ts=2026-09-20T12:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 52.215554] nix-grpc-daemon[862]: ts=2026-09-20T12:21:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 52.224235] nix-grpc-daemon[862]: ts=2026-09-20T12:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 52.949294] nix-grpc-daemon[855]: ts=2026-09-20T12:21:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 52.955127] nix-grpc-daemon[855]: ts=2026-09-20T12:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 52.994922] nix-grpc-daemon[855]: ts=2026-09-20T12:21:46Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Timeout was reached" worker2 # [ 52.433761] nix-grpc-daemon[862]: ts=2026-09-20T12:21:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 52.440662] nix-grpc-daemon[862]: ts=2026-09-20T12:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 53.159457] nix-grpc-daemon[855]: ts=2026-09-20T12:21:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 53.165942] nix-grpc-daemon[855]: ts=2026-09-20T12:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 52.642216] nix-grpc-daemon[862]: ts=2026-09-20T12:21:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 52.656311] nix-grpc-daemon[862]: ts=2026-09-20T12:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 53.363159] nix-grpc-daemon[855]: ts=2026-09-20T12:21:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 53.369789] nix-grpc-daemon[855]: ts=2026-09-20T12:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 52.858530] nix-grpc-daemon[862]: ts=2026-09-20T12:21:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 52.866083] nix-grpc-daemon[862]: ts=2026-09-20T12:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 52.974629] nix-grpc-daemon[862]: ts=2026-09-20T12:21:46Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Timeout was reached" worker1 # [ 53.571295] nix-grpc-daemon[855]: ts=2026-09-20T12:21:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 53.580515] nix-grpc-daemon[855]: ts=2026-09-20T12:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 53.068748] nix-grpc-daemon[862]: ts=2026-09-20T12:21:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 53.077706] nix-grpc-daemon[862]: ts=2026-09-20T12:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 53.782313] nix-grpc-daemon[855]: ts=2026-09-20T12:21:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 53.791948] nix-grpc-daemon[855]: ts=2026-09-20T12:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 53.278235] nix-grpc-daemon[862]: ts=2026-09-20T12:21:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 53.285717] nix-grpc-daemon[862]: ts=2026-09-20T12:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 53.998535] nix-grpc-daemon[855]: ts=2026-09-20T12:21:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 54.001325] nix-grpc-daemon[855]: ts=2026-09-20T12:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 53.492940] nix-grpc-daemon[862]: ts=2026-09-20T12:21:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 53.497933] nix-grpc-daemon[862]: ts=2026-09-20T12:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 54.197424] nix-grpc-daemon[855]: ts=2026-09-20T12:21:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 54.207641] nix-grpc-daemon[855]: ts=2026-09-20T12:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 53.693509] nix-grpc-daemon[862]: ts=2026-09-20T12:21:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 53.699197] nix-grpc-daemon[862]: ts=2026-09-20T12:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 54.408516] nix-grpc-daemon[855]: ts=2026-09-20T12:21:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 54.411302] nix-grpc-daemon[855]: ts=2026-09-20T12:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 53.900625] nix-grpc-daemon[862]: ts=2026-09-20T12:21:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 53.906462] nix-grpc-daemon[862]: ts=2026-09-20T12:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 54.612340] nix-grpc-daemon[855]: ts=2026-09-20T12:21:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 54.617853] nix-grpc-daemon[855]: ts=2026-09-20T12:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 54.108122] nix-grpc-daemon[862]: ts=2026-09-20T12:21:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 54.113960] nix-grpc-daemon[862]: ts=2026-09-20T12:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 54.819074] nix-grpc-daemon[855]: ts=2026-09-20T12:21:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 54.824968] nix-grpc-daemon[855]: ts=2026-09-20T12:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 54.315350] nix-grpc-daemon[862]: ts=2026-09-20T12:21:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 54.321401] nix-grpc-daemon[862]: ts=2026-09-20T12:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 55.028587] nix-grpc-daemon[855]: ts=2026-09-20T12:21:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 55.033071] nix-grpc-daemon[855]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 54.524302] nix-grpc-daemon[862]: ts=2026-09-20T12:21:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 54.527759] nix-grpc-daemon[862]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 55.229106] nix-grpc-daemon[855]: ts=2026-09-20T12:21:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 55.232543] nix-grpc-daemon[855]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 54.725610] nix-grpc-daemon[862]: ts=2026-09-20T12:21:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 54.728813] nix-grpc-daemon[862]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 55.433684] nix-grpc-daemon[855]: ts=2026-09-20T12:21:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 55.439260] nix-grpc-daemon[855]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 54.929838] nix-grpc-daemon[862]: ts=2026-09-20T12:21:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 54.934799] nix-grpc-daemon[862]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 55.639979] nix-grpc-daemon[855]: ts=2026-09-20T12:21:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 55.643609] nix-grpc-daemon[855]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 55.135720] nix-grpc-daemon[862]: ts=2026-09-20T12:21:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 55.139261] nix-grpc-daemon[862]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 55.844952] nix-grpc-daemon[855]: ts=2026-09-20T12:21:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 55.850090] nix-grpc-daemon[855]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 55.340567] nix-grpc-daemon[862]: ts=2026-09-20T12:21:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 55.346869] nix-grpc-daemon[862]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 56.051377] nix-grpc-daemon[855]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 56.053748] nix-grpc-daemon[855]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 55.548086] nix-grpc-daemon[862]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 55.552544] nix-grpc-daemon[862]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 56.254678] nix-grpc-daemon[855]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 56.259613] nix-grpc-daemon[855]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 55.749490] nix-grpc-daemon[862]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 55.754762] nix-grpc-daemon[862]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 56.460405] nix-grpc-daemon[855]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 56.463064] nix-grpc-daemon[855]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 55.955805] nix-grpc-daemon[862]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 55.959777] nix-grpc-daemon[862]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 56.664544] nix-grpc-daemon[855]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 56.670293] nix-grpc-daemon[855]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 56.161536] nix-grpc-daemon[862]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 56.167248] nix-grpc-daemon[862]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 56.871276] nix-grpc-daemon[855]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 56.876912] nix-grpc-daemon[855]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 56.368202] nix-grpc-daemon[862]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 56.371320] nix-grpc-daemon[862]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 57.080744] nix-grpc-daemon[855]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 57.092506] nix-grpc-daemon[855]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 56.573975] nix-grpc-daemon[862]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 56.579226] nix-grpc-daemon[862]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 57.280716] nix-grpc-daemon[855]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 57.286365] nix-grpc-daemon[855]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 56.776982] nix-grpc-daemon[862]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 56.782766] nix-grpc-daemon[862]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 57.487441] nix-grpc-daemon[855]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 57.493599] nix-grpc-daemon[855]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 57.617735] rustfs-bucket-start[1123]: mb s3://farm lb # [ 57.631168] systemd[1]: Finished rustfs-bucket.service. lb # [ 57.645216] systemd[1]: Starting niks3 server... worker2 # [ 56.984301] nix-grpc-daemon[862]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 56.990228] nix-grpc-daemon[862]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 57.694991] nix-grpc-daemon[855]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 57.700851] nix-grpc-daemon[855]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 57.191729] nix-grpc-daemon[862]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 57.197765] nix-grpc-daemon[862]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 57.954675] postgres[1142]: [1142] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 57.957020] postgres[1142]: [1142] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 58.006609] niks3-server[1132]: 2026/09/20 12:21:50 OK 20241026095416_initial_model.sql (28.32ms) lb # [ 58.012704] niks3-server[1132]: 2026/09/20 12:21:50 OK 20251210153512_drop_unused_gin_index.sql (4.24ms) worker1 # [ 57.901746] nix-grpc-daemon[855]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 57.907495] nix-grpc-daemon[855]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 58.020527] niks3-server[1132]: 2026/09/20 12:21:50 OK 20251218171726_add_pins.sql (7.72ms) lb # [ 58.027719] niks3-server[1132]: 2026/09/20 12:21:51 OK 20260628120000_add_object_size_and_stats.sql (7.12ms) lb # [ 58.033995] niks3-server[1132]: 2026/09/20 12:21:51 OK 20260905000000_add_claims.sql (6.23ms) lb # [ 58.039985] niks3-server[1132]: 2026/09/20 12:21:51 OK 20260920000000_drop_claims.sql (5.76ms) lb # [ 58.041410] niks3-server[1132]: 2026/09/20 12:21:51 goose: successfully migrated database to version: 20260920000000 lb # [ 58.048116] niks3-server[1132]: 2026/09/20 12:21:51 OK 1_commit_pending_closure.sql (8.05ms) lb # [ 58.051621] niks3-server[1132]: 2026/09/20 12:21:51 OK 2_object_stats_trigger.sql (3.39ms) lb # [ 58.053444] niks3-server[1132]: 2026/09/20 12:21:51 goose: up to current file version: 2 lb # [ 58.057875] niks3-server[1132]: 2026/09/20 12:21:51 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key worker2 # [ 57.399344] nix-grpc-daemon[862]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 57.405178] nix-grpc-daemon[862]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 58.117244] niks3-server[1132]: 2026/09/20 12:21:51 INFO Read proxy enabled — serving cache objects from S3 lb # [ 58.120244] niks3-server[1132]: 2026/09/20 12:21:51 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 58.124242] niks3-server[1132]: 2026/09/20 12:21:51 INFO systemd watchdog enabled interval=15s lb # [ 58.125485] niks3-server[1132]: 2026/09/20 12:21:51 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 58.132984] systemd[1]: Started niks3 server. lb # [ 58.138077] niks3-server[1132]: 2026/09/20 12:21:51 INFO lead: acquired remote=192.168.1.4:40980 lb # [ 58.139360] systemd[1]: Reached target Multi-User System. worker2 # [ 57.463907] nix-grpc-daemon[862]: ts=2026-09-20T12:21:50Z level=info event=scheduler_take_over lb # [ 58.148382] systemd[1]: Startup finished in 1.618s (kernel) + 8.475s (initrd) + 48.036s (userspace) = 58.129s. worker1 # [ 58.110490] nix-grpc-daemon[855]: ts=2026-09-20T12:21:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 58.114941] nix-grpc-daemon[855]: ts=2026-09-20T12:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 57.608694] nix-grpc-daemon[862]: ts=2026-09-20T12:21:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 57.613303] nix-grpc-daemon[862]: ts=2026-09-20T12:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 58.310797] nix-grpc-daemon[855]: ts=2026-09-20T12:21:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 58.314048] nix-grpc-daemon[855]: ts=2026-09-20T12:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 57.809718] nix-grpc-daemon[862]: ts=2026-09-20T12:21:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 57.815442] nix-grpc-daemon[862]: ts=2026-09-20T12:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 58.514842] nix-grpc-daemon[855]: ts=2026-09-20T12:21:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 57.956704] nix-grpc-daemon[862]: ts=2026-09-20T12:21:51Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:42820 worker2 # [ 57.963730] nix-grpc-daemon[862]: ts=2026-09-20T12:21:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 58.016692] nix-grpc-daemon[862]: ts=2026-09-20T12:21:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 58.035664] nix-grpc-daemon[862]: ts=2026-09-20T12:21:51Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 58.038351] nix-grpc-daemon[862]: ts=2026-09-20T12:21:51Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:42820 worker2 # [ 58.041222] nix-grpc-daemon[862]: ts=2026-09-20T12:21:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: waiting for unit niks3.service, in 28.96 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.11 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.07 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 59.146528] envoy[882]: conn peer=[::1]:33884 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=4 lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds) worker2 # [ 58.652988] systemd[1]: Starting scheduler-token.service... worker2 # [ 58.768920] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 58.771652] systemd[1]: Finished scheduler-token.service. worker2 # [ 58.773896] systemd[1]: scheduler-token.service: Consumed 35ms CPU time over 117ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.07 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.37 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 59.633704] nix-grpc-daemon[862]: ts=2026-09-20T12:21:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 59.655168] systemd[1]: Started Nix Daemon. worker2 # [ 59.974273] nix-daemon[936]: accepted connection from pid 862, user nix-grpc-daemon (trusted) worker2 # [ 60.014492] nix-grpc-daemon[862]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 1/5) worker2 # [ 60.079894] nix-grpc-daemon[862]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 176 ms (attempt 2/5) worker2 # [ 60.259696] nix-grpc-daemon[862]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 176 ms (attempt 3/5) worker2 # [ 60.444302] nix-grpc-daemon[862]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 565 ms (attempt 4/5) worker2 # [ 61.017608] nix-grpc-daemon[862]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 61.625838] nix-grpc-daemon[855]: ts=2026-09-20T12:21:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 61.646616] systemd[1]: Started Nix Daemon. worker1 # [ 61.973118] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 62.004845] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 1/5) worker1 # [ 62.012956] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 164 ms (attempt 2/5) worker1 # [ 62.180643] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 3/5) worker1 # [ 62.209571] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 413 ms (attempt 4/5) worker1 # [ 62.634402] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 62.651598] nix-grpc-daemon[855]: ts=2026-09-20T12:21:55Z level=debug event=path_info_miss path=a8gc22jhjd6rmf0wand1fsy50rgzy95i-nixos-system-client-test error="error: path '/nix/store/a8gc22jhjd6rmf0wand1fsy50rgzy95i-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 62.665950] nix-grpc-daemon[855]: ts=2026-09-20T12:21:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 62.679948] nix-grpc-daemon[855]: ts=2026-09-20T12:21:55Z level=debug event=path_info_miss path=a8gc22jhjd6rmf0wand1fsy50rgzy95i-nixos-system-client-test error="error: path '/nix/store/a8gc22jhjd6rmf0wand1fsy50rgzy95i-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.12 seconds) client: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.06 seconds) worker1 # [ 63.166709] nix-grpc-daemon[855]: ts=2026-09-20T12:21:56Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 63.171413] nix-grpc-daemon[855]: ts=2026-09-20T12:21:56Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:41652 worker1 # [ 63.183691] nix-grpc-daemon[855]: ts=2026-09-20T12:21:56Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:41652 worker1 # [ 63.192822] nix-grpc-daemon[855]: ts=2026-09-20T12:21:56Z level=debug event=path_info_miss path=a8gc22jhjd6rmf0wand1fsy50rgzy95i-nixos-system-client-test error="error: path '/nix/store/a8gc22jhjd6rmf0wand1fsy50rgzy95i-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 62.635262] nix-grpc-daemon[862]: ts=2026-09-20T12:21:56Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:42832 worker2 # [ 62.650041] nix-grpc-daemon[862]: ts=2026-09-20T12:21:56Z level=debug event=path_info_miss path=a8gc22jhjd6rmf0wand1fsy50rgzy95i-nixos-system-client-test error="error: path '/nix/store/a8gc22jhjd6rmf0wand1fsy50rgzy95i-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds) worker2 # [ 62.976805] nix-grpc-daemon[862]: ts=2026-09-20T12:21:56Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 63.247570] nix-grpc-daemon[862]: ts=2026-09-20T12:21:56Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.02 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 64.091663] nix-grpc-daemon[855]: ts=2026-09-20T12:21:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:41652 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 64.107665] nix-grpc-daemon[855]: ts=2026-09-20T12:21:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41652 worker2 # [ 63.582845] nix-grpc-daemon[862]: ts=2026-09-20T12:21:57Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 63.589790] nix-grpc-daemon[862]: ts=2026-09-20T12:21:57Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 64.200352] nix-grpc-daemon[855]: ts=2026-09-20T12:21:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 64.218852] nix-grpc-daemon[855]: ts=2026-09-20T12:21:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41652 client # copying 1 paths to 'lb:50051'... worker1 # [ 64.240572] nix-grpc-daemon[855]: ts=2026-09-20T12:21:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker1 # [ 64.270042] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 64.308999] nix-grpc-daemon[855]: ts=2026-09-20T12:21:57Z level=info event=niks3_push_started pid=928 worker1 # [ 64.627319] nix-grpc-daemon[928]: time=2026-09-20T12:21:57.655Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca="" worker1 # [ 64.839452] nix-daemon[919]: accepted connection from pid 941, user nix-grpc-daemon (trusted) worker1 # [ 64.863392] nix-daemon[919]: reaped child process 944, status = succeeded worker1 # [ 65.059986] nix-daemon[919]: accepted connection from pid 946, user nix-grpc-daemon (trusted) worker1 # [ 65.080267] nix-daemon[919]: reaped child process 949, status = succeeded lb # [ 65.201573] niks3-server[1132]: 2026/09/20 12:21:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 65.120575] nix-grpc-daemon[928]: time=2026-09-20T12:21:58.150Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 65.124320] nix-grpc-daemon[928]: time=2026-09-20T12:21:58.152Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 65.263079] niks3-server[1132]: 2026/09/20 12:21:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 65.281606] niks3-server[1132]: 2026/09/20 12:21:58 INFO Signed narinfos id=1 count=1 worker1 # [ 65.178159] nix-grpc-daemon[928]: time=2026-09-20T12:21:58.207Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.288361] niks3-server[1132]: 2026/09/20 12:21:58 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 65.306994] niks3-server[1132]: 2026/09/20 12:21:58 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 65.318674] niks3-server[1132]: 2026/09/20 12:21:58 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 65.325780] niks3-server[1132]: 2026/09/20 12:21:58 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo lb # [ 65.330559] niks3-server[1132]: 2026/09/20 12:21:58 INFO Completed upload id=1 worker1 # [ 65.223421] nix-grpc-daemon[928]: time=2026-09-20T12:21:58.253Z level=INFO msg="Upload complete. (587ms)" worker1 # [ 65.230568] nix-grpc-daemon[855]: ts=2026-09-20T12:21:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 65.248738] nix-grpc-daemon[855]: ts=2026-09-20T12:21:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 65.258144] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 65.264608] nix-daemon[919]: reaped child process 926, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker1 # [ 65.283556] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) lb # [ 65.543648] envoy[882]: conn peer=[2001:db8:1::1]:40546 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=2524 lb # [ 65.548525] envoy[882]: conn peer=[2001:db8:1::1]:44536 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=77 lb # [ 65.553404] envoy[882]: conn peer=[2001:db8:1::1]:44552 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=13 lb # [ 65.557156] envoy[882]: conn peer=[2001:db8:1::1]:44560 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=21 client # farm-a> LOG-farm-a-t1 worker1 # [ 66.513151] nix-daemon[919]: reaped child process 953, status = succeeded worker1 # [ 66.713178] nix-daemon[919]: accepted connection from pid 968, user nix-grpc-daemon (trusted) worker1 # [ 66.739328] nix-daemon[919]: reaped child process 971, status = succeeded lb # [ 66.858852] niks3-server[1132]: 2026/09/20 12:21:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 66.769876] nix-grpc-daemon[928]: time=2026-09-20T12:21:59.797Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 66.772154] nix-grpc-daemon[928]: time=2026-09-20T12:21:59.797Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 66.908624] niks3-server[1132]: 2026/09/20 12:21:59 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 66.919408] niks3-server[1132]: 2026/09/20 12:21:59 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 66.932661] niks3-server[1132]: 2026/09/20 12:21:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign worker1 # [ 66.831468] nix-grpc-daemon[928]: time=2026-09-20T12:21:59.861Z level=INFO msg="Uploading 1 narinfos" lb # [ 66.940284] niks3-server[1132]: 2026/09/20 12:21:59 INFO Signed narinfos id=2 count=1 lb # [ 66.944449] niks3-server[1132]: 2026/09/20 12:21:59 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 66.957133] niks3-server[1132]: 2026/09/20 12:21:59 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete worker1 # [ 66.858523] nix-grpc-daemon[928]: time=2026-09-20T12:21:59.888Z level=INFO msg="Upload complete. (362ms)" lb # [ 66.965918] niks3-server[1132]: 2026/09/20 12:21:59 INFO Completed upload id=2 lb # [ 66.971485] niks3-server[1132]: 2026/09/20 12:21:59 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker1 # [ 66.864720] nix-grpc-daemon[855]: ts=2026-09-20T12:21:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker1 # [ 66.874570] nix-daemon[919]: reaped child process 951, status = succeeded worker2 # [ 66.309127] nix-grpc-daemon[862]: ts=2026-09-20T12:21:59Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker2 # [ 66.313901] nix-grpc-daemon[862]: ts=2026-09-20T12:21:59Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 66.929439] nix-grpc-daemon[855]: ts=2026-09-20T12:21:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 66.951063] nix-grpc-daemon[855]: ts=2026-09-20T12:21:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 66.967641] nix-grpc-daemon[928]: time=2026-09-20T12:21:59.997Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 66.982681] nix-grpc-daemon[855]: ts=2026-09-20T12:22:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker1 # [ 67.005214] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 67.255218] nix-daemon[919]: accepted connection from pid 975, user nix-grpc-daemon (trusted) worker1 # [ 67.281373] nix-daemon[919]: reaped child process 978, status = succeeded worker1 # [ 67.466847] nix-daemon[919]: accepted connection from pid 980, user nix-grpc-daemon (trusted) worker1 # [ 67.495212] nix-daemon[919]: reaped child process 983, status = succeeded lb # [ 67.617485] niks3-server[1132]: 2026/09/20 12:22:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 67.519289] nix-grpc-daemon[928]: time=2026-09-20T12:22:00.548Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 67.521183] nix-grpc-daemon[928]: time=2026-09-20T12:22:00.549Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 67.658197] niks3-server[1132]: 2026/09/20 12:22:00 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst lb # [ 67.672082] niks3-server[1132]: 2026/09/20 12:22:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign worker1 # [ 67.571813] nix-grpc-daemon[928]: time=2026-09-20T12:22:00.601Z level=INFO msg="Uploading 1 narinfos" lb # [ 67.683347] niks3-server[1132]: 2026/09/20 12:22:00 INFO Signed narinfos id=3 count=1 lb # [ 67.690769] niks3-server[1132]: 2026/09/20 12:22:00 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 67.704157] niks3-server[1132]: 2026/09/20 12:22:00 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 67.711401] niks3-server[1132]: 2026/09/20 12:22:00 INFO Completed upload id=3 lb # [ 67.714388] niks3-server[1132]: 2026/09/20 12:22:00 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker1 # [ 67.604280] nix-grpc-daemon[928]: time=2026-09-20T12:22:00.634Z level=INFO msg="Upload complete. (574ms)" worker1 # [ 67.616972] nix-grpc-daemon[855]: ts=2026-09-20T12:22:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 67.628554] nix-grpc-daemon[855]: ts=2026-09-20T12:22:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 67.642825] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 67.649490] nix-daemon[919]: reaped child process 973, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... worker1 # [ 67.665326] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv client # farm-b> LOG-farm-b-t1 worker1 # [ 68.507125] nix-daemon[919]: reaped child process 987, status = succeeded worker1 # [ 68.694914] nix-daemon[919]: accepted connection from pid 1002, user nix-grpc-daemon (trusted) worker1 # [ 68.720428] nix-daemon[919]: reaped child process 1005, status = succeeded lb # [ 68.841748] niks3-server[1132]: 2026/09/20 12:22:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 68.746905] nix-grpc-daemon[928]: time=2026-09-20T12:22:01.776Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 68.748727] nix-grpc-daemon[928]: time=2026-09-20T12:22:01.776Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 68.894965] niks3-server[1132]: 2026/09/20 12:22:01 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 68.906268] niks3-server[1132]: 2026/09/20 12:22:01 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 68.918242] niks3-server[1132]: 2026/09/20 12:22:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 68.927253] niks3-server[1132]: 2026/09/20 12:22:01 INFO Signed narinfos id=4 count=1 worker1 # [ 68.820043] nix-grpc-daemon[928]: time=2026-09-20T12:22:01.849Z level=INFO msg="Uploading 1 narinfos" lb # [ 68.932330] niks3-server[1132]: 2026/09/20 12:22:01 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 68.947751] niks3-server[1132]: 2026/09/20 12:22:01 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 68.957626] niks3-server[1132]: 2026/09/20 12:22:01 INFO Completed upload id=4 worker1 # [ 68.850344] nix-grpc-daemon[928]: time=2026-09-20T12:22:01.880Z level=INFO msg="Upload complete. (369ms)" lb # [ 68.960653] niks3-server[1132]: 2026/09/20 12:22:01 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker1 # [ 68.866291] nix-grpc-daemon[855]: ts=2026-09-20T12:22:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker2 # [ 68.301509] nix-grpc-daemon[862]: ts=2026-09-20T12:22:01Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker2 # [ 68.308209] nix-grpc-daemon[862]: ts=2026-09-20T12:22:01Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 68.887027] nix-daemon[919]: reaped child process 985, status = succeeded worker1 # [ 68.914315] nix-grpc-daemon[855]: ts=2026-09-20T12:22:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 68.939886] nix-grpc-daemon[855]: ts=2026-09-20T12:22:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 68.956493] nix-grpc-daemon[928]: time=2026-09-20T12:22:01.986Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 68.969795] nix-grpc-daemon[855]: ts=2026-09-20T12:22:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker1 # [ 68.991351] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 69.198121] nix-daemon[919]: accepted connection from pid 1009, user nix-grpc-daemon (trusted) worker1 # [ 69.227183] nix-daemon[919]: reaped child process 1012, status = succeeded worker1 # [ 69.433635] nix-daemon[919]: accepted connection from pid 1014, user nix-grpc-daemon (trusted) worker1 # [ 69.457881] nix-daemon[919]: reaped child process 1017, status = succeeded lb # [ 69.573942] niks3-server[1132]: 2026/09/20 12:22:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 69.480187] nix-grpc-daemon[928]: time=2026-09-20T12:22:02.510Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 69.481799] nix-grpc-daemon[928]: time=2026-09-20T12:22:02.510Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 69.613698] niks3-server[1132]: 2026/09/20 12:22:02 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 69.627192] niks3-server[1132]: 2026/09/20 12:22:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign worker1 # [ 69.527112] nix-grpc-daemon[928]: time=2026-09-20T12:22:02.557Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.636420] niks3-server[1132]: 2026/09/20 12:22:02 INFO Signed narinfos id=5 count=1 lb # [ 69.638893] niks3-server[1132]: 2026/09/20 12:22:02 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 69.651401] niks3-server[1132]: 2026/09/20 12:22:02 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete worker1 # [ 69.549436] nix-grpc-daemon[928]: time=2026-09-20T12:22:02.579Z level=INFO msg="Upload complete. (548ms)" lb # [ 69.658605] niks3-server[1132]: 2026/09/20 12:22:02 INFO Completed upload id=5 lb # [ 69.662412] niks3-server[1132]: 2026/09/20 12:22:02 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker1 # [ 69.556231] nix-grpc-daemon[855]: ts=2026-09-20T12:22:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 69.572003] nix-grpc-daemon[855]: ts=2026-09-20T12:22:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 69.579620] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 69.585999] nix-daemon[919]: reaped child process 1007, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 69.602585] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-t1 worker1 # [ 70.445789] nix-daemon[919]: reaped child process 1021, status = succeeded worker1 # [ 70.650926] nix-daemon[919]: accepted connection from pid 1036, user nix-grpc-daemon (trusted) worker1 # [ 70.674727] nix-daemon[919]: reaped child process 1039, status = succeeded lb # [ 70.800990] niks3-server[1132]: 2026/09/20 12:22:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 70.704374] nix-grpc-daemon[928]: time=2026-09-20T12:22:03.732Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 70.705960] nix-grpc-daemon[928]: time=2026-09-20T12:22:03.732Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 70.856781] niks3-server[1132]: 2026/09/20 12:22:03 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 70.868616] niks3-server[1132]: 2026/09/20 12:22:03 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst lb # [ 70.895318] niks3-server[1132]: 2026/09/20 12:22:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign worker1 # [ 70.792375] nix-grpc-daemon[928]: time=2026-09-20T12:22:03.822Z level=INFO msg="Uploading 1 narinfos" lb # [ 70.908514] niks3-server[1132]: 2026/09/20 12:22:03 INFO Signed narinfos id=6 count=1 lb # [ 70.917149] niks3-server[1132]: 2026/09/20 12:22:03 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 70.930150] niks3-server[1132]: 2026/09/20 12:22:03 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 70.936918] niks3-server[1132]: 2026/09/20 12:22:03 INFO Completed upload id=6 worker1 # [ 70.829696] nix-grpc-daemon[928]: time=2026-09-20T12:22:03.859Z level=INFO msg="Upload complete. (415ms)" lb # [ 70.940507] niks3-server[1132]: 2026/09/20 12:22:03 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo worker1 # [ 70.841393] nix-grpc-daemon[855]: ts=2026-09-20T12:22:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker1 # [ 70.861525] nix-daemon[919]: reaped child process 1019, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.06 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.27 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.35 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.84 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker2 # [ 72.010956] nix-grpc-daemon[862]: ts=2026-09-20T12:22:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42832 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 72.593158] nix-grpc-daemon[855]: ts=2026-09-20T12:22:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 72.609248] nix-grpc-daemon[928]: time=2026-09-20T12:22:05.637Z level=INFO msg="All 2 paths already cached" worker2 # [ 72.057848] nix-grpc-daemon[862]: ts=2026-09-20T12:22:05Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.37 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.61 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.08 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 worker2 # [ 73.237848] nix-grpc-daemon[862]: ts=2026-09-20T12:22:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42832 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 73.250921] nix-grpc-daemon[862]: ts=2026-09-20T12:22:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 73.290420] nix-grpc-daemon[862]: ts=2026-09-20T12:22:06Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker2 # [ 73.298585] nix-grpc-daemon[862]: ts=2026-09-20T12:22:06Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 73.909493] nix-grpc-daemon[855]: ts=2026-09-20T12:22:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 73.933055] nix-grpc-daemon[855]: ts=2026-09-20T12:22:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 73.950105] nix-grpc-daemon[928]: time=2026-09-20T12:22:06.979Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 73.963168] nix-grpc-daemon[855]: ts=2026-09-20T12:22:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker1 # [ 73.977570] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 74.200290] nix-daemon[919]: accepted connection from pid 1056, user nix-grpc-daemon (trusted) worker1 # [ 74.226705] nix-daemon[919]: reaped child process 1059, status = succeeded worker1 # [ 74.438419] nix-daemon[919]: accepted connection from pid 1061, user nix-grpc-daemon (trusted) worker1 # [ 74.464068] nix-daemon[919]: reaped child process 1064, status = succeeded lb # [ 74.584488] niks3-server[1132]: 2026/09/20 12:22:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 74.484116] nix-grpc-daemon[928]: time=2026-09-20T12:22:07.514Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 74.485814] nix-grpc-daemon[928]: time=2026-09-20T12:22:07.514Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 74.626311] niks3-server[1132]: 2026/09/20 12:22:07 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst worker1 # [ 74.534729] nix-grpc-daemon[928]: time=2026-09-20T12:22:07.564Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.645005] niks3-server[1132]: 2026/09/20 12:22:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 74.653495] niks3-server[1132]: 2026/09/20 12:22:07 INFO Signed narinfos id=7 count=1 lb # [ 74.663792] niks3-server[1132]: 2026/09/20 12:22:07 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 74.667375] niks3-server[1132]: 2026/09/20 12:22:07 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 74.684544] niks3-server[1132]: 2026/09/20 12:22:07 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo lb # [ 74.695449] niks3-server[1132]: 2026/09/20 12:22:07 INFO Completed upload id=7 worker1 # [ 74.588474] nix-grpc-daemon[928]: time=2026-09-20T12:22:07.618Z level=INFO msg="Upload complete. (587ms)" worker1 # [ 74.604624] nix-grpc-daemon[855]: ts=2026-09-20T12:22:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 74.616633] nix-grpc-daemon[855]: ts=2026-09-20T12:22:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 74.631480] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 74.640680] nix-daemon[919]: reaped child process 1054, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... worker1 # [ 74.657117] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv lb # [ 75.542104] envoy[882]: conn peer=[2001:db8:1::1]:44576 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9497 tx=3857 ms=6791 lb # [ 75.544498] envoy[882]: conn peer=[2001:db8:1::1]:59764 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=481 ms=77 client # farm-top> LOG-farm-top-t1b worker1 # [ 75.698601] nix-daemon[919]: reaped child process 1068, status = succeeded worker1 # [ 75.891521] nix-daemon[919]: accepted connection from pid 1083, user nix-grpc-daemon (trusted) worker1 # [ 75.918024] nix-daemon[919]: reaped child process 1086, status = succeeded lb # [ 76.031268] niks3-server[1132]: 2026/09/20 12:22:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 76.099343] nix-grpc-daemon[928]: time=2026-09-20T12:22:09.128Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 76.114753] nix-grpc-daemon[928]: time=2026-09-20T12:22:09.134Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" worker1 # [ 76.173038] nix-grpc-daemon[928]: time=2026-09-20T12:22:09.202Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.272984] niks3-server[1132]: 2026/09/20 12:22:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 76.290966] niks3-server[1132]: 2026/09/20 12:22:09 INFO Signed narinfos id=8 count=1 lb # [ 76.298898] niks3-server[1132]: 2026/09/20 12:22:09 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv lb # [ 76.308761] niks3-server[1132]: 2026/09/20 12:22:09 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst lb # [ 76.321978] niks3-server[1132]: 2026/09/20 12:22:09 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls worker1 # [ 76.221092] nix-grpc-daemon[928]: time=2026-09-20T12:22:09.251Z level=INFO msg="Upload complete. (546ms)" lb # [ 76.329697] niks3-server[1132]: 2026/09/20 12:22:09 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 76.336739] niks3-server[1132]: 2026/09/20 12:22:09 INFO Completed upload id=8 lb # [ 76.339372] niks3-server[1132]: 2026/09/20 12:22:09 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker1 # [ 76.233402] nix-grpc-daemon[855]: ts=2026-09-20T12:22:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker1 # [ 76.256988] nix-daemon[919]: reaped child process 1066, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.74 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.24 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.08 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.42 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 77.086072] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: ff269ff42f854546983b7bdd95b24f52 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.07 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 77.350723] nix[967]: don't know how to build these paths: worker2 # [ 76.468147] nix-grpc-daemon[862]: ts=2026-09-20T12:22:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42832 client # [ 77.351775] nix[967]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 76.480920] nix-grpc-daemon[862]: ts=2026-09-20T12:22:09Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 76.486374] nix-grpc-daemon[862]: ts=2026-09-20T12:22:09Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 76.492559] nix-grpc-daemon[862]: ts=2026-09-20T12:22:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 76.513868] nix-grpc-daemon[862]: ts=2026-09-20T12:22:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42832 client # [ 77.408234] nix[967]: copying 1 paths to 'lb:50051'... client # [ 77.411997] nix[967]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker2 # [ 76.532184] nix-grpc-daemon[862]: ts=2026-09-20T12:22:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 76.544950] nix-daemon[936]: accepted connection from pid 862, user nix-grpc-daemon (trusted) worker2 # [ 76.568343] nix-grpc-daemon[862]: ts=2026-09-20T12:22:10Z level=info event=niks3_push_started pid=984 worker2 # [ 76.852562] nix-grpc-daemon[984]: time=2026-09-20T12:22:10.363Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 77.064951] nix-daemon[936]: accepted connection from pid 997, user nix-grpc-daemon (trusted) worker2 # [ 77.087769] nix-daemon[936]: reaped child process 1000, status = succeeded worker2 # [ 77.288141] nix-daemon[936]: accepted connection from pid 1002, user nix-grpc-daemon (trusted) worker2 # [ 77.310134] nix-daemon[936]: reaped child process 1005, status = succeeded lb # [ 78.001492] niks3-server[1132]: 2026/09/20 12:22:10 INFO Received uploads request method=POST path=/api/pending_closures client # [ 78.199247] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. worker2 # [ 77.339700] nix-grpc-daemon[984]: time=2026-09-20T12:22:10.852Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 77.343368] nix-grpc-daemon[984]: time=2026-09-20T12:22:10.854Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds) lb # [ 78.057868] niks3-server[1132]: 2026/09/20 12:22:11 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst lb # [ 78.069137] niks3-server[1132]: 2026/09/20 12:22:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign worker2 # [ 77.400532] nix-grpc-daemon[984]: time=2026-09-20T12:22:10.912Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.082163] niks3-server[1132]: 2026/09/20 12:22:11 INFO Signed narinfos id=9 count=1 lb # [ 78.091461] niks3-server[1132]: 2026/09/20 12:22:11 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 78.106080] niks3-server[1132]: 2026/09/20 12:22:11 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 78.118823] niks3-server[1132]: 2026/09/20 12:22:11 INFO Completed upload id=9 worker2 # [ 77.448593] nix-grpc-daemon[984]: time=2026-09-20T12:22:10.957Z level=INFO msg="Upload complete. (582ms)" lb # [ 78.122944] niks3-server[1132]: 2026/09/20 12:22:11 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker2 # [ 77.451256] nix-grpc-daemon[862]: ts=2026-09-20T12:22:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42832 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 77.462579] nix-grpc-daemon[862]: ts=2026-09-20T12:22:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 77.478406] nix-daemon[936]: accepted connection from pid 862, user nix-grpc-daemon (trusted) worker2 # [ 77.482597] nix-daemon[936]: reaped child process 982, status = succeeded client # Running as unit: dedup2.service; invocation ID: ab04d405e20544929a091fa6118c1cce client # [ 78.375790] nix[967]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 77.498127] nix-daemon[936]: accepted connection from pid 862, user nix-grpc-daemon (trusted) worker2 # [ 77.694014] nix-grpc-daemon[862]: ts=2026-09-20T12:22:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42832 client # [ 78.589828] nix[983]: this derivation will be built: worker1 # [ 78.282668] nix-grpc-daemon[855]: ts=2026-09-20T12:22:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 78.304164] nix-grpc-daemon[855]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' from 'http://lb:5751'... client # [ 78.639185] nix[983]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 77.774692] nix-grpc-daemon[862]: ts=2026-09-20T12:22:11Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 77.785242] nix-grpc-daemon[862]: ts=2026-09-20T12:22:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42832 client # [ 78.670299] nix[983]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.07 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 82.135027] nix-daemon[936]: reaped child process 1013, status = succeeded worker2 # [ 82.326355] nix-daemon[936]: accepted connection from pid 1044, user nix-grpc-daemon (trusted) worker2 # [ 82.348915] nix-daemon[936]: reaped child process 1047, status = succeeded lb # [ 83.037935] niks3-server[1132]: 2026/09/20 12:22:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 82.376527] nix-grpc-daemon[984]: time=2026-09-20T12:22:15.888Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 82.378177] nix-grpc-daemon[984]: time=2026-09-20T12:22:15.888Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 83.104197] niks3-server[1132]: 2026/09/20 12:22:16 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 83.113939] niks3-server[1132]: 2026/09/20 12:22:16 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 83.124166] niks3-server[1132]: 2026/09/20 12:22:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign worker2 # [ 82.454326] nix-grpc-daemon[984]: time=2026-09-20T12:22:15.966Z level=INFO msg="Uploading 1 narinfos" lb # [ 83.133536] niks3-server[1132]: 2026/09/20 12:22:16 INFO Signed narinfos id=10 count=1 lb # [ 83.139571] niks3-server[1132]: 2026/09/20 12:22:16 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 83.152959] niks3-server[1132]: 2026/09/20 12:22:16 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 83.161168] niks3-server[1132]: 2026/09/20 12:22:16 INFO Completed upload id=10 worker2 # [ 82.483484] nix-grpc-daemon[984]: time=2026-09-20T12:22:15.996Z level=INFO msg="Upload complete. (366ms)" lb # [ 83.164523] niks3-server[1132]: 2026/09/20 12:22:16 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker2 # [ 82.505466] nix-grpc-daemon[862]: ts=2026-09-20T12:22:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42832 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 82.520003] nix-grpc-daemon[862]: ts=2026-09-20T12:22:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42832 duration_s=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 82.525941] nix-daemon[936]: reaped child process 1011, status = succeeded client # [ 83.430308] systemd[1]: dedup1.service: Deactivated successfully. client # [ 83.432832] systemd[1]: dedup1.service: Consumed 167ms CPU time over 6.347s wall clock time, 37.2M memory peak, 8.6K incoming IP traffic, 9.1K outgoing IP traffic. client # [ 83.438228] systemd[1]: dedup2.service: Deactivated successfully. client # [ 83.441025] systemd[1]: dedup2.service: Consumed 210ms CPU time over 5.239s wall clock time, 31M memory peak, 7.9K incoming IP traffic, 6.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.17 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.06 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.11 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds) (finished: subtest: two clients wanting the same drv build it once, in 7.51 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 84.813490] systemd[1]: Started Nix Daemon. client # [ 85.053191] nix-daemon[1025]: accepted connection from pid 1022, user root (trusted) worker1 # [ 84.983447] nix-grpc-daemon[855]: ts=2026-09-20T12:22:18Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 84.993559] nix-grpc-daemon[855]: ts=2026-09-20T12:22:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41652 worker2 # [ 84.442302] nix-grpc-daemon[862]: ts=2026-09-20T12:22:17Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 84.442525] nix-grpc-daemon[862]: ts=2026-09-20T12:22:17Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 85.058957] nix-grpc-daemon[855]: ts=2026-09-20T12:22:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 85.080454] nix-grpc-daemon[855]: ts=2026-09-20T12:22:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 85.099981] nix-grpc-daemon[855]: ts=2026-09-20T12:22:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 85.127156] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 85.368985] nix-daemon[919]: accepted connection from pid 1116, user nix-grpc-daemon (trusted) worker1 # [ 85.393813] nix-daemon[919]: reaped child process 1119, status = succeeded lb # [ 85.542880] envoy[882]: conn peer=[2001:db8:1::1]:59774 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4228 tx=1746 ms=2451 lb # [ 85.548590] envoy[882]: conn peer=[2001:db8:1::1]:59776 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1397 ms=6048 lb # [ 85.553977] envoy[882]: conn peer=[2001:db8:1::1]:59778 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1579 tx=1487 ms=4828 worker1 # [ 85.573147] nix-daemon[919]: accepted connection from pid 1121, user nix-grpc-daemon (trusted) worker1 # [ 85.594864] nix-daemon[919]: reaped child process 1124, status = succeeded lb # [ 85.719128] niks3-server[1132]: 2026/09/20 12:22:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 85.624402] nix-grpc-daemon[928]: time=2026-09-20T12:22:18.653Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 85.625987] nix-grpc-daemon[928]: time=2026-09-20T12:22:18.653Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 85.766060] niks3-server[1132]: 2026/09/20 12:22:18 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst worker1 # [ 85.675233] nix-grpc-daemon[928]: time=2026-09-20T12:22:18.705Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.784905] niks3-server[1132]: 2026/09/20 12:22:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 85.794232] niks3-server[1132]: 2026/09/20 12:22:18 INFO Signed narinfos id=11 count=1 lb # [ 85.801126] niks3-server[1132]: 2026/09/20 12:22:18 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 85.811235] niks3-server[1132]: 2026/09/20 12:22:18 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 85.817760] niks3-server[1132]: 2026/09/20 12:22:18 INFO Completed upload id=11 worker1 # [ 85.708790] nix-grpc-daemon[928]: time=2026-09-20T12:22:18.739Z level=INFO msg="Upload complete. (557ms)" lb # [ 85.820589] niks3-server[1132]: 2026/09/20 12:22:18 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker1 # [ 85.724771] nix-grpc-daemon[855]: ts=2026-09-20T12:22:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 85.740841] nix-grpc-daemon[855]: ts=2026-09-20T12:22:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 85.749484] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 85.755402] nix-daemon[919]: reaped child process 1114, status = succeeded worker1 # [ 85.769033] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 87.009826] nix-daemon[919]: reaped child process 1128, status = succeeded worker1 # [ 87.208969] nix-daemon[919]: accepted connection from pid 1143, user nix-grpc-daemon (trusted) worker1 # [ 87.232487] nix-daemon[919]: reaped child process 1146, status = succeeded lb # [ 87.358562] niks3-server[1132]: 2026/09/20 12:22:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 87.264645] nix-grpc-daemon[928]: time=2026-09-20T12:22:20.292Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 87.266259] nix-grpc-daemon[928]: time=2026-09-20T12:22:20.292Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 87.412877] niks3-server[1132]: 2026/09/20 12:22:20 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 87.429821] niks3-server[1132]: 2026/09/20 12:22:20 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 87.442649] niks3-server[1132]: 2026/09/20 12:22:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign worker1 # [ 87.334932] nix-grpc-daemon[928]: time=2026-09-20T12:22:20.364Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.447853] niks3-server[1132]: 2026/09/20 12:22:20 INFO Signed narinfos id=12 count=1 lb # [ 87.455818] niks3-server[1132]: 2026/09/20 12:22:20 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 87.468708] niks3-server[1132]: 2026/09/20 12:22:20 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 87.475892] niks3-server[1132]: 2026/09/20 12:22:20 INFO Completed upload id=12 worker1 # [ 87.367077] nix-grpc-daemon[928]: time=2026-09-20T12:22:20.397Z level=INFO msg="Upload complete. (381ms)" lb # [ 87.478374] niks3-server[1132]: 2026/09/20 12:22:20 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker1 # [ 87.381812] nix-grpc-daemon[855]: ts=2026-09-20T12:22:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 worker2 # [ 86.819417] nix-grpc-daemon[862]: ts=2026-09-20T12:22:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42832 worker1 # [ 87.405051] nix-daemon[919]: reaped child process 1126, status = succeeded worker2 # [ 86.845349] nix-grpc-daemon[862]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker1 # [ 87.471565] nix-grpc-daemon[855]: ts=2026-09-20T12:22:20Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 87.479057] nix-grpc-daemon[855]: ts=2026-09-20T12:22:20Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 87.778816] nix-grpc-daemon[855]: ts=2026-09-20T12:22:20Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:41652 worker2 # [ 87.217274] nix-grpc-daemon[862]: ts=2026-09-20T12:22:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 87.234916] nix-grpc-daemon[984]: time=2026-09-20T12:22:20.746Z level=INFO msg="All 1 paths already cached" worker2 # [ 87.258219] nix-grpc-daemon[862]: ts=2026-09-20T12:22:20Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker2 # [ 87.265693] nix-grpc-daemon[862]: ts=2026-09-20T12:22:20Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 87.838430] nix-grpc-daemon[855]: ts=2026-09-20T12:22:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 87.859132] nix-grpc-daemon[855]: ts=2026-09-20T12:22:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 87.869617] nix-grpc-daemon[928]: time=2026-09-20T12:22:20.899Z level=INFO msg="All 1 paths already cached" worker1 # [ 87.879412] nix-grpc-daemon[855]: ts=2026-09-20T12:22:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 87.897452] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 88.150652] nix-daemon[919]: accepted connection from pid 1150, user nix-grpc-daemon (trusted) worker1 # [ 88.177453] nix-daemon[919]: reaped child process 1153, status = succeeded worker1 # [ 88.381410] nix-daemon[919]: accepted connection from pid 1155, user nix-grpc-daemon (trusted) worker1 # [ 88.407127] nix-daemon[919]: reaped child process 1158, status = succeeded lb # [ 88.529830] niks3-server[1132]: 2026/09/20 12:22:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 88.556539] nix-grpc-daemon[928]: time=2026-09-20T12:22:21.584Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 88.561514] nix-grpc-daemon[928]: time=2026-09-20T12:22:21.584Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" worker1 # [ 88.598961] nix-grpc-daemon[928]: time=2026-09-20T12:22:21.628Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.696728] niks3-server[1132]: 2026/09/20 12:22:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 88.713274] niks3-server[1132]: 2026/09/20 12:22:21 INFO Signed narinfos id=13 count=1 lb # [ 88.722749] niks3-server[1132]: 2026/09/20 12:22:21 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst lb # [ 88.734725] niks3-server[1132]: 2026/09/20 12:22:21 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls worker1 # [ 88.639421] nix-grpc-daemon[928]: time=2026-09-20T12:22:21.669Z level=INFO msg="Upload complete. (719ms)" lb # [ 88.748848] niks3-server[1132]: 2026/09/20 12:22:21 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 88.754963] niks3-server[1132]: 2026/09/20 12:22:21 INFO Completed upload id=13 lb # [ 88.758245] niks3-server[1132]: 2026/09/20 12:22:21 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker1 # [ 88.653598] nix-grpc-daemon[855]: ts=2026-09-20T12:22:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 88.670068] nix-grpc-daemon[855]: ts=2026-09-20T12:22:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 88.689514] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 88.698333] nix-daemon[919]: reaped child process 1148, status = succeeded worker1 # [ 88.720319] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 89.956527] nix-daemon[919]: reaped child process 1162, status = succeeded worker1 # [ 90.159954] nix-daemon[919]: accepted connection from pid 1177, user nix-grpc-daemon (trusted) worker1 # [ 90.185490] nix-daemon[919]: reaped child process 1180, status = succeeded lb # [ 90.311194] niks3-server[1132]: 2026/09/20 12:22:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 90.218729] nix-grpc-daemon[928]: time=2026-09-20T12:22:23.248Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 90.222444] nix-grpc-daemon[928]: time=2026-09-20T12:22:23.250Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 90.343192] niks3-server[1132]: 2026/09/20 12:22:23 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv lb # [ 90.355224] niks3-server[1132]: 2026/09/20 12:22:23 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 90.362492] niks3-server[1132]: 2026/09/20 12:22:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign worker1 # [ 90.258566] nix-grpc-daemon[928]: time=2026-09-20T12:22:23.288Z level=INFO msg="Uploading 1 narinfos" lb # [ 90.369355] niks3-server[1132]: 2026/09/20 12:22:23 INFO Signed narinfos id=14 count=1 lb # [ 90.372121] niks3-server[1132]: 2026/09/20 12:22:23 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 90.379661] niks3-server[1132]: 2026/09/20 12:22:23 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 90.387151] niks3-server[1132]: 2026/09/20 12:22:23 INFO Completed upload id=14 worker1 # [ 90.279998] nix-grpc-daemon[928]: time=2026-09-20T12:22:23.310Z level=INFO msg="Upload complete. (340ms)" lb # [ 90.389270] niks3-server[1132]: 2026/09/20 12:22:23 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker1 # [ 90.286944] nix-grpc-daemon[855]: ts=2026-09-20T12:22:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 worker1 # [ 90.296529] nix-daemon[919]: reaped child process 1160, status = succeeded worker2 # [ 89.729291] nix-grpc-daemon[862]: ts=2026-09-20T12:22:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 89.747593] nix-grpc-daemon[862]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker1 # [ 90.367205] nix-grpc-daemon[855]: ts=2026-09-20T12:22:23Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 90.370633] nix-grpc-daemon[855]: ts=2026-09-20T12:22:23Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 90.079350] nix-grpc-daemon[862]: ts=2026-09-20T12:22:23Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 90.092591] nix-grpc-daemon[862]: ts=2026-09-20T12:22:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 90.107041] nix-grpc-daemon[984]: time=2026-09-20T12:22:23.618Z level=INFO msg="All 2 paths already cached" worker2 # [ 90.134231] nix-grpc-daemon[862]: ts=2026-09-20T12:22:23Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker2 # [ 90.141698] nix-grpc-daemon[862]: ts=2026-09-20T12:22:23Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 90.715181] nix-grpc-daemon[855]: ts=2026-09-20T12:22:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 90.739646] nix-grpc-daemon[855]: ts=2026-09-20T12:22:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 90.759468] nix-grpc-daemon[928]: time=2026-09-20T12:22:23.789Z level=INFO msg="All 2 paths already cached" worker1 # [ 90.773454] nix-grpc-daemon[855]: ts=2026-09-20T12:22:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 90.792513] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 91.035456] nix-daemon[919]: accepted connection from pid 1184, user nix-grpc-daemon (trusted) worker1 # [ 91.057803] nix-daemon[919]: reaped child process 1187, status = succeeded worker1 # [ 91.248001] nix-daemon[919]: accepted connection from pid 1189, user nix-grpc-daemon (trusted) worker1 # [ 91.271508] nix-daemon[919]: reaped child process 1192, status = succeeded lb # [ 91.393820] niks3-server[1132]: 2026/09/20 12:22:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 91.301950] nix-grpc-daemon[928]: time=2026-09-20T12:22:24.331Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 91.303612] nix-grpc-daemon[928]: time=2026-09-20T12:22:24.331Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 91.420179] niks3-server[1132]: 2026/09/20 12:22:24 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst lb # [ 91.427984] niks3-server[1132]: 2026/09/20 12:22:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 91.430265] niks3-server[1132]: 2026/09/20 12:22:24 INFO Signed narinfos id=15 count=1 worker1 # [ 91.324542] nix-grpc-daemon[928]: time=2026-09-20T12:22:24.354Z level=INFO msg="Uploading 1 narinfos" lb # [ 91.437323] niks3-server[1132]: 2026/09/20 12:22:24 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 91.444761] niks3-server[1132]: 2026/09/20 12:22:24 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 91.449208] niks3-server[1132]: 2026/09/20 12:22:24 INFO Completed upload id=15 worker1 # [ 91.341688] nix-grpc-daemon[928]: time=2026-09-20T12:22:24.372Z level=INFO msg="Upload complete. (527ms)" lb # [ 91.451061] niks3-server[1132]: 2026/09/20 12:22:24 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker1 # [ 91.353121] nix-grpc-daemon[855]: ts=2026-09-20T12:22:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 91.363149] nix-grpc-daemon[855]: ts=2026-09-20T12:22:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 91.370033] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 91.374865] nix-daemon[919]: reaped child process 1182, status = succeeded worker1 # [ 91.387794] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 92.416996] nix-daemon[919]: reaped child process 1196, status = succeeded worker1 # [ 92.605303] nix-daemon[919]: accepted connection from pid 1211, user nix-grpc-daemon (trusted) worker1 # [ 92.628779] nix-daemon[919]: reaped child process 1214, status = succeeded lb # [ 92.750049] niks3-server[1132]: 2026/09/20 12:22:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 92.656563] nix-grpc-daemon[928]: time=2026-09-20T12:22:25.684Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 92.658164] nix-grpc-daemon[928]: time=2026-09-20T12:22:25.685Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 92.812641] niks3-server[1132]: 2026/09/20 12:22:25 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst worker1 # [ 92.716648] nix-grpc-daemon[928]: time=2026-09-20T12:22:25.746Z level=INFO msg="Uploading 1 narinfos" lb # [ 92.828003] niks3-server[1132]: 2026/09/20 12:22:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 92.831327] niks3-server[1132]: 2026/09/20 12:22:25 INFO Signed narinfos id=16 count=1 lb # [ 92.841591] niks3-server[1132]: 2026/09/20 12:22:25 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 92.846240] niks3-server[1132]: 2026/09/20 12:22:25 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 92.853798] niks3-server[1132]: 2026/09/20 12:22:25 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 92.857816] niks3-server[1132]: 2026/09/20 12:22:25 INFO Completed upload id=16 lb # [ 92.859865] niks3-server[1132]: 2026/09/20 12:22:25 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker1 # [ 92.750658] nix-grpc-daemon[928]: time=2026-09-20T12:22:25.780Z level=INFO msg="Upload complete. (349ms)" worker2 # [ 92.200129] nix-grpc-daemon[862]: ts=2026-09-20T12:22:25Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42832 worker1 # [ 92.765579] nix-grpc-daemon[855]: ts=2026-09-20T12:22:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker2 # [ 92.209029] nix-grpc-daemon[862]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... worker1 # [ 92.784849] nix-daemon[919]: reaped child process 1194, status = succeeded worker2 # [ 92.256231] nix-grpc-daemon[862]: ts=2026-09-20T12:22:25Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 92.265978] nix-grpc-daemon[862]: ts=2026-09-20T12:22:25Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42832 duration_s=0 paths=1 nar_bytes_out=232 client # [ 93.307320] nix-daemon[1025]: reaped child process 1027, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.77 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.06 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.06 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.93 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.54 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.23 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.31 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.05 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 94.849956] nix-daemon[1025]: accepted connection from pid 1107, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker1 # [ 94.785727] nix-grpc-daemon[855]: ts=2026-09-20T12:22:27Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:41652 client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 94.231175] nix-grpc-daemon[862]: ts=2026-09-20T12:22:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42832 client # copying 1 paths... client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'... worker1 # [ 94.818104] nix-grpc-daemon[855]: ts=2026-09-20T12:22:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 94.837091] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 95.088705] nix-daemon[919]: accepted connection from pid 1223, user nix-grpc-daemon (trusted) worker1 # [ 95.112254] nix-daemon[919]: reaped child process 1226, status = succeeded lb # [ 95.238734] niks3-server[1132]: 2026/09/20 12:22:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 95.142953] nix-grpc-daemon[928]: time=2026-09-20T12:22:28.172Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 95.145177] nix-grpc-daemon[928]: time=2026-09-20T12:22:28.175Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 95.276569] niks3-server[1132]: 2026/09/20 12:22:28 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 95.297104] niks3-server[1132]: 2026/09/20 12:22:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker1 # [ 95.195323] nix-grpc-daemon[928]: time=2026-09-20T12:22:28.225Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.310417] niks3-server[1132]: 2026/09/20 12:22:28 INFO Signed narinfos id=17 count=1 lb # [ 95.317612] niks3-server[1132]: 2026/09/20 12:22:28 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 95.327960] niks3-server[1132]: 2026/09/20 12:22:28 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete worker1 # [ 95.227781] nix-grpc-daemon[928]: time=2026-09-20T12:22:28.258Z level=INFO msg="Upload complete. (371ms)" lb # [ 95.337424] niks3-server[1132]: 2026/09/20 12:22:28 INFO Completed upload id=17 lb # [ 95.340653] niks3-server[1132]: 2026/09/20 12:22:28 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker1 # [ 95.238533] nix-grpc-daemon[855]: ts=2026-09-20T12:22:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=0 paths=1 nar_bytes_in=120 worker1 # [ 95.259324] nix-daemon[919]: reaped child process 1221, status = succeeded worker2 # [ 94.697753] nix-grpc-daemon[862]: ts=2026-09-20T12:22:28Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 94.707110] nix-grpc-daemon[862]: ts=2026-09-20T12:22:28Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 94.746307] nix-grpc-daemon[862]: ts=2026-09-20T12:22:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 94.763560] nix-grpc-daemon[862]: ts=2026-09-20T12:22:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42832 client # copying 2 paths to 'lb:50051'... worker2 # [ 94.791390] nix-grpc-daemon[862]: ts=2026-09-20T12:22:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42832 client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 94.817928] nix-daemon[936]: accepted connection from pid 862, user nix-grpc-daemon (trusted) lb # [ 95.544173] envoy[882]: conn peer=[2001:db8:1::1]:34150 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=41 lb # [ 95.549410] envoy[882]: conn peer=[2001:db8:1::1]:34140 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3437 tx=1792 ms=2530 lb # [ 95.554346] envoy[882]: conn peer=[2001:db8:1::1]:34154 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3888 tx=1989 ms=2611 lb # [ 95.559043] envoy[882]: conn peer=[2001:db8:1::1]:34168 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=27 lb # [ 95.563000] envoy[882]: conn peer=[2001:db8:1::1]:35224 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4314 tx=2223 ms=2252 lb # [ 95.567401] envoy[882]: conn peer=[2001:db8:1::1]:35228 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=407 ms=83 worker2 # [ 95.069902] nix-daemon[936]: accepted connection from pid 1074, user nix-grpc-daemon (trusted) worker2 # [ 95.096468] nix-daemon[936]: reaped child process 1077, status = succeeded worker2 # [ 95.292588] nix-daemon[936]: accepted connection from pid 1079, user nix-grpc-daemon (trusted) worker2 # [ 95.316571] nix-daemon[936]: reaped child process 1082, status = succeeded lb # [ 95.997582] niks3-server[1132]: 2026/09/20 12:22:28 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 96.010781] niks3-server[1132]: 2026/09/20 12:22:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 95.348100] nix-grpc-daemon[984]: time=2026-09-20T12:22:28.859Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 95.349655] nix-grpc-daemon[984]: time=2026-09-20T12:22:28.859Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" worker2 # [ 95.351478] nix-grpc-daemon[984]: time=2026-09-20T12:22:28.859Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" lb # [ 96.049718] niks3-server[1132]: 2026/09/20 12:22:29 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 96.074257] niks3-server[1132]: 2026/09/20 12:22:29 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 96.091215] niks3-server[1132]: 2026/09/20 12:22:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 96.101107] niks3-server[1132]: 2026/09/20 12:22:29 INFO Signed narinfos id=18 count=1 worker2 # [ 95.427178] nix-grpc-daemon[984]: time=2026-09-20T12:22:28.938Z level=INFO msg="Uploading 3 narinfos" lb # [ 96.107116] niks3-server[1132]: 2026/09/20 12:22:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 96.114118] niks3-server[1132]: 2026/09/20 12:22:29 INFO Signed narinfos id=19 count=2 lb # [ 96.119088] niks3-server[1132]: 2026/09/20 12:22:29 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 96.125605] niks3-server[1132]: 2026/09/20 12:22:29 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 96.143551] niks3-server[1132]: 2026/09/20 12:22:29 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 96.152874] niks3-server[1132]: 2026/09/20 12:22:29 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 96.160183] niks3-server[1132]: 2026/09/20 12:22:29 INFO Completed upload id=18 lb # [ 96.161709] niks3-server[1132]: 2026/09/20 12:22:29 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 96.163947] niks3-server[1132]: 2026/09/20 12:22:29 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 96.167372] niks3-server[1132]: 2026/09/20 12:22:29 INFO Completed upload id=19 lb # [ 96.169464] niks3-server[1132]: 2026/09/20 12:22:29 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo worker2 # [ 95.492317] nix-grpc-daemon[984]: time=2026-09-20T12:22:29.005Z level=INFO msg="Upload complete. (649ms)" worker2 # [ 95.506568] nix-grpc-daemon[862]: ts=2026-09-20T12:22:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42832 duration_s=0 paths=2 nar_bytes_in=984 worker2 # [ 95.525134] nix-grpc-daemon[862]: ts=2026-09-20T12:22:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 95.538279] nix-daemon[936]: accepted connection from pid 862, user nix-grpc-daemon (trusted) worker2 # [ 95.546507] nix-daemon[936]: reaped child process 1072, status = succeeded worker2 # [ 95.566142] nix-grpc-daemon[862]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... worker2 # [ 95.589262] nix-daemon[936]: accepted connection from pid 862, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker2 # [ 96.830462] nix-daemon[936]: reaped child process 1087, status = succeeded worker2 # [ 97.027469] nix-daemon[936]: accepted connection from pid 1102, user nix-grpc-daemon (trusted) worker2 # [ 97.051634] nix-daemon[936]: reaped child process 1105, status = succeeded lb # [ 97.743028] niks3-server[1132]: 2026/09/20 12:22:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 97.076162] nix-grpc-daemon[984]: time=2026-09-20T12:22:30.588Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 97.782769] niks3-server[1132]: 2026/09/20 12:22:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker2 # [ 97.120109] nix-grpc-daemon[984]: time=2026-09-20T12:22:30.632Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.801270] niks3-server[1132]: 2026/09/20 12:22:30 INFO Signed narinfos id=20 count=1 lb # [ 97.807818] niks3-server[1132]: 2026/09/20 12:22:30 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 97.817161] niks3-server[1132]: 2026/09/20 12:22:30 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls lb # [ 97.828557] niks3-server[1132]: 2026/09/20 12:22:30 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete worker2 # [ 97.157847] nix-grpc-daemon[984]: time=2026-09-20T12:22:30.670Z level=INFO msg="Upload complete. (357ms)" lb # [ 97.834234] niks3-server[1132]: 2026/09/20 12:22:30 INFO Completed upload id=20 lb # [ 97.838906] niks3-server[1132]: 2026/09/20 12:22:30 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo worker2 # [ 97.164574] nix-grpc-daemon[862]: ts=2026-09-20T12:22:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42832 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 worker2 # [ 97.176776] nix-daemon[936]: reaped child process 1084, status = succeeded client # copying 1 paths... worker1 # [ 97.791212] nix-grpc-daemon[855]: ts=2026-09-20T12:22:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 97.806081] nix-grpc-daemon[855]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 97.296196] nix-grpc-daemon[862]: ts=2026-09-20T12:22:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 97.306285] nix-grpc-daemon[862]: ts=2026-09-20T12:22:30Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42832 duration_s=0 paths=1 nar_bytes_out=120 client # [ 98.275807] nix-daemon[1025]: reaped child process 1110, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.70 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 98.530329] nix-daemon[1025]: accepted connection from pid 1128, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 97.892692] nix-grpc-daemon[862]: ts=2026-09-20T12:22:31Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:42832 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 97.903761] nix-grpc-daemon[862]: ts=2026-09-20T12:22:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 97.918204] nix-grpc-daemon[984]: time=2026-09-20T12:22:31.430Z level=INFO msg="All 1 paths already cached" worker2 # [ 97.942087] nix-grpc-daemon[862]: ts=2026-09-20T12:22:31Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker2 # [ 97.951735] nix-grpc-daemon[862]: ts=2026-09-20T12:22:31Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 98.522980] nix-grpc-daemon[855]: ts=2026-09-20T12:22:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 98.543160] nix-grpc-daemon[855]: ts=2026-09-20T12:22:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41652 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 98.568816] nix-grpc-daemon[855]: ts=2026-09-20T12:22:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 98.589850] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 98.621364] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 1/5) worker1 # [ 98.673596] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 185 ms (attempt 2/5) worker1 # [ 98.868703] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 74 ms (attempt 3/5) worker1 # [ 98.942780] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 258 ms (attempt 4/5) worker1 # [ 99.210392] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 99.221716] nix-grpc-daemon[855]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 99.509090] nix-daemon[919]: accepted connection from pid 1235, user nix-grpc-daemon (trusted) worker1 # [ 99.532680] nix-daemon[919]: reaped child process 1238, status = succeeded worker1 # [ 99.742225] nix-daemon[919]: accepted connection from pid 1240, user nix-grpc-daemon (trusted) worker1 # [ 99.763188] nix-daemon[919]: reaped child process 1243, status = succeeded lb # [ 99.886135] niks3-server[1132]: 2026/09/20 12:22:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 99.784757] nix-grpc-daemon[928]: time=2026-09-20T12:22:32.814Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 99.786379] nix-grpc-daemon[928]: time=2026-09-20T12:22:32.814Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 99.907309] niks3-server[1132]: 2026/09/20 12:22:32 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst worker1 # [ 99.814984] nix-grpc-daemon[928]: time=2026-09-20T12:22:32.845Z level=INFO msg="Uploading 1 narinfos" lb # [ 99.918575] niks3-server[1132]: 2026/09/20 12:22:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 99.924796] niks3-server[1132]: 2026/09/20 12:22:32 INFO Signed narinfos id=21 count=1 lb # [ 99.928671] niks3-server[1132]: 2026/09/20 12:22:32 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 99.938703] niks3-server[1132]: 2026/09/20 12:22:32 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 99.944109] niks3-server[1132]: 2026/09/20 12:22:32 INFO Completed upload id=21 worker1 # [ 99.836586] nix-grpc-daemon[928]: time=2026-09-20T12:22:32.866Z level=INFO msg="Upload complete. (585ms)" lb # [ 99.946127] niks3-server[1132]: 2026/09/20 12:22:32 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker1 # [ 99.844302] nix-grpc-daemon[855]: ts=2026-09-20T12:22:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=1 paths=1 nar_bytes_in=568 worker1 # [ 99.852653] nix-grpc-daemon[855]: ts=2026-09-20T12:22:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 99.861637] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 99.872284] nix-daemon[919]: reaped child process 1229, status = succeeded client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... worker1 # [ 99.880254] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 100.912680] nix-daemon[919]: reaped child process 1247, status = succeeded worker1 # [ 101.113232] nix-daemon[919]: accepted connection from pid 1262, user nix-grpc-daemon (trusted) worker1 # [ 101.135803] nix-daemon[919]: reaped child process 1265, status = succeeded lb # [ 101.259401] niks3-server[1132]: 2026/09/20 12:22:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 101.165453] nix-grpc-daemon[928]: time=2026-09-20T12:22:34.194Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 101.302748] niks3-server[1132]: 2026/09/20 12:22:34 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls lb # [ 101.315101] niks3-server[1132]: 2026/09/20 12:22:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign worker1 # [ 101.215768] nix-grpc-daemon[928]: time=2026-09-20T12:22:34.245Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.329329] niks3-server[1132]: 2026/09/20 12:22:34 INFO Signed narinfos id=22 count=1 lb # [ 101.336199] niks3-server[1132]: 2026/09/20 12:22:34 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv lb # [ 101.350389] niks3-server[1132]: 2026/09/20 12:22:34 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 101.359705] niks3-server[1132]: 2026/09/20 12:22:34 INFO Completed upload id=22 worker1 # [ 101.252743] nix-grpc-daemon[928]: time=2026-09-20T12:22:34.283Z level=INFO msg="Upload complete. (360ms)" lb # [ 101.363916] niks3-server[1132]: 2026/09/20 12:22:34 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo worker1 # [ 101.265592] nix-grpc-daemon[855]: ts=2026-09-20T12:22:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41652 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 worker1 # [ 101.288365] nix-daemon[919]: reaped child process 1245, status = succeeded client # copying 1 paths... worker2 # [ 100.745270] nix-grpc-daemon[862]: ts=2026-09-20T12:22:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 100.762591] nix-grpc-daemon[862]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 100.822186] nix-grpc-daemon[862]: ts=2026-09-20T12:22:34Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 100.828128] nix-grpc-daemon[862]: ts=2026-09-20T12:22:34Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42832 duration_s=0 paths=1 nar_bytes_out=120 client # [ 101.838996] nix-daemon[1025]: reaped child process 1131, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.56 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 102.093323] nix-daemon[1025]: accepted connection from pid 1149, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker2 # [ 101.420609] nix-grpc-daemon[862]: ts=2026-09-20T12:22:34Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:42832 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 101.427350] nix-grpc-daemon[862]: ts=2026-09-20T12:22:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 101.433637] nix-grpc-daemon[984]: time=2026-09-20T12:22:34.945Z level=INFO msg="All 1 paths already cached" worker2 # [ 101.446909] nix-grpc-daemon[862]: ts=2026-09-20T12:22:34Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker2 # [ 101.454373] nix-grpc-daemon[862]: ts=2026-09-20T12:22:34Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 101.460823] nix-grpc-daemon[862]: ts=2026-09-20T12:22:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 101.466016] nix-grpc-daemon[862]: ts=2026-09-20T12:22:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 101.475587] nix-grpc-daemon[984]: time=2026-09-20T12:22:34.988Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 101.486487] nix-grpc-daemon[862]: ts=2026-09-20T12:22:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 101.501134] nix-daemon[936]: accepted connection from pid 862, user nix-grpc-daemon (trusted) worker2 # [ 101.706566] nix-daemon[936]: accepted connection from pid 1114, user nix-grpc-daemon (trusted) worker2 # [ 101.731036] nix-daemon[936]: reaped child process 1117, status = succeeded worker2 # [ 101.918359] nix-daemon[936]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker2 # [ 101.938567] nix-daemon[936]: reaped child process 1122, status = succeeded lb # [ 102.627338] niks3-server[1132]: 2026/09/20 12:22:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 102.015229] nix-grpc-daemon[984]: time=2026-09-20T12:22:35.527Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 102.018119] nix-grpc-daemon[984]: time=2026-09-20T12:22:35.527Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 102.712853] niks3-server[1132]: 2026/09/20 12:22:35 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst lb # [ 102.725729] niks3-server[1132]: 2026/09/20 12:22:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign worker2 # [ 102.057740] nix-grpc-daemon[984]: time=2026-09-20T12:22:35.570Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.736927] niks3-server[1132]: 2026/09/20 12:22:35 INFO Signed narinfos id=23 count=1 lb # [ 102.745462] niks3-server[1132]: 2026/09/20 12:22:35 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 102.756443] niks3-server[1132]: 2026/09/20 12:22:35 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 102.766994] niks3-server[1132]: 2026/09/20 12:22:35 INFO Completed upload id=23 worker2 # [ 102.091983] nix-grpc-daemon[984]: time=2026-09-20T12:22:35.604Z level=INFO msg="Upload complete. (575ms)" lb # [ 102.770775] niks3-server[1132]: 2026/09/20 12:22:35 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker2 # [ 102.106341] nix-grpc-daemon[862]: ts=2026-09-20T12:22:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42832 duration_s=0 paths=1 nar_bytes_in=568 worker2 # [ 102.121071] nix-grpc-daemon[862]: ts=2026-09-20T12:22:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 102.130932] nix-daemon[936]: accepted connection from pid 862, user nix-grpc-daemon (trusted) worker2 # [ 102.138642] nix-daemon[936]: reaped child process 1112, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... worker2 # [ 102.154023] nix-daemon[936]: accepted connection from pid 862, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker2 # [ 103.190351] nix-daemon[936]: reaped child process 1126, status = succeeded worker2 # [ 103.380278] nix-daemon[936]: accepted connection from pid 1141, user nix-grpc-daemon (trusted) worker2 # [ 103.404255] nix-daemon[936]: reaped child process 1144, status = succeeded lb # [ 104.094897] niks3-server[1132]: 2026/09/20 12:22:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 103.435904] nix-grpc-daemon[984]: time=2026-09-20T12:22:36.946Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 104.136382] niks3-server[1132]: 2026/09/20 12:22:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign worker2 # [ 103.473053] nix-grpc-daemon[984]: time=2026-09-20T12:22:36.985Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.152711] niks3-server[1132]: 2026/09/20 12:22:37 INFO Signed narinfos id=24 count=1 lb # [ 104.166410] niks3-server[1132]: 2026/09/20 12:22:37 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 104.174933] niks3-server[1132]: 2026/09/20 12:22:37 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 104.184299] niks3-server[1132]: 2026/09/20 12:22:37 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 104.189216] niks3-server[1132]: 2026/09/20 12:22:37 INFO Completed upload id=24 worker2 # [ 103.514092] nix-grpc-daemon[984]: time=2026-09-20T12:22:37.027Z level=INFO msg="Upload complete. (343ms)" lb # [ 104.191888] niks3-server[1132]: 2026/09/20 12:22:37 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker2 # [ 103.529156] nix-grpc-daemon[862]: ts=2026-09-20T12:22:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42832 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker2 # [ 103.545768] nix-daemon[936]: reaped child process 1124, status = succeeded client # copying 1 paths... worker2 # [ 103.572460] nix-grpc-daemon[862]: ts=2026-09-20T12:22:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42832 client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 103.604145] nix-grpc-daemon[862]: ts=2026-09-20T12:22:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42832 worker2 # [ 103.611456] nix-grpc-daemon[862]: ts=2026-09-20T12:22:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42832 duration_s=0 paths=1 nar_bytes_out=120 client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.83 seconds) client # [ 104.682161] nix-daemon[1025]: reaped child process 1152, status = succeeded (finished: subtest: an input only one worker has still reaches the builder, in 11.21 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.55 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.51 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure lb # [ 105.544990] envoy[882]: conn peer=[2001:db8:1::1]:35238 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4222 tx=1909 ms=3110 client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.24 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.32 seconds) lb # [ 105.550712] envoy[882]: conn peer=[2001:db8:1::1]:35248 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=329 ms=36 lb # [ 105.551026] envoy[882]: conn peer=[2001:db8:1::1]:35250 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3698 tx=1917 ms=2995 lb # [ 105.551231] envoy[882]: conn peer=[2001:db8:1::1]:40386 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=71 lb # [ 105.551402] envoy[882]: conn peer=[2001:db8:1::1]:40392 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1803 ms=2252 lb # [ 105.551509] envoy[882]: conn peer=[2001:db8:1::1]:40406 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=73 worker2 # [ 105.519263] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 105.802403] nix-grpc-daemon[862]: ts=2026-09-20T12:22:39Z level=info event=signal_exit worker2 # [ 106.255835] nix-grpc-daemon[862]: ts=2026-09-20T12:22:39Z level=info event=scheduler_yield lb # [ 106.937977] niks3-server[1132]: 2026/09/20 12:22:39 INFO lead: released remote=192.168.1.4:40980 worker2 # [ 106.264761] nix-grpc-daemon[862]: ts=2026-09-20T12:22:39Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 106.270912] nix-grpc-daemon[862]: ts=2026-09-20T12:22:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42820 worker2 # [ 106.276592] nix-grpc-daemon[862]: ts=2026-09-20T12:22:39Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 106.845106] nix-grpc-daemon[855]: ts=2026-09-20T12:22:39Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 106.283881] nix-grpc-daemon[862]: ts=2026-09-20T12:22:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42820 worker2 # [ 106.288742] nix-grpc-daemon[862]: ts=2026-09-20T12:22:39Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 106.466443] nix-grpc-daemon[862]: ts=2026-09-20T12:22:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.472488] nix-grpc-daemon[862]: ts=2026-09-20T12:22:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.045148] nix-grpc-daemon[855]: ts=2026-09-20T12:22:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.052134] nix-grpc-daemon[855]: ts=2026-09-20T12:22:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.674952] nix-grpc-daemon[862]: ts=2026-09-20T12:22:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.682026] nix-grpc-daemon[862]: ts=2026-09-20T12:22:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.253290] nix-grpc-daemon[855]: ts=2026-09-20T12:22:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.260369] nix-grpc-daemon[855]: ts=2026-09-20T12:22:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.887200] nix-grpc-daemon[862]: ts=2026-09-20T12:22:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.892485] nix-grpc-daemon[862]: ts=2026-09-20T12:22:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.461810] nix-grpc-daemon[855]: ts=2026-09-20T12:22:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.468381] nix-grpc-daemon[855]: ts=2026-09-20T12:22:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.087867] nix-grpc-daemon[862]: ts=2026-09-20T12:22:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 107.094152] nix-grpc-daemon[862]: ts=2026-09-20T12:22:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.664874] nix-grpc-daemon[855]: ts=2026-09-20T12:22:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.670747] nix-grpc-daemon[855]: ts=2026-09-20T12:22:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.262897] nix-grpc-daemon[862]: ts=2026-09-20T12:22:40Z level=info event=scheduler_restarting worker1 # [ 107.874552] nix-grpc-daemon[855]: ts=2026-09-20T12:22:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.879093] nix-grpc-daemon[855]: ts=2026-09-20T12:22:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.323836] nix-grpc-daemon[862]: ts=2026-09-20T12:22:40Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 107.358508] nix-daemon[936]: reaped child process 938, status = succeeded lb # [ 108.130990] niks3-server[1132]: 2026/09/20 12:22:41 INFO lead: acquired remote=192.168.1.3:33976 worker1 # [ 108.024337] nix-grpc-daemon[855]: ts=2026-09-20T12:22:41Z level=info event=scheduler_take_over worker1 # [ 108.075065] nix-grpc-daemon[855]: ts=2026-09-20T12:22:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.080003] nix-grpc-daemon[855]: ts=2026-09-20T12:22:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 108.281525] nix-grpc-daemon[855]: ts=2026-09-20T12:22:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.288147] nix-grpc-daemon[855]: ts=2026-09-20T12:22:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.737918] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 107.749450] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 107.751791] systemd[1]: nix-grpc-daemon.service: Consumed 2.452s CPU time over 1min 12.296s wall clock time, 52.4M memory peak, 66.5K incoming IP traffic, 189.7K outgoing IP traffic. worker2 # [ 107.766756] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 107.772663] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 107.775081] systemd[1]: nix-grpc-daemon.socket: Consumed 952us CPU time over 1min 22.083s wall clock time, 256K memory peak, 80.7K incoming IP traffic, 69.3K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.11 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 108.489030] nix-grpc-daemon[855]: ts=2026-09-20T12:22:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.495109] nix-grpc-daemon[855]: ts=2026-09-20T12:22:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 108.696602] nix-grpc-daemon[855]: ts=2026-09-20T12:22:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.702612] nix-grpc-daemon[855]: ts=2026-09-20T12:22:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 108.782077] nix-grpc-daemon[855]: ts=2026-09-20T12:22:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:41652 worker1 # [ 108.792705] nix-grpc-daemon[855]: ts=2026-09-20T12:22:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:41652 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.37 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds) worker1 # [ 108.905538] nix-grpc-daemon[855]: ts=2026-09-20T12:22:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.909866] nix-grpc-daemon[855]: ts=2026-09-20T12:22:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 108.377953] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 109.030092] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 109.106393] nix-grpc-daemon[855]: ts=2026-09-20T12:22:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.122362] nix-grpc-daemon[855]: ts=2026-09-20T12:22:42Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:53092 worker1 # [ 109.128552] nix-grpc-daemon[855]: ts=2026-09-20T12:22:42Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 108.988458] systemd[1]: Starting scheduler-token.service... worker2 # [ 109.075344] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 109.077897] systemd[1]: Finished scheduler-token.service. worker2 # [ 109.078760] systemd[1]: scheduler-token.service: Consumed 35ms CPU time over 89ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 109.085100] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 109.806681] nix-grpc-daemon[855]: ts=2026-09-20T12:22:42Z level=info event=signal_exit worker2 # [ 109.267867] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:42Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 109.270694] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:42Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 109.275134] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:42Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 109.284064] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:42Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 109.296305] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 109.313430] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.885102] nix-grpc-daemon[855]: ts=2026-09-20T12:22:42Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:53092 worker1 # [ 109.891278] nix-grpc-daemon[855]: ts=2026-09-20T12:22:42Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 110.292402] nix-grpc-daemon[855]: ts=2026-09-20T12:22:43Z level=info event=scheduler_yield lb # [ 110.401302] niks3-server[1132]: 2026/09/20 12:22:43 INFO lead: released remote=192.168.1.3:33976 worker2 # [ 109.728732] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:43Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 110.301939] nix-grpc-daemon[855]: ts=2026-09-20T12:22:43Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:53092 worker1 # [ 110.305274] nix-grpc-daemon[855]: ts=2026-09-20T12:22:43Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 110.310537] nix-grpc-daemon[855]: ts=2026-09-20T12:22:43Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 110.313289] nix-grpc-daemon[855]: ts=2026-09-20T12:22:43Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:53092 worker1 # [ 110.316095] nix-grpc-daemon[855]: ts=2026-09-20T12:22:43Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 109.930311] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.510089] nix-grpc-daemon[855]: ts=2026-09-20T12:22:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.520721] nix-grpc-daemon[855]: ts=2026-09-20T12:22:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 109.953227] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 110.154627] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.722018] nix-grpc-daemon[855]: ts=2026-09-20T12:22:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.729944] nix-grpc-daemon[855]: ts=2026-09-20T12:22:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 110.162360] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 110.931117] nix-grpc-daemon[855]: ts=2026-09-20T12:22:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.365261] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.370649] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 110.939142] nix-grpc-daemon[855]: ts=2026-09-20T12:22:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 111.140330] nix-grpc-daemon[855]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.572297] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.143482] nix-grpc-daemon[855]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 110.577999] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.293886] nix-grpc-daemon[855]: ts=2026-09-20T12:22:44Z level=info event=scheduler_restarting worker1 # [ 111.328165] nix-daemon[919]: reaped child process 921, status = succeeded worker2 # [ 110.779269] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.355120] nix-grpc-daemon[855]: ts=2026-09-20T12:22:44Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 110.784995] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 110.986349] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.991965] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.193435] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.198946] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.402349] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.406857] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.010014] nix-grpc-daemon[855]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 112.010522] nix-grpc-daemon[855]: E0000 00:00:1789906965.040072 898 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true worker1 # [ 112.055103] nix-grpc-daemon[855]: E0000 00:00:1789906965.085358 898 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 111.603324] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.609360] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.200486] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 112.208926] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 112.211692] systemd[1]: nix-grpc-daemon.service: Consumed 4.533s CPU time over 1min 16.780s wall clock time, 59.5M memory peak, 95.2K incoming IP traffic, 176.1K outgoing IP traffic. worker1 # [ 112.231608] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 112.234721] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 112.236511] systemd[1]: nix-grpc-daemon.socket: Consumed 908us CPU time over 1min 27.344s wall clock time, 256K memory peak, 96.1K incoming IP traffic, 77.4K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 111.810418] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.816157] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.019019] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 112.031167] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.042117] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.057490] nix-daemon[936]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker2 # [ 112.074458] nix-grpc-daemon[1168]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5) worker2 # [ 112.097660] nix-grpc-daemon[1168]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 78 ms (attempt 2/5) worker2 # [ 112.183560] nix-grpc-daemon[1168]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 130 ms (attempt 3/5) worker2 # [ 112.227410] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.230423] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.318211] nix-grpc-daemon[1168]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 153 ms (attempt 4/5) worker2 # [ 112.434119] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.439511] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.480510] nix-grpc-daemon[1168]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 112.509505] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52946 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 112.525079] nix-daemon[936]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker2 # [ 112.562502] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:46Z level=info event=niks3_push_started pid=1224 worker2 # [ 112.644988] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.664831] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.798915] nix-grpc-daemon[1224]: time=2026-09-20T12:22:46.311Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 112.849430] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.852165] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.988668] nix-daemon[936]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) worker2 # [ 113.007153] nix-daemon[936]: reaped child process 1240, status = succeeded lb # [ 113.699782] niks3-server[1132]: 2026/09/20 12:22:46 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 113.710751] niks3-server[1132]: 2026/09/20 12:22:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 113.047219] nix-grpc-daemon[1224]: time=2026-09-20T12:22:46.558Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 113.049919] nix-grpc-daemon[1224]: time=2026-09-20T12:22:46.558Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 113.052712] nix-grpc-daemon[1224]: time=2026-09-20T12:22:46.558Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" worker2 # [ 113.055981] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.057845] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 113.769302] niks3-server[1132]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 113.786278] niks3-server[1132]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 113.796498] niks3-server[1132]: 2026/09/20 12:22:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 113.809234] niks3-server[1132]: 2026/09/20 12:22:46 INFO Signed narinfos id=25 count=1 worker2 # [ 113.135638] nix-grpc-daemon[1224]: time=2026-09-20T12:22:46.646Z level=INFO msg="Uploading 3 narinfos" lb # [ 113.818225] niks3-server[1132]: 2026/09/20 12:22:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 113.832286] niks3-server[1132]: 2026/09/20 12:22:46 INFO Signed narinfos id=26 count=2 lb # [ 113.834547] niks3-server[1132]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 113.865638] niks3-server[1132]: 2026/09/20 12:22:46 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 113.876652] niks3-server[1132]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 113.888949] niks3-server[1132]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 113.896975] niks3-server[1132]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 113.907196] niks3-server[1132]: 2026/09/20 12:22:46 INFO Completed upload id=25 lb # [ 113.912389] niks3-server[1132]: 2026/09/20 12:22:46 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 113.915961] niks3-server[1132]: 2026/09/20 12:22:46 INFO Completed upload id=26 worker2 # [ 113.239923] nix-grpc-daemon[1224]: time=2026-09-20T12:22:46.752Z level=INFO msg="Upload complete. (437ms)" lb # [ 113.922492] niks3-server[1132]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo worker2 # [ 113.252338] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52946 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 113.272761] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.276853] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.282292] nix-daemon[936]: reaped child process 1222, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.54 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds) worker1 # [ 114.005259] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 114.011087] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 113.468539] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.472920] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.211434] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:47Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 114.214284] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 114.218991] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 114.233260] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 113.670339] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.242827] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 114.245489] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:47Z level=info event=scheduler_take_over worker2 # [ 113.676207] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb # [ 114.353477] niks3-server[1132]: 2026/09/20 12:22:47 INFO lead: acquired remote=192.168.1.3:47914 worker1 # [ 114.275749] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.282028] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:47Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:46620 worker1 # [ 114.284168] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.12 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.00 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 113.877712] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.452156] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:47Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 114.454244] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:47Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:46620 worker1 # [ 114.457353] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 114.642765] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 115.234432] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:48Z level=info event=signal_exit lb # [ 115.543347] envoy[882]: conn peer=[2001:db8:1::4]:58926 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=86213 tx=4171 ms=71522 lb # [ 115.548873] envoy[882]: conn peer=[2001:db8:1::1]:40422 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=523 ms=36 worker1 # [ 115.444223] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:48Z level=info event=scheduler_yield worker2 # [ 114.883196] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:48Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 115.558265] envoy[882]: conn peer=192.168.1.3:51928 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=17785 tx=4835 ms=74394 worker1 # [ 115.451174] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:46620 worker1 # [ 115.456961] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:48Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 115.463209] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:48Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 115.570730] envoy[882]: conn peer=[2001:db8:1::1]:34340 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1007 tx=305 ms=1248 lb # [ 115.581093] niks3-server[1132]: 2026/09/20 12:22:48 INFO lead: released remote=192.168.1.3:47914 worker1 # [ 115.472918] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:46620 worker1 # [ 115.478008] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:48Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 115.083813] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.089537] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 115.664468] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 115.670285] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.290761] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.296635] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 115.871200] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 115.876986] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.498014] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.504167] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 116.078192] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 116.083971] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.705555] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.711220] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 116.286653] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 116.291170] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 116.449595] nix-grpc-daemon[1288]: ts=2026-09-20T12:22:49Z level=info event=scheduler_restarting worker2 # [ 115.912567] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.915057] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 116.117170] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.123763] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 116.325413] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.331813] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 116.532620] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.535916] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 117.284265] nix-grpc-daemon[1288]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 117.290258] nix-grpc-daemon[1288]: E0000 00:00:1789906970.314240 1331 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 117.297418] nix-grpc-daemon[1288]: E0000 00:00:1789906970.314518 1331 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 116.738401] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.744156] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 116.947129] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.951592] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 117.148676] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.154372] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 117.355456] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.361235] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 117.562731] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.568496] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 118.263423] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 118.268972] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 118.271354] systemd[1]: nix-grpc-daemon.service: Consumed 174ms CPU time over 4.248s wall clock time, 10.8M memory peak, 9.2K incoming IP traffic, 7.9K outgoing IP traffic. worker1 # [ 118.288634] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 118.290703] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 118.294529] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 4.302s wall clock time, 256K memory peak, 13.4K incoming IP traffic, 10.5K outgoing IP traffic. worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2 # [ 117.770060] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.777646] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.11 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2 # [ 117.980709] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.985345] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 118.186801] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.192430] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 118.393775] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.399355] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 118.600844] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.606558] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 118.807847] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.813463] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2 # [ 119.017056] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.021435] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.218703] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.224541] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.298366] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:52Z level=info event=scheduler_take_over lb # [ 119.974377] niks3-server[1132]: 2026/09/20 12:22:52 INFO lead: acquired remote=192.168.1.4:47248 worker2 # [ 119.425781] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.456174] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:52Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 119.461135] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:52Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:52954 worker2 # [ 119.466607] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker2 # [ 120.327947] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 120.336834] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 120.370409] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:53Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker2 # [ 120.378426] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:53Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 120.418412] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 120.436326] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52946 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker2 # [ 120.453336] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 120.469149] nix-daemon[936]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker2 # [ 120.680129] nix-daemon[936]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 120.703227] nix-daemon[936]: reaped child process 1267, status = succeeded worker2 # [ 120.889832] nix-daemon[936]: accepted connection from pid 1269, user nix-grpc-daemon (trusted) worker2 # [ 120.910196] nix-daemon[936]: reaped child process 1272, status = succeeded lb # [ 121.598224] niks3-server[1132]: 2026/09/20 12:22:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 120.934808] nix-grpc-daemon[1224]: time=2026-09-20T12:22:54.447Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 120.936739] nix-grpc-daemon[1224]: time=2026-09-20T12:22:54.447Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 121.633244] niks3-server[1132]: 2026/09/20 12:22:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 121.653125] niks3-server[1132]: 2026/09/20 12:22:54 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst lb # [ 121.667074] niks3-server[1132]: 2026/09/20 12:22:54 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 121.674663] niks3-server[1132]: 2026/09/20 12:22:54 INFO Signed narinfos id=27 count=1 worker2 # [ 121.000077] nix-grpc-daemon[1224]: time=2026-09-20T12:22:54.512Z level=INFO msg="Uploading 1 narinfos" lb # [ 121.684298] niks3-server[1132]: 2026/09/20 12:22:54 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 121.697294] niks3-server[1132]: 2026/09/20 12:22:54 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo lb # [ 121.706963] niks3-server[1132]: 2026/09/20 12:22:54 INFO Completed upload id=27 worker2 # [ 121.031864] nix-grpc-daemon[1224]: time=2026-09-20T12:22:54.544Z level=INFO msg="Upload complete. (545ms)" worker2 # [ 121.044123] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52946 duration_s=0 paths=1 nar_bytes_in=520 worker2 # [ 121.060834] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 121.074025] nix-daemon[936]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker2 # [ 121.080168] nix-daemon[936]: reaped child process 1262, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker2 # [ 121.096210] nix-daemon[936]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-on-standby worker2 # [ 122.343989] nix-daemon[936]: reaped child process 1276, status = succeeded worker2 # [ 122.544064] nix-daemon[936]: accepted connection from pid 1291, user nix-grpc-daemon (trusted) worker2 # [ 122.563758] nix-daemon[936]: reaped child process 1294, status = succeeded lb # [ 123.253812] niks3-server[1132]: 2026/09/20 12:22:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 122.593160] nix-grpc-daemon[1224]: time=2026-09-20T12:22:56.102Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 122.595180] nix-grpc-daemon[1224]: time=2026-09-20T12:22:56.102Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 123.290561] niks3-server[1132]: 2026/09/20 12:22:56 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 123.305649] niks3-server[1132]: 2026/09/20 12:22:56 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 123.324229] niks3-server[1132]: 2026/09/20 12:22:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign worker2 # [ 122.656137] nix-grpc-daemon[1224]: time=2026-09-20T12:22:56.168Z level=INFO msg="Uploading 1 narinfos" lb # [ 123.334236] niks3-server[1132]: 2026/09/20 12:22:56 INFO Signed narinfos id=28 count=1 lb # [ 123.339582] niks3-server[1132]: 2026/09/20 12:22:56 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 123.354925] niks3-server[1132]: 2026/09/20 12:22:56 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete worker2 # [ 122.686066] nix-grpc-daemon[1224]: time=2026-09-20T12:22:56.199Z level=INFO msg="Upload complete. (376ms)" lb # [ 123.363497] niks3-server[1132]: 2026/09/20 12:22:56 INFO Completed upload id=28 lb # [ 123.367939] niks3-server[1132]: 2026/09/20 12:22:56 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker2 # [ 122.707911] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52946 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker2 # [ 122.724434] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:56Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker2 # [ 122.731356] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:56Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 122.736168] nix-daemon[936]: reaped child process 1274, status = succeeded worker2 # [ 122.754831] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 122.772089] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 122.788597] nix-grpc-daemon[1224]: time=2026-09-20T12:22:56.301Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker2 # [ 122.801034] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 122.816222] nix-daemon[936]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker2 # [ 123.034484] nix-daemon[936]: accepted connection from pid 1300, user nix-grpc-daemon (trusted) worker2 # [ 123.054128] nix-daemon[936]: reaped child process 1303, status = succeeded worker2 # [ 123.235197] nix-daemon[936]: accepted connection from pid 1305, user nix-grpc-daemon (trusted) worker2 # [ 123.254247] nix-daemon[936]: reaped child process 1308, status = succeeded lb # [ 123.942462] niks3-server[1132]: 2026/09/20 12:22:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 123.273391] nix-grpc-daemon[1224]: time=2026-09-20T12:22:56.786Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 123.274940] nix-grpc-daemon[1224]: time=2026-09-20T12:22:56.786Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 123.963002] niks3-server[1132]: 2026/09/20 12:22:56 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst worker2 # [ 123.294424] nix-grpc-daemon[1224]: time=2026-09-20T12:22:56.807Z level=INFO msg="Uploading 1 narinfos" lb # [ 123.969483] niks3-server[1132]: 2026/09/20 12:22:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 123.975394] niks3-server[1132]: 2026/09/20 12:22:56 INFO Signed narinfos id=29 count=1 lb # [ 123.979228] niks3-server[1132]: 2026/09/20 12:22:56 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 123.984701] niks3-server[1132]: 2026/09/20 12:22:56 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 123.991629] niks3-server[1132]: 2026/09/20 12:22:56 INFO Completed upload id=29 worker2 # [ 123.316243] nix-grpc-daemon[1224]: time=2026-09-20T12:22:56.829Z level=INFO msg="Upload complete. (482ms)" lb # [ 123.994026] niks3-server[1132]: 2026/09/20 12:22:56 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker2 # [ 123.323748] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52946 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 123.327324] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 123.337609] nix-daemon[936]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker2 # [ 123.341616] nix-daemon[936]: reaped child process 1298, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker2 # [ 123.353739] nix-daemon[936]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-on-standby worker2 # [ 124.385488] nix-daemon[936]: reaped child process 1312, status = succeeded worker2 # [ 124.558108] nix-daemon[936]: accepted connection from pid 1327, user nix-grpc-daemon (trusted) worker2 # [ 124.580689] nix-daemon[936]: reaped child process 1330, status = succeeded lb # [ 125.269275] niks3-server[1132]: 2026/09/20 12:22:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 124.606367] nix-grpc-daemon[1224]: time=2026-09-20T12:22:58.118Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 124.608070] nix-grpc-daemon[1224]: time=2026-09-20T12:22:58.118Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 125.304485] niks3-server[1132]: 2026/09/20 12:22:58 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 125.317858] niks3-server[1132]: 2026/09/20 12:22:58 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 125.331084] niks3-server[1132]: 2026/09/20 12:22:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign worker2 # [ 124.660726] nix-grpc-daemon[1224]: time=2026-09-20T12:22:58.173Z level=INFO msg="Uploading 1 narinfos" lb # [ 125.341431] niks3-server[1132]: 2026/09/20 12:22:58 INFO Signed narinfos id=30 count=1 lb # [ 125.346828] niks3-server[1132]: 2026/09/20 12:22:58 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls worker2 # [ 124.682561] nix-grpc-daemon[1224]: time=2026-09-20T12:22:58.195Z level=INFO msg="Upload complete. (319ms)" lb # [ 125.358143] niks3-server[1132]: 2026/09/20 12:22:58 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 125.362167] niks3-server[1132]: 2026/09/20 12:22:58 INFO Completed upload id=30 lb # [ 125.364572] niks3-server[1132]: 2026/09/20 12:22:58 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker2 # [ 124.688705] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52946 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker2 # [ 124.704384] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:58Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker2 # [ 124.707367] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:58Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 124.710642] nix-daemon[936]: reaped child process 1310, status = succeeded worker2 # [ 124.750048] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 124.766590] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 124.782779] nix-grpc-daemon[1224]: time=2026-09-20T12:22:58.295Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker2 # [ 124.794318] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 124.809121] nix-daemon[936]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) lb # [ 125.542624] envoy[882]: conn peer=[2001:db8:1::3]:50054 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1028 tx=349 ms=2235 worker2 # [ 125.018309] nix-daemon[936]: accepted connection from pid 1336, user nix-grpc-daemon (trusted) worker2 # [ 125.040349] nix-daemon[936]: reaped child process 1339, status = succeeded worker2 # [ 125.223591] nix-daemon[936]: accepted connection from pid 1341, user nix-grpc-daemon (trusted) worker2 # [ 125.245521] nix-daemon[936]: reaped child process 1344, status = succeeded lb # [ 125.934286] niks3-server[1132]: 2026/09/20 12:22:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 125.268290] nix-grpc-daemon[1224]: time=2026-09-20T12:22:58.781Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 125.270441] nix-grpc-daemon[1224]: time=2026-09-20T12:22:58.783Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 125.965102] niks3-server[1132]: 2026/09/20 12:22:58 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst worker2 # [ 125.305049] nix-grpc-daemon[1224]: time=2026-09-20T12:22:58.817Z level=INFO msg="Uploading 1 narinfos" lb # [ 125.981499] niks3-server[1132]: 2026/09/20 12:22:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 125.991458] niks3-server[1132]: 2026/09/20 12:22:58 INFO Signed narinfos id=31 count=1 lb # [ 126.001069] niks3-server[1132]: 2026/09/20 12:22:58 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 126.011995] niks3-server[1132]: 2026/09/20 12:22:58 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 126.017123] niks3-server[1132]: 2026/09/20 12:22:58 INFO Completed upload id=31 lb # [ 126.020207] niks3-server[1132]: 2026/09/20 12:22:58 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker2 # [ 125.341781] nix-grpc-daemon[1224]: time=2026-09-20T12:22:58.854Z level=INFO msg="Upload complete. (516ms)" worker2 # [ 125.352542] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52946 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 125.361257] nix-grpc-daemon[1168]: ts=2026-09-20T12:22:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 125.373547] nix-daemon[936]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker2 # [ 125.379474] nix-daemon[936]: reaped child process 1334, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker2 # [ 125.397384] nix-daemon[936]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-on-standby worker2 # [ 126.238592] nix-daemon[936]: reaped child process 1348, status = succeeded worker2 # [ 126.437695] nix-daemon[936]: accepted connection from pid 1363, user nix-grpc-daemon (trusted) worker2 # [ 126.460145] nix-daemon[936]: reaped child process 1366, status = succeeded lb # [ 127.150089] niks3-server[1132]: 2026/09/20 12:23:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 126.487322] nix-grpc-daemon[1224]: time=2026-09-20T12:22:59.998Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 126.489636] nix-grpc-daemon[1224]: time=2026-09-20T12:22:59.998Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 127.190941] niks3-server[1132]: 2026/09/20 12:23:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker2 # [ 126.533332] nix-grpc-daemon[1224]: time=2026-09-20T12:23:00.045Z level=INFO msg="Uploading 1 narinfos" lb # [ 127.209532] niks3-server[1132]: 2026/09/20 12:23:00 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 127.221879] niks3-server[1132]: 2026/09/20 12:23:00 INFO Signed narinfos id=32 count=1 lb # [ 127.226656] niks3-server[1132]: 2026/09/20 12:23:00 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 127.234588] niks3-server[1132]: 2026/09/20 12:23:00 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 127.238174] niks3-server[1132]: 2026/09/20 12:23:00 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 127.242145] niks3-server[1132]: 2026/09/20 12:23:00 INFO Completed upload id=32 worker2 # [ 126.566480] nix-grpc-daemon[1224]: time=2026-09-20T12:23:00.079Z level=INFO msg="Upload complete. (357ms)" lb # [ 127.244573] niks3-server[1132]: 2026/09/20 12:23:00 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker2 # [ 126.581407] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52946 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker2 # [ 126.600720] nix-daemon[936]: reaped child process 1346, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 6.56 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.22 seconds) worker1 # [ 127.493124] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 127.501492] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 127.697812] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:00Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 127.702098] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:00Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 127.706504] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:00Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 127.715522] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:00Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 127.724632] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 127.744918] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 127.179736] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:00Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:52954 worker2 # [ 127.185087] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:00Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.80 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 128.553408] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 43251dcbccfb4595856f072501f22ce5 client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.10 seconds) client # [ 128.814955] nix[1253]: don't know how to build these paths: client # [ 128.816041] nix[1253]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker2 # [ 127.933351] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 127.949697] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:01Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker2 # [ 127.958067] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:01Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 127.998493] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 128.016477] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52946 client # [ 128.912190] nix[1253]: copying 1 paths to 'lb:50051'... worker2 # [ 128.033584] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52946 client # [ 128.916889] nix[1253]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker2 # [ 128.051924] nix-daemon[936]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker2 # [ 128.274277] nix-daemon[936]: accepted connection from pid 1379, user nix-grpc-daemon (trusted) worker2 # [ 128.296930] nix-daemon[936]: reaped child process 1382, status = succeeded worker2 # [ 128.479242] nix-daemon[936]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) worker2 # [ 128.501698] nix-daemon[936]: reaped child process 1387, status = succeeded lb # [ 129.191437] niks3-server[1132]: 2026/09/20 12:23:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 128.529325] nix-grpc-daemon[1224]: time=2026-09-20T12:23:02.041Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 128.530909] nix-grpc-daemon[1224]: time=2026-09-20T12:23:02.041Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 129.227267] niks3-server[1132]: 2026/09/20 12:23:02 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst lb # [ 129.245992] niks3-server[1132]: 2026/09/20 12:23:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign worker2 # [ 128.575604] nix-grpc-daemon[1224]: time=2026-09-20T12:23:02.088Z level=INFO msg="Uploading 1 narinfos" lb # [ 129.257701] niks3-server[1132]: 2026/09/20 12:23:02 INFO Signed narinfos id=33 count=1 lb # [ 129.263966] niks3-server[1132]: 2026/09/20 12:23:02 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 129.273456] niks3-server[1132]: 2026/09/20 12:23:02 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete worker2 # [ 128.604299] nix-grpc-daemon[1224]: time=2026-09-20T12:23:02.117Z level=INFO msg="Upload complete. (533ms)" lb # [ 129.282375] niks3-server[1132]: 2026/09/20 12:23:02 INFO Completed upload id=33 lb # [ 129.287274] niks3-server[1132]: 2026/09/20 12:23:02 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker2 # [ 128.616992] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52946 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 128.631183] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52946 worker2 # [ 128.637805] nix-daemon[936]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker2 # [ 128.643075] nix-daemon[936]: reaped child process 1377, status = succeeded client # [ 129.535244] nix[1253]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker2 # [ 128.658600] nix-daemon[936]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 131.266185] systemd-journald[265]: Received client request to rotate journal, rotating. worker1 # [ 131.287861] systemd-journald[265]: Vacuuming done, freed 0B of archived journals from /var/log/journal/efbc8ee5e71d4dc6b275e1e5f21ad766. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 130.765402] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds) client: must succeed: sleep 5.0 worker2 # [ 131.299564] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:04Z level=info event=draining lb # [ 135.545329] envoy[882]: conn peer=[2001:db8:1::1]:56006 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9662 tx=3839 ms=6269 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 136.313841] nix-daemon[936]: reaped child process 1391, status = succeeded worker2 # [ 136.492428] nix-daemon[936]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 136.511460] nix-daemon[936]: reaped child process 1434, status = succeeded lb # [ 137.199971] niks3-server[1132]: 2026/09/20 12:23:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 136.536474] nix-grpc-daemon[1224]: time=2026-09-20T12:23:10.047Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 136.538265] nix-grpc-daemon[1224]: time=2026-09-20T12:23:10.047Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 137.250538] niks3-server[1132]: 2026/09/20 12:23:10 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker2 # [ 136.588680] nix-grpc-daemon[1224]: time=2026-09-20T12:23:10.101Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.264440] niks3-server[1132]: 2026/09/20 12:23:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 137.274220] niks3-server[1132]: 2026/09/20 12:23:10 INFO Signed narinfos id=34 count=1 lb # [ 137.278751] niks3-server[1132]: 2026/09/20 12:23:10 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 137.287480] niks3-server[1132]: 2026/09/20 12:23:10 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 137.290702] niks3-server[1132]: 2026/09/20 12:23:10 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete worker2 # [ 136.616065] nix-grpc-daemon[1224]: time=2026-09-20T12:23:10.129Z level=INFO msg="Upload complete. (339ms)" lb # [ 137.294770] niks3-server[1132]: 2026/09/20 12:23:10 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo lb # [ 137.299123] niks3-server[1132]: 2026/09/20 12:23:10 INFO Completed upload id=34 worker2 # [ 136.633076] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52946 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker2 # [ 136.648104] nix-daemon[936]: reaped child process 1389, status = succeeded client # [ 137.553756] systemd[1]: rs.service: Deactivated successfully. client # [ 137.558145] systemd[1]: rs.service: Consumed 174ms CPU time over 9.004s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic. worker2 # [ 137.301824] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:10Z level=info event=signal_exit worker2 # [ 137.527195] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:11Z level=info event=scheduler_yield worker1 # [ 138.099940] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:11Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 137.533497] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:52954 worker2 # [ 137.538138] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:11Z level=info event=worker_gone addr=192.168.1.3:50051 lb # [ 138.207901] niks3-server[1132]: 2026/09/20 12:23:11 INFO lead: released remote=192.168.1.4:47248 worker2 # [ 137.543939] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:11Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 137.548475] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:52954 worker2 # [ 137.552904] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:11Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 138.299951] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 137.736401] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 138.305361] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 137.740598] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 137.937145] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 138.506127] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 137.942428] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 138.511379] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 138.143580] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 138.712327] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 138.149125] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 138.717557] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 138.350110] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 138.918436] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 138.355375] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 138.924583] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.24 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' worker2 # [ 138.533495] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:12Z level=info event=scheduler_restarting worker1 # [ 139.126686] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:12Z level=info event=scheduler_connected addr=lb:50051 client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 139.131267] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 138.577176] nix-grpc-daemon[1168]: ts=2026-09-20T12:23:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 138.593727] nix-daemon[936]: reaped child process 1217, status = succeeded lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1 # [ 139.327880] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 139.333212] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 139.534222] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 139.539778] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 139.740661] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 139.746568] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 139.947404] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 139.953409] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 139.399760] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 139.403055] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 139.409280] systemd[1]: nix-grpc-daemon.service: Consumed 2.132s CPU time over 30.311s wall clock time, 34.2M memory peak, 63.5K incoming IP traffic, 159.4K outgoing IP traffic. worker2 # [ 139.427268] systemd[1]: Starting scheduler-token.service... worker2 # [ 139.522522] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 139.528458] systemd[1]: Finished scheduler-token.service. worker2 # [ 139.530547] systemd[1]: scheduler-token.service: Consumed 43ms CPU time over 98ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 139.536134] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 140.157173] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 140.161825] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 139.709577] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:13Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 139.712278] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 139.716394] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:13Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 139.724076] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 139.733105] systemd[1]: Started Nix worker-protocol over gRPC. lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2 # [ 139.742230] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:13Z level=info event=scheduler_take_over lb # [ 140.418434] niks3-server[1132]: 2026/09/20 12:23:13 INFO lead: acquired remote=192.168.1.4:33222 worker2 # [ 139.752146] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 139.754041] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 140.357975] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 140.365107] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 139.955704] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 139.961293] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 140.565340] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 140.571682] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 140.162475] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 140.168147] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 140.772534] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 140.778011] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 140.369361] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 140.374782] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 140.979018] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 140.984790] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 140.576133] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 140.581663] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 141.187847] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 141.192303] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 140.784593] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 140.802608] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:14Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 140.807227] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:14Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:40458 worker2 # [ 140.812738] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 141.388694] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:14Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 140.824849] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:14Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:40458 worker2 # [ 140.833741] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.31 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 141.860697] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 368924fb7b45438981c543a91b0178e8 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds) worker2 # [ 141.236204] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40474 worker2 # [ 141.253409] nix-daemon[936]: accepted connection from pid 1444, user nix-grpc-daemon (trusted) client # [ 142.152859] nix[1289]: don't know how to build these paths: client # [ 142.154532] nix[1289]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker2 # [ 141.287822] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:14Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 141.295351] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:14Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 141.342442] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40474 worker2 # [ 141.361871] nix-grpc-daemon[1444]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 1/5) worker2 # [ 141.373090] nix-grpc-daemon[1444]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 151 ms (attempt 2/5) worker2 # [ 141.532416] nix-grpc-daemon[1444]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 259 ms (attempt 3/5) worker2 # [ 141.800860] nix-grpc-daemon[1444]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 545 ms (attempt 4/5) worker2 # [ 142.354689] nix-grpc-daemon[1444]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 142.373669] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40474 worker2 # [ 142.383003] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40474 client # [ 143.265226] nix[1289]: copying 1 paths to 'lb:50051'... client # [ 143.265593] nix[1289]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker2 # [ 142.398919] nix-daemon[936]: accepted connection from pid 1444, user nix-grpc-daemon (trusted) worker2 # [ 142.417633] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:15Z level=info event=niks3_push_started pid=1513 worker2 # [ 142.626304] nix-grpc-daemon[1513]: time=2026-09-20T12:23:16.138Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 142.818847] nix-daemon[936]: accepted connection from pid 1526, user nix-grpc-daemon (trusted) worker2 # [ 142.840780] nix-daemon[936]: reaped child process 1529, status = succeeded worker2 # [ 143.025988] nix-daemon[936]: accepted connection from pid 1531, user nix-grpc-daemon (trusted) worker2 # [ 143.045568] nix-daemon[936]: reaped child process 1534, status = succeeded lb # [ 143.733602] niks3-server[1132]: 2026/09/20 12:23:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 143.288075] nix-grpc-daemon[1513]: time=2026-09-20T12:23:16.797Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 143.294244] nix-grpc-daemon[1513]: time=2026-09-20T12:23:16.797Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 144.005807] niks3-server[1132]: 2026/09/20 12:23:16 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst worker2 # [ 143.343304] nix-grpc-daemon[1513]: time=2026-09-20T12:23:16.856Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.018583] niks3-server[1132]: 2026/09/20 12:23:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 144.024330] niks3-server[1132]: 2026/09/20 12:23:16 INFO Signed narinfos id=35 count=1 lb # [ 144.049457] niks3-server[1132]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 144.062411] niks3-server[1132]: 2026/09/20 12:23:17 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete worker2 # [ 143.397836] nix-grpc-daemon[1513]: time=2026-09-20T12:23:16.910Z level=INFO msg="Upload complete. (767ms)" lb # [ 144.076123] niks3-server[1132]: 2026/09/20 12:23:17 INFO Completed upload id=35 lb # [ 144.082929] niks3-server[1132]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo worker2 # [ 143.410769] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40474 duration_s=1 paths=1 nar_bytes_in=424 worker2 # [ 143.432763] nix-grpc-daemon[1444]: ts=2026-09-20T12:23:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40474 worker2 # [ 143.447597] nix-daemon[936]: accepted connection from pid 1444, user nix-grpc-daemon (trusted) worker2 # [ 143.451109] nix-daemon[936]: reaped child process 1511, status = succeeded worker2 # [ 143.464864] nix-daemon[936]: accepted connection from pid 1444, user nix-grpc-daemon (trusted) client # [ 144.345470] nix[1289]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb # [ 145.541674] envoy[882]: conn peer=[2001:db8:1::1]:56020 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2940 tx=1351 ms=8710 lb # [ 145.546891] envoy[882]: conn peer=[2001:db8:1::4]:51174 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=37013 tx=2156 ms=29255 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 145.072483] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1444 (nix-grpc-daemon) on client request. worker2 # [ 145.074188] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 145.759778] niks3-server[1132]: 2026/09/20 12:23:18 INFO lead: released remote=192.168.1.4:33222 worker2 # [ 145.102552] systemd[1]: Starting scheduler-token.service... client # [ 145.983744] nix[1289]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker1 # [ 145.670545] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:18Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" worker2 # [ 145.127415] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 145.129963] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 145.131233] systemd[1]: nix-grpc-daemon.service: Consumed 524ms CPU time over 5.588s wall clock time, 31.6M memory peak, 14.5K incoming IP traffic, 20.9K outgoing IP traffic. worker2 # [ 145.154028] nix-daemon[936]: reaped child process 1536, status = succeeded worker2 # [ 145.155511] nix-daemon[936]: reaped child process 1500, status = succeeded worker2 # [ 145.164646] nix-daemon[1538]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 145.170553] nix-daemon[936]: reaped child process 1538, status = failed with exit code 1 worker2 # [ 145.216653] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 145.217821] systemd[1]: Finished scheduler-token.service. worker2 # [ 145.218832] systemd[1]: scheduler-token.service: Consumed 26ms CPU time over 110ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 145.222578] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 145.224893] systemd[1]: Starting scheduler-token.service... worker2 # [ 145.298978] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 145.303703] systemd[1]: Finished scheduler-token.service. worker2 # [ 145.305108] systemd[1]: scheduler-token.service: Consumed 25ms CPU time over 78ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 145.308882] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 145.879733] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 145.486936] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:18Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 145.489572] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 145.493790] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 145.502226] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 145.511410] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 145.521192] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:19Z level=info event=scheduler_take_over worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.50 seconds) lb # [ 146.195534] niks3-server[1132]: 2026/09/20 12:23:19 INFO lead: acquired remote=192.168.1.4:33030 client: must succeed: sleep 5.0 worker1 # [ 146.086741] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 145.534909] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 145.541560] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:19Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 145.542949] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:19Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:40484 worker2 # [ 145.544932] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:19Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 145.615208] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:19Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 145.619671] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:19Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 145.677437] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40496 worker2 # [ 145.691897] nix-daemon[936]: accepted connection from pid 1580, user nix-grpc-daemon (trusted) worker2 # [ 145.713837] nix-daemon[936]: accepted connection from pid 1580, user nix-grpc-daemon (trusted) worker1 # [ 146.287925] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 145.722111] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:19Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:40484 worker2 # [ 145.725892] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:19Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 145.737186] nix-daemon[936]: accepted connection from pid 1580, user nix-grpc-daemon (trusted) client # [ 145.990384] nix[1289]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting client # [ 146.621246] nix[1289]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... client: (finished: must succeed: sleep 5.0, in 5.06 seconds) client: waiting for success: ! systemctl is-active mid worker2 # [ 150.958695] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:24Z level=info event=niks3_push_started pid=1659 worker2 # [ 150.978897] nix-daemon[936]: reaped child process 1635, status = succeeded worker2 # [ 151.160318] nix-grpc-daemon[1659]: time=2026-09-20T12:23:24.672Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 151.341387] nix-daemon[936]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 151.361600] nix-daemon[936]: reaped child process 1675, status = succeeded lb # [ 152.050726] niks3-server[1132]: 2026/09/20 12:23:25 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 151.389947] nix-grpc-daemon[1659]: time=2026-09-20T12:23:24.900Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 151.393039] nix-grpc-daemon[1659]: time=2026-09-20T12:23:24.900Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 152.102362] niks3-server[1132]: 2026/09/20 12:23:25 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 152.115415] niks3-server[1132]: 2026/09/20 12:23:25 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 152.128546] niks3-server[1132]: 2026/09/20 12:23:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 152.140160] niks3-server[1132]: 2026/09/20 12:23:25 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls lb # [ 152.150041] niks3-server[1132]: 2026/09/20 12:23:25 INFO Signed narinfos id=36 count=1 worker2 # [ 151.476126] nix-grpc-daemon[1659]: time=2026-09-20T12:23:24.988Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.163420] niks3-server[1132]: 2026/09/20 12:23:25 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 152.174168] niks3-server[1132]: 2026/09/20 12:23:25 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo lb # [ 152.183637] niks3-server[1132]: 2026/09/20 12:23:25 INFO Completed upload id=36 worker2 # [ 151.508597] nix-grpc-daemon[1659]: time=2026-09-20T12:23:25.021Z level=INFO msg="Upload complete. (344ms)" worker2 # [ 151.524697] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40496 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker2 # [ 151.544140] nix-daemon[936]: reaped child process 1633, status = succeeded client # [ 152.447537] systemd[1]: mid.service: Deactivated successfully. client # [ 152.452119] systemd[1]: mid.service: Consumed 180ms CPU time over 10.591s wall clock time, 37M memory peak, 9.7K incoming IP traffic, 10.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 11.20 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 153.026614] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 129ee46e58a948dea05c480a0169f5d5 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds) worker1 # [ 152.963814] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 152.978634] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) client # [ 153.310884] nix[1325]: don't know how to build these paths: client # [ 153.313558] nix[1325]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker2 # [ 152.445386] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:25Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker1 # [ 153.065938] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 153.085878] nix-grpc-daemon[1352]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 1/5) worker1 # [ 153.136691] nix-grpc-daemon[1352]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 2/5) worker1 # [ 153.205415] nix-grpc-daemon[1352]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 283 ms (attempt 3/5) worker1 # [ 153.488896] nix-grpc-daemon[1352]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 315 ms (attempt 4/5) worker2 # [ 152.451778] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:25Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 153.812513] nix-grpc-daemon[1352]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 153.834962] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41784 client # [ 154.164184] nix[1325]: copying 1 paths to 'lb:50051'... worker1 # [ 153.851932] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 client # [ 154.164554] nix[1325]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker1 # [ 153.869831] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 153.897061] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:26Z level=info event=niks3_push_started pid=1490 worker1 # [ 154.127258] nix-grpc-daemon[1490]: time=2026-09-20T12:23:27.157Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca="" worker1 # [ 154.311589] nix-daemon[919]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 154.329637] nix-daemon[919]: reaped child process 1510, status = succeeded worker1 # [ 154.510289] nix-daemon[919]: accepted connection from pid 1512, user nix-grpc-daemon (trusted) worker1 # [ 154.530571] nix-daemon[919]: reaped child process 1515, status = succeeded lb # [ 154.655034] niks3-server[1132]: 2026/09/20 12:23:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.560095] nix-grpc-daemon[1490]: time=2026-09-20T12:23:27.589Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 154.561632] nix-grpc-daemon[1490]: time=2026-09-20T12:23:27.589Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 154.703637] niks3-server[1132]: 2026/09/20 12:23:27 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst worker1 # [ 154.605942] nix-grpc-daemon[1490]: time=2026-09-20T12:23:27.636Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.713439] niks3-server[1132]: 2026/09/20 12:23:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 154.721738] niks3-server[1132]: 2026/09/20 12:23:27 INFO Signed narinfos id=37 count=1 lb # [ 154.730260] niks3-server[1132]: 2026/09/20 12:23:27 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 154.742744] niks3-server[1132]: 2026/09/20 12:23:27 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 154.748710] niks3-server[1132]: 2026/09/20 12:23:27 INFO Completed upload id=37 worker1 # [ 154.640903] nix-grpc-daemon[1490]: time=2026-09-20T12:23:27.671Z level=INFO msg="Upload complete. (508ms)" worker1 # [ 154.653224] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 154.667986] nix-grpc-daemon[1490]: time=2026-09-20T12:23:27.676Z level=WARN msg="Failed to register uploaded object" key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 154.678634] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 154.683540] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 154.686134] nix-daemon[919]: reaped child process 1488, status = succeeded client # [ 155.010485] nix[1325]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker1 # [ 154.701046] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) lb # [ 155.542958] envoy[882]: conn peer=[2001:db8:1::4]:57898 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4906 tx=426 ms=5354 lb # [ 155.548348] envoy[882]: conn peer=[2001:db8:1::1]:46686 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3841 tx=1661 ms=10303 client: must succeed: systemctl kill -s INT intr client # [ 156.800446] systemd[1]: intr.service: Sent signal SIGINT to main process 1325 (nix) on client request. worker1 # [ 156.496676] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:29Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv client # [ 156.810303] nix[1325]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 156.820917] nix[1325]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.09 seconds) worker1 # [ 156.536524] nix-daemon[919]: reaped child process 1517, status = succeeded worker1 # [ 156.541008] nix-daemon[1519]: unexpected Nix daemon error: error: interrupted by the user client # [ 156.855904] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 156.859003] systemd[1]: intr.service: Failed with result 'exit-code'. worker1 # [ 156.547812] nix-daemon[919]: reaped child process 1519, status = failed with exit code 1 client # [ 156.863975] systemd[1]: intr.service: Consumed 157ms CPU time over 3.835s wall clock time, 39.2M memory peak, 7.8K incoming IP traffic, 8.8K outgoing IP traffic. (finished: subtest: interrupting the client stops the build on the worker, in 4.00 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 157.058027] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: ffeb8f4a3a7845a2841fff1d8fa16baf client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.10 seconds) worker1 # [ 156.982696] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:41784 client # [ 157.304586] nix[1345]: don't know how to build these paths: client # [ 157.306176] nix[1345]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 156.437139] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:29Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker2 # [ 156.442698] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:29Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 156.481786] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40496 worker2 # [ 156.499099] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 1/5) worker2 # [ 156.582377] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 2/5) worker2 # [ 156.651174] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 374 ms (attempt 3/5) worker2 # [ 157.033141] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 493 ms (attempt 4/5) worker2 # [ 157.535596] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 157.558202] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40496 client # [ 158.456739] nix[1345]: copying 1 paths to 'lb:50051'... worker2 # [ 157.574447] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40496 client # [ 158.457043] nix[1345]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker2 # [ 157.590046] nix-daemon[936]: accepted connection from pid 1580, user nix-grpc-daemon (trusted) worker2 # [ 157.796332] nix-daemon[936]: accepted connection from pid 1714, user nix-grpc-daemon (trusted) worker2 # [ 157.817152] nix-daemon[936]: reaped child process 1717, status = succeeded worker2 # [ 157.996352] nix-daemon[936]: accepted connection from pid 1719, user nix-grpc-daemon (trusted) worker2 # [ 158.017771] nix-daemon[936]: reaped child process 1722, status = succeeded lb # [ 158.705166] niks3-server[1132]: 2026/09/20 12:23:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 158.041618] nix-grpc-daemon[1659]: time=2026-09-20T12:23:31.553Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 158.043189] nix-grpc-daemon[1659]: time=2026-09-20T12:23:31.553Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 158.734234] niks3-server[1132]: 2026/09/20 12:23:31 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst lb # [ 158.750981] niks3-server[1132]: 2026/09/20 12:23:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign worker2 # [ 158.082247] nix-grpc-daemon[1659]: time=2026-09-20T12:23:31.594Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.764947] niks3-server[1132]: 2026/09/20 12:23:31 INFO Signed narinfos id=38 count=1 lb # [ 158.776598] niks3-server[1132]: 2026/09/20 12:23:31 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls worker2 # [ 158.107130] nix-grpc-daemon[1659]: time=2026-09-20T12:23:31.620Z level=INFO msg="Upload complete. (500ms)" lb # [ 158.783957] niks3-server[1132]: 2026/09/20 12:23:31 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 158.789386] niks3-server[1132]: 2026/09/20 12:23:31 INFO Completed upload id=38 worker2 # [ 158.114033] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40496 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 158.792829] niks3-server[1132]: 2026/09/20 12:23:31 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker2 # [ 158.125080] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40496 worker2 # [ 158.136415] nix-daemon[936]: accepted connection from pid 1580, user nix-grpc-daemon (trusted) worker2 # [ 158.141720] nix-daemon[936]: reaped child process 1712, status = succeeded client # [ 159.032791] nix[1345]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker2 # [ 158.155599] nix-daemon[936]: accepted connection from pid 1580, user nix-grpc-daemon (trusted) worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2 worker2 # Checking switch inhibitors... done worker2 # [ 160.802177] nixos[1757]: switching to system configuration /nix/store/x3shrq1ffilhixgmbncqj99ry14cv69l-nixos-system-worker2-test worker2 # [ 160.805389] systemd[1]: Stopped target Remote File Systems. worker2 # activating the configuration... worker2 # [ 160.809499] systemd[1]: Stopped target Local File Systems. worker2 # setting up /etc... worker2 # [ 161.593079] systemd[1]: Reload requested from client PID 1757 ('.switch-to-conf') (unit backdoor.service)... worker2 # [ 161.596076] systemd[1]: Reloading... worker2 # [ 162.488393] systemd[1]: Reloading finished in 889 ms. worker2 # restarting sysinit-reactivation.target worker2 # [ 162.569501] systemd[1]: Starting Re-setup tmpfiles on a system that is already running.... worker2 # [ 162.722846] systemd[1]: Finished Re-setup tmpfiles on a system that is already running.. worker2 # [ 162.728413] systemd[1]: Reached target Reactivate sysinit units. worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service worker2 # [ 162.735313] systemd[1]: Reloading D-Bus System Message Bus... worker2 # [ 162.739373] dbus-broker-launch[574]: Caught SIGHUP, trigger reload. worker2 # [ 162.747396] systemd[1]: Reloading Nix worker-protocol over gRPC... worker2 # [ 162.768526] dbus-broker-launch[574]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 162.771623] dbus-broker-launch[574]: NSS returned no entry for 'systemd-timesync' worker2 # [ 162.778019] dbus-broker-launch[574]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 162.801406] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker2 # [ 162.825874] systemd[1]: Reloaded D-Bus System Message Bus. worker2 # [ 162.828582] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 162.836731] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 162.838050] systemd[1]: Reached target Local File Systems. worker2 # [ 162.838825] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 162.852136] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 162.853036] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 162.854211] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 162.865400] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 162.872229] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 162.875549] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 162.880305] systemd[1]: Reached target Remote File Systems. worker2 # [ 163.356130] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 163.362836] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 163.365746] systemd[1]: Starting linger-users.service... worker2 # [ 163.421836] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 163.422861] systemd[1]: Finished linger-users.service. worker2 # [ 163.518134] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:37Z level=info event=draining worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service worker2 # [ 163.684500] nixos[1757]: finished switching to system configuration /nix/store/x3shrq1ffilhixgmbncqj99ry14cv69l-nixos-system-worker2-test worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.71 seconds) worker2: must succeed: pgrep -f 'read -t [9]0 x' worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker1 # [ 164.569290] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 164.578102] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41784 worker2 # [ 164.032721] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:37Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker2 # [ 164.034902] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:37Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 164.648623] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 164.665077] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41784 client # copying 1 paths to 'lb:50051'... worker1 # [ 164.682531] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker1 # [ 164.707580] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 164.918900] nix-daemon[919]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 164.939675] nix-daemon[919]: reaped child process 1572, status = succeeded worker1 # [ 165.117333] nix-daemon[919]: accepted connection from pid 1574, user nix-grpc-daemon (trusted) worker1 # [ 165.135769] nix-daemon[919]: reaped child process 1577, status = succeeded lb # [ 165.258201] niks3-server[1132]: 2026/09/20 12:23:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.159577] nix-grpc-daemon[1490]: time=2026-09-20T12:23:38.189Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 165.161237] nix-grpc-daemon[1490]: time=2026-09-20T12:23:38.189Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 165.286195] niks3-server[1132]: 2026/09/20 12:23:38 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst worker1 # [ 165.193001] nix-grpc-daemon[1490]: time=2026-09-20T12:23:38.223Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.303927] niks3-server[1132]: 2026/09/20 12:23:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 165.313701] niks3-server[1132]: 2026/09/20 12:23:38 INFO Signed narinfos id=39 count=1 worker1 # [ 165.216384] nix-grpc-daemon[1490]: time=2026-09-20T12:23:38.246Z level=INFO msg="Upload complete. (490ms)" lb # [ 165.324502] niks3-server[1132]: 2026/09/20 12:23:38 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 165.329936] niks3-server[1132]: 2026/09/20 12:23:38 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 165.335071] niks3-server[1132]: 2026/09/20 12:23:38 INFO Completed upload id=39 lb # [ 165.337622] niks3-server[1132]: 2026/09/20 12:23:38 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo worker1 # [ 165.224125] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=0 paths=1 nar_bytes_in=528 worker1 # [ 165.237247] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 165.243389] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 165.248444] nix-daemon[919]: reaped child process 1567, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... worker1 # [ 165.260591] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 165.542268] envoy[882]: conn peer=[2001:db8:1::1]:40376 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2931 tx=755 ms=3572 client # farm-a> LOG-farm-a-during-drain worker1 # [ 166.109573] nix-daemon[919]: reaped child process 1581, status = succeeded worker1 # [ 166.285044] nix-daemon[919]: accepted connection from pid 1596, user nix-grpc-daemon (trusted) worker1 # [ 166.302741] nix-daemon[919]: reaped child process 1599, status = succeeded lb # [ 166.427535] niks3-server[1132]: 2026/09/20 12:23:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.332542] nix-grpc-daemon[1490]: time=2026-09-20T12:23:39.359Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 166.337106] nix-grpc-daemon[1490]: time=2026-09-20T12:23:39.359Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 166.466176] niks3-server[1132]: 2026/09/20 12:23:39 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 166.485027] niks3-server[1132]: 2026/09/20 12:23:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign worker1 # [ 166.389805] nix-grpc-daemon[1490]: time=2026-09-20T12:23:39.418Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.499590] niks3-server[1132]: 2026/09/20 12:23:39 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 166.513627] niks3-server[1132]: 2026/09/20 12:23:39 INFO Signed narinfos id=40 count=1 worker1 # [ 166.414435] nix-grpc-daemon[1490]: time=2026-09-20T12:23:39.444Z level=INFO msg="Upload complete. (341ms)" lb # [ 166.522182] niks3-server[1132]: 2026/09/20 12:23:39 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 166.529537] niks3-server[1132]: 2026/09/20 12:23:39 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 166.534320] niks3-server[1132]: 2026/09/20 12:23:39 INFO Completed upload id=40 lb # [ 166.536649] niks3-server[1132]: 2026/09/20 12:23:39 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker1 # [ 166.425224] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker1 # [ 166.444209] nix-daemon[919]: reaped child process 1579, status = succeeded worker2 # [ 165.900738] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:39Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker2 # [ 165.904179] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:39Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 166.518729] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 166.534685] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 166.561976] nix-grpc-daemon[1490]: time=2026-09-20T12:23:39.592Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 166.571912] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker1 # [ 166.597104] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 166.806430] nix-daemon[919]: accepted connection from pid 1603, user nix-grpc-daemon (trusted) worker1 # [ 166.827351] nix-daemon[919]: reaped child process 1606, status = succeeded worker1 # [ 167.004260] nix-daemon[919]: accepted connection from pid 1608, user nix-grpc-daemon (trusted) worker1 # [ 167.022654] nix-daemon[919]: reaped child process 1611, status = succeeded lb # [ 167.142741] niks3-server[1132]: 2026/09/20 12:23:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.044925] nix-grpc-daemon[1490]: time=2026-09-20T12:23:40.074Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 167.046459] nix-grpc-daemon[1490]: time=2026-09-20T12:23:40.074Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 167.171411] niks3-server[1132]: 2026/09/20 12:23:40 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst worker1 # [ 167.077714] nix-grpc-daemon[1490]: time=2026-09-20T12:23:40.107Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.188352] niks3-server[1132]: 2026/09/20 12:23:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 167.199259] niks3-server[1132]: 2026/09/20 12:23:40 INFO Signed narinfos id=41 count=1 lb # [ 167.203526] niks3-server[1132]: 2026/09/20 12:23:40 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls lb # [ 167.212384] niks3-server[1132]: 2026/09/20 12:23:40 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 167.217630] niks3-server[1132]: 2026/09/20 12:23:40 INFO Completed upload id=41 worker1 # [ 167.109762] nix-grpc-daemon[1490]: time=2026-09-20T12:23:40.140Z level=INFO msg="Upload complete. (494ms)" lb # [ 167.220455] niks3-server[1132]: 2026/09/20 12:23:40 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker1 # [ 167.116271] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 167.130059] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 167.138110] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 167.143095] nix-daemon[919]: reaped child process 1601, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker1 # [ 167.156634] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-during-drain worker1 # [ 167.989754] nix-daemon[919]: reaped child process 1615, status = succeeded worker1 # [ 168.164768] nix-daemon[919]: accepted connection from pid 1630, user nix-grpc-daemon (trusted) worker1 # [ 168.186720] nix-daemon[919]: reaped child process 1633, status = succeeded lb # [ 168.306552] niks3-server[1132]: 2026/09/20 12:23:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.210871] nix-grpc-daemon[1490]: time=2026-09-20T12:23:41.240Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 168.212553] nix-grpc-daemon[1490]: time=2026-09-20T12:23:41.240Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 168.344277] niks3-server[1132]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 168.356980] niks3-server[1132]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 168.368369] niks3-server[1132]: 2026/09/20 12:23:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker1 # [ 168.266366] nix-grpc-daemon[1490]: time=2026-09-20T12:23:41.296Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.377131] niks3-server[1132]: 2026/09/20 12:23:41 INFO Signed narinfos id=42 count=1 lb # [ 168.379739] niks3-server[1132]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 168.390967] niks3-server[1132]: 2026/09/20 12:23:41 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 168.398446] niks3-server[1132]: 2026/09/20 12:23:41 INFO Completed upload id=42 worker1 # [ 168.291073] nix-grpc-daemon[1490]: time=2026-09-20T12:23:41.321Z level=INFO msg="Upload complete. (324ms)" lb # [ 168.401840] niks3-server[1132]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker2 # [ 167.738437] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:41Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker2 # [ 167.741946] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:41Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 168.301137] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker1 # [ 168.320908] nix-daemon[919]: reaped child process 1613, status = succeeded worker1 # [ 168.353192] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 168.370095] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 168.386575] nix-grpc-daemon[1490]: time=2026-09-20T12:23:41.416Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 168.397899] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker1 # [ 168.421434] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 168.632627] nix-daemon[919]: accepted connection from pid 1637, user nix-grpc-daemon (trusted) worker1 # [ 168.653805] nix-daemon[919]: reaped child process 1640, status = succeeded worker1 # [ 168.830034] nix-daemon[919]: accepted connection from pid 1642, user nix-grpc-daemon (trusted) worker1 # [ 168.849093] nix-daemon[919]: reaped child process 1645, status = succeeded lb # [ 168.967457] niks3-server[1132]: 2026/09/20 12:23:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.869532] nix-grpc-daemon[1490]: time=2026-09-20T12:23:41.899Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 168.871053] nix-grpc-daemon[1490]: time=2026-09-20T12:23:41.899Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 168.997108] niks3-server[1132]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst lb # [ 169.009496] niks3-server[1132]: 2026/09/20 12:23:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign worker1 # [ 168.909638] nix-grpc-daemon[1490]: time=2026-09-20T12:23:41.939Z level=INFO msg="Uploading 1 narinfos" lb # [ 169.017340] niks3-server[1132]: 2026/09/20 12:23:41 INFO Signed narinfos id=43 count=1 lb # [ 169.025544] niks3-server[1132]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 169.035385] niks3-server[1132]: 2026/09/20 12:23:42 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 169.042628] niks3-server[1132]: 2026/09/20 12:23:42 INFO Completed upload id=43 worker1 # [ 168.935126] nix-grpc-daemon[1490]: time=2026-09-20T12:23:41.965Z level=INFO msg="Upload complete. (495ms)" lb # [ 169.045801] niks3-server[1132]: 2026/09/20 12:23:42 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker1 # [ 168.943201] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 168.957378] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 168.963941] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 168.969636] nix-daemon[919]: reaped child process 1635, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... worker1 # [ 168.981337] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker1 # [ 170.207873] nix-daemon[919]: reaped child process 1649, status = succeeded client # farm-top> LOG-farm-top-during-drain worker1 # [ 170.369940] nix-daemon[919]: accepted connection from pid 1664, user nix-grpc-daemon (trusted) worker1 # [ 170.388686] nix-daemon[919]: reaped child process 1667, status = succeeded lb # [ 170.510335] niks3-server[1132]: 2026/09/20 12:23:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 170.412421] nix-grpc-daemon[1490]: time=2026-09-20T12:23:43.441Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 170.413924] nix-grpc-daemon[1490]: time=2026-09-20T12:23:43.441Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 170.546128] niks3-server[1132]: 2026/09/20 12:23:43 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 170.560087] niks3-server[1132]: 2026/09/20 12:23:43 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 170.571263] niks3-server[1132]: 2026/09/20 12:23:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker1 # [ 170.469372] nix-grpc-daemon[1490]: time=2026-09-20T12:23:43.499Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.579832] niks3-server[1132]: 2026/09/20 12:23:43 INFO Signed narinfos id=44 count=1 lb # [ 170.585688] niks3-server[1132]: 2026/09/20 12:23:43 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 170.594734] niks3-server[1132]: 2026/09/20 12:23:43 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 170.601410] niks3-server[1132]: 2026/09/20 12:23:43 INFO Completed upload id=44 worker1 # [ 170.493977] nix-grpc-daemon[1490]: time=2026-09-20T12:23:43.524Z level=INFO msg="Upload complete. (300ms)" lb # [ 170.604204] niks3-server[1132]: 2026/09/20 12:23:43 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker1 # [ 170.505148] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker1 # [ 170.522661] nix-daemon[919]: reaped child process 1647, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.23 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.24 seconds) worker2: must succeed: pkill -f 'read -t [9]0 x' worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker2 # [ 170.408430] nix-daemon[936]: reaped child process 1726, status = succeeded worker2 # [ 170.583340] nix-daemon[936]: accepted connection from pid 1903, user nix-grpc-daemon (trusted) worker2 # [ 170.604140] nix-daemon[936]: reaped child process 1906, status = succeeded lb # [ 171.291120] niks3-server[1132]: 2026/09/20 12:23:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 170.626163] nix-grpc-daemon[1659]: time=2026-09-20T12:23:44.138Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 170.628558] nix-grpc-daemon[1659]: time=2026-09-20T12:23:44.140Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 171.336504] niks3-server[1132]: 2026/09/20 12:23:44 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst worker2 # [ 170.677399] nix-grpc-daemon[1659]: time=2026-09-20T12:23:44.188Z level=INFO msg="Uploading 1 narinfos" lb # [ 171.351579] niks3-server[1132]: 2026/09/20 12:23:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 171.362121] niks3-server[1132]: 2026/09/20 12:23:44 INFO Signed narinfos id=45 count=1 lb # [ 171.372477] niks3-server[1132]: 2026/09/20 12:23:44 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete worker2 # [ 170.704452] nix-grpc-daemon[1659]: time=2026-09-20T12:23:44.217Z level=INFO msg="Upload complete. (321ms)" lb # [ 171.387544] niks3-server[1132]: 2026/09/20 12:23:44 INFO Completed upload id=45 worker2 # [ 170.716788] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40496 duration_s=12 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 lb # [ 171.393744] niks3-server[1132]: 2026/09/20 12:23:44 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 171.404253] niks3-server[1132]: 2026/09/20 12:23:44 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 170.731080] nix-daemon[936]: reaped child process 1724, status = succeeded worker2 # [ 170.734763] nix-grpc-daemon[1659]: time=2026-09-20T12:23:44.247Z level=WARN msg="Failed to register uploaded object" key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo error="server returned 404: object is not pending upload\n" client # [ 171.641883] systemd[1]: sw.service: Deactivated successfully. client # [ 171.647218] systemd[1]: sw.service: Consumed 160ms CPU time over 14.584s wall clock time, 37M memory peak, 8.8K incoming IP traffic, 9K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active sw, in 1.13 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds) worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 171.520970] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:45Z level=info event=signal_exit worker2 # [ 171.562992] systemd[1]: Starting scheduler-token.service... worker2 # [ 171.650310] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 171.653702] systemd[1]: Finished scheduler-token.service. worker2 # [ 171.654999] systemd[1]: scheduler-token.service: Consumed 32ms CPU time over 90ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 171.745057] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:45Z level=info event=scheduler_yield lb # [ 172.429146] niks3-server[1132]: 2026/09/20 12:23:45 INFO lead: released remote=192.168.1.4:33030 worker1 # [ 172.323566] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:45Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 171.755682] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:40484 worker2 # [ 171.762743] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:45Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 171.767011] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:45Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 171.771099] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:40484 worker2 # [ 171.775657] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:45Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 172.529099] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 171.963740] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 172.534625] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 171.969214] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 172.834592] niks3-server[1132]: 2026/09/20 12:23:45 INFO lead: acquired remote=192.168.1.3:45590 worker1 # [ 172.731721] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:45Z level=info event=scheduler_take_over worker2 # [ 172.170083] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 172.736713] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 172.742575] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 172.175326] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 172.943320] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 172.376951] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 172.948859] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 172.381934] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 173.149757] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 172.582874] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 173.156088] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 172.588369] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 172.756396] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:46Z level=info event=scheduler_restarting worker2 # [ 172.782735] nix-daemon[936]: reaped child process 1631, status = succeeded worker2 # [ 172.786873] nix-grpc-daemon[1580]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 173.358797] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 173.363293] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 172.801560] nix-grpc-daemon[1580]: E0000 00:00:1789907026.299437 1623 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true worker2 # [ 172.817159] nix-grpc-daemon[1580]: E0000 00:00:1789907026.306736 1623 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker2 # [ 172.822967] nix-grpc-daemon[1580]: ts=2026-09-20T12:23:46Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 173.559503] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 173.578104] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:46Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:44360 worker1 # [ 173.583658] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:46Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 173.554538] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 173.559868] systemd[1]: nix-grpc-daemon.service: Consumed 865ms CPU time over 28.428s wall clock time, 32M memory peak, 26.3K incoming IP traffic, 36.5K outgoing IP traffic. worker2 # [ 173.583327] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 173.782987] nix-grpc-daemon[1923]: ts=2026-09-20T12:23:47Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 173.785607] nix-grpc-daemon[1923]: ts=2026-09-20T12:23:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 173.789830] nix-grpc-daemon[1923]: ts=2026-09-20T12:23:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 173.797999] nix-grpc-daemon[1923]: ts=2026-09-20T12:23:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 173.799800] systemd[1]: Started Nix worker-protocol over gRPC. worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.34 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 173.822638] nix-grpc-daemon[1923]: ts=2026-09-20T12:23:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 174.404782] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:47Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 174.405198] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:47Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:44360 worker1 # [ 174.405382] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb # [ 175.542549] envoy[882]: conn peer=[2001:db8:1::1]:32800 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9612 tx=3860 ms=5953 lb # [ 175.547564] envoy[882]: conn peer=[2001:db8:1::1]:40386 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2939 tx=1377 ms=14317 lb # [ 175.552504] envoy[882]: conn peer=[2001:db8:1::4]:54732 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4556 tx=516 ms=27268 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.16 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 19.02 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 175.395748] nix-grpc-daemon[1923]: ts=2026-09-20T12:23:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48206 worker2 # [ 175.411010] nix-daemon[936]: accepted connection from pid 1923, user nix-grpc-daemon (trusted) worker1 # [ 176.001076] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 176.046765] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:49Z level=debug event=want client=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker1 # [ 176.054089] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:49Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 176.060459] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:49Z level=debug event=want client=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker1 # [ 176.066760] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:49Z level=debug event=want client=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 176.092670] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 176.108352] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 176.122886] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 176.138699] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 176.343886] nix-daemon[919]: accepted connection from pid 1676, user nix-grpc-daemon (trusted) worker1 # [ 176.365979] nix-daemon[919]: reaped child process 1679, status = succeeded worker1 # [ 176.544964] nix-daemon[919]: accepted connection from pid 1681, user nix-grpc-daemon (trusted) worker1 # [ 176.563424] nix-daemon[919]: reaped child process 1684, status = succeeded lb # [ 176.683012] niks3-server[1132]: 2026/09/20 12:23:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 176.587088] nix-grpc-daemon[1490]: time=2026-09-20T12:23:49.616Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 176.588675] nix-grpc-daemon[1490]: time=2026-09-20T12:23:49.616Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 176.719062] niks3-server[1132]: 2026/09/20 12:23:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign worker1 # [ 176.622292] nix-grpc-daemon[1490]: time=2026-09-20T12:23:49.652Z level=INFO msg="Uploading 1 narinfos" lb # [ 176.736225] niks3-server[1132]: 2026/09/20 12:23:49 INFO Signed narinfos id=46 count=1 lb # [ 176.738976] niks3-server[1132]: 2026/09/20 12:23:49 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst worker1 # [ 176.647323] nix-grpc-daemon[1490]: time=2026-09-20T12:23:49.677Z level=INFO msg="Upload complete. (492ms)" lb # [ 176.755195] niks3-server[1132]: 2026/09/20 12:23:49 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 176.759581] niks3-server[1132]: 2026/09/20 12:23:49 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 176.763806] niks3-server[1132]: 2026/09/20 12:23:49 INFO Completed upload id=46 worker1 # [ 176.657086] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 176.765878] niks3-server[1132]: 2026/09/20 12:23:49 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 176.667541] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 176.675596] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 176.680829] nix-daemon[919]: reaped child process 1674, status = succeeded worker1 # [ 176.694391] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 177.931351] nix-daemon[919]: reaped child process 1688, status = succeeded worker1 # [ 178.101746] nix-daemon[919]: accepted connection from pid 1703, user nix-grpc-daemon (trusted) worker1 # [ 178.121879] nix-daemon[919]: reaped child process 1706, status = succeeded lb # [ 178.241365] niks3-server[1132]: 2026/09/20 12:23:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 178.144541] nix-grpc-daemon[1490]: time=2026-09-20T12:23:51.174Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 178.146382] nix-grpc-daemon[1490]: time=2026-09-20T12:23:51.174Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 178.283749] niks3-server[1132]: 2026/09/20 12:23:51 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 178.295980] niks3-server[1132]: 2026/09/20 12:23:51 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst worker1 # [ 178.200692] nix-grpc-daemon[1490]: time=2026-09-20T12:23:51.230Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.307784] niks3-server[1132]: 2026/09/20 12:23:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 178.313962] niks3-server[1132]: 2026/09/20 12:23:51 INFO Signed narinfos id=47 count=1 lb # [ 178.318660] niks3-server[1132]: 2026/09/20 12:23:51 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 178.326990] niks3-server[1132]: 2026/09/20 12:23:51 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 178.333592] niks3-server[1132]: 2026/09/20 12:23:51 INFO Completed upload id=47 worker1 # [ 178.226258] nix-grpc-daemon[1490]: time=2026-09-20T12:23:51.256Z level=INFO msg="Upload complete. (321ms)" lb # [ 178.336619] niks3-server[1132]: 2026/09/20 12:23:51 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker1 # [ 178.251225] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=1 outputs=1 worker1 # [ 178.266680] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:51Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 178.270810] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:51Z level=debug event=want client=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 178.274198] nix-daemon[919]: reaped child process 1686, status = succeeded worker1 # [ 178.297359] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 178.313818] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 178.329611] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 178.344131] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 178.546863] nix-daemon[919]: accepted connection from pid 1712, user nix-grpc-daemon (trusted) worker1 # [ 178.567705] nix-daemon[919]: reaped child process 1715, status = succeeded worker1 # [ 178.744339] nix-daemon[919]: accepted connection from pid 1717, user nix-grpc-daemon (trusted) worker1 # [ 178.763444] nix-daemon[919]: reaped child process 1720, status = succeeded lb # [ 178.881681] niks3-server[1132]: 2026/09/20 12:23:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 178.780116] nix-grpc-daemon[1490]: time=2026-09-20T12:23:51.810Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 178.781647] nix-grpc-daemon[1490]: time=2026-09-20T12:23:51.810Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 178.911152] niks3-server[1132]: 2026/09/20 12:23:51 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst worker1 # [ 178.816580] nix-grpc-daemon[1490]: time=2026-09-20T12:23:51.846Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.928983] niks3-server[1132]: 2026/09/20 12:23:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 178.938896] niks3-server[1132]: 2026/09/20 12:23:51 INFO Signed narinfos id=48 count=1 lb # [ 178.944120] niks3-server[1132]: 2026/09/20 12:23:51 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 178.953718] niks3-server[1132]: 2026/09/20 12:23:51 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete worker1 # [ 178.845796] nix-grpc-daemon[1490]: time=2026-09-20T12:23:51.876Z level=INFO msg="Upload complete. (485ms)" lb # [ 178.958590] niks3-server[1132]: 2026/09/20 12:23:51 INFO Completed upload id=48 worker1 # [ 178.852401] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 178.961868] niks3-server[1132]: 2026/09/20 12:23:51 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 178.863548] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 178.874834] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 178.883371] nix-daemon[919]: reaped child process 1710, status = succeeded worker1 # [ 178.889416] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 179.911421] nix-daemon[919]: reaped child process 1724, status = succeeded worker1 # [ 180.073772] nix-daemon[919]: accepted connection from pid 1739, user nix-grpc-daemon (trusted) worker1 # [ 180.094543] nix-daemon[919]: reaped child process 1742, status = succeeded lb # [ 180.215648] niks3-server[1132]: 2026/09/20 12:23:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 180.405026] nix-grpc-daemon[1490]: time=2026-09-20T12:23:53.432Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 180.418980] nix-grpc-daemon[1490]: time=2026-09-20T12:23:53.432Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 180.562961] niks3-server[1132]: 2026/09/20 12:23:53 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 180.581812] niks3-server[1132]: 2026/09/20 12:23:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 180.595334] niks3-server[1132]: 2026/09/20 12:23:53 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 180.602813] niks3-server[1132]: 2026/09/20 12:23:53 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls worker1 # [ 180.495650] nix-grpc-daemon[1490]: time=2026-09-20T12:23:53.525Z level=INFO msg="Uploading 1 narinfos" lb # [ 180.608279] niks3-server[1132]: 2026/09/20 12:23:53 INFO Signed narinfos id=49 count=1 lb # [ 180.619122] niks3-server[1132]: 2026/09/20 12:23:53 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 180.632658] niks3-server[1132]: 2026/09/20 12:23:53 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo lb # [ 180.646596] niks3-server[1132]: 2026/09/20 12:23:53 INFO Completed upload id=49 worker1 # [ 180.539320] nix-grpc-daemon[1490]: time=2026-09-20T12:23:53.569Z level=INFO msg="Upload complete. (641ms)" worker1 # [ 180.557328] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=2 outputs=1 worker1 # [ 180.579147] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:53Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 180.592352] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 180.599367] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:53Z level=debug event=want client=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 180.606039] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 180.617357] nix-daemon[919]: reaped child process 1722, status = succeeded worker1 # [ 180.624263] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 180.626943] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 180.819828] nix-daemon[919]: accepted connection from pid 1748, user nix-grpc-daemon (trusted) worker1 # [ 180.840386] nix-daemon[919]: reaped child process 1751, status = succeeded worker1 # [ 181.018588] nix-daemon[919]: accepted connection from pid 1753, user nix-grpc-daemon (trusted) worker1 # [ 181.038533] nix-daemon[919]: reaped child process 1756, status = succeeded lb # [ 181.157151] niks3-server[1132]: 2026/09/20 12:23:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 181.062072] nix-grpc-daemon[1490]: time=2026-09-20T12:23:54.092Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 181.063670] nix-grpc-daemon[1490]: time=2026-09-20T12:23:54.092Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 181.194443] niks3-server[1132]: 2026/09/20 12:23:54 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst lb # [ 181.207360] niks3-server[1132]: 2026/09/20 12:23:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign worker1 # [ 181.106959] nix-grpc-daemon[1490]: time=2026-09-20T12:23:54.137Z level=INFO msg="Uploading 1 narinfos" lb # [ 181.214454] niks3-server[1132]: 2026/09/20 12:23:54 INFO Signed narinfos id=50 count=1 lb # [ 181.221185] niks3-server[1132]: 2026/09/20 12:23:54 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 181.230732] niks3-server[1132]: 2026/09/20 12:23:54 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 181.241164] niks3-server[1132]: 2026/09/20 12:23:54 INFO Completed upload id=50 lb # [ 181.244616] niks3-server[1132]: 2026/09/20 12:23:54 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 181.133830] nix-grpc-daemon[1490]: time=2026-09-20T12:23:54.164Z level=INFO msg="Upload complete. (498ms)" worker1 # [ 181.144668] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 181.160705] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 181.168940] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 181.174814] nix-daemon[919]: reaped child process 1746, status = succeeded worker1 # [ 181.190660] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 182.037760] nix-daemon[919]: reaped child process 1760, status = succeeded worker1 # [ 182.226167] nix-daemon[919]: accepted connection from pid 1775, user nix-grpc-daemon (trusted) worker1 # [ 182.246000] nix-daemon[919]: reaped child process 1778, status = succeeded lb # [ 182.365637] niks3-server[1132]: 2026/09/20 12:23:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 182.274640] nix-grpc-daemon[1490]: time=2026-09-20T12:23:55.302Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 182.277053] nix-grpc-daemon[1490]: time=2026-09-20T12:23:55.303Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 182.405494] niks3-server[1132]: 2026/09/20 12:23:55 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 182.432170] niks3-server[1132]: 2026/09/20 12:23:55 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 182.444594] niks3-server[1132]: 2026/09/20 12:23:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker1 # [ 182.335998] nix-grpc-daemon[1490]: time=2026-09-20T12:23:55.365Z level=INFO msg="Uploading 1 narinfos" lb # [ 182.447555] niks3-server[1132]: 2026/09/20 12:23:55 INFO Signed narinfos id=51 count=1 lb # [ 182.456663] niks3-server[1132]: 2026/09/20 12:23:55 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 182.462388] niks3-server[1132]: 2026/09/20 12:23:55 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 182.467501] niks3-server[1132]: 2026/09/20 12:23:55 INFO Completed upload id=51 worker1 # [ 182.359713] nix-grpc-daemon[1490]: time=2026-09-20T12:23:55.390Z level=INFO msg="Upload complete. (355ms)" lb # [ 182.469588] niks3-server[1132]: 2026/09/20 12:23:55 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker1 # [ 182.379866] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=3 outputs=1 worker1 # [ 182.397786] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:55Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 182.408215] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 182.411752] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:55Z level=debug event=want client=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 182.417729] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 182.422467] nix-daemon[919]: reaped child process 1758, status = succeeded worker1 # [ 182.424654] nix-grpc-daemon[1490]: time=2026-09-20T12:23:55.452Z level=INFO msg="All 1 paths already cached" worker1 # [ 182.429345] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 182.440336] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 182.636145] nix-daemon[919]: accepted connection from pid 1784, user nix-grpc-daemon (trusted) worker1 # [ 182.657109] nix-daemon[919]: reaped child process 1787, status = succeeded worker1 # [ 182.837401] nix-daemon[919]: accepted connection from pid 1789, user nix-grpc-daemon (trusted) worker1 # [ 182.858330] nix-daemon[919]: reaped child process 1792, status = succeeded lb # [ 182.979387] niks3-server[1132]: 2026/09/20 12:23:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 182.885024] nix-grpc-daemon[1490]: time=2026-09-20T12:23:55.915Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 182.886574] nix-grpc-daemon[1490]: time=2026-09-20T12:23:55.915Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 183.016423] niks3-server[1132]: 2026/09/20 12:23:55 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst lb # [ 183.031663] niks3-server[1132]: 2026/09/20 12:23:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign worker1 # [ 182.932630] nix-grpc-daemon[1490]: time=2026-09-20T12:23:55.962Z level=INFO msg="Uploading 1 narinfos" lb # [ 183.043713] niks3-server[1132]: 2026/09/20 12:23:56 INFO Signed narinfos id=52 count=1 lb # [ 183.050940] niks3-server[1132]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 183.059732] niks3-server[1132]: 2026/09/20 12:23:56 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 183.069715] niks3-server[1132]: 2026/09/20 12:23:56 INFO Completed upload id=52 worker1 # [ 182.962113] nix-grpc-daemon[1490]: time=2026-09-20T12:23:55.992Z level=INFO msg="Upload complete. (508ms)" lb # [ 183.072420] niks3-server[1132]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 182.972862] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 182.985129] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 182.998364] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 183.003763] nix-daemon[919]: reaped child process 1782, status = succeeded worker1 # [ 183.013978] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 184.467471] nix-daemon[919]: reaped child process 1796, status = succeeded worker1 # [ 184.649049] nix-daemon[919]: accepted connection from pid 1811, user nix-grpc-daemon (trusted) worker1 # [ 184.670380] nix-daemon[919]: reaped child process 1814, status = succeeded lb # [ 184.793639] niks3-server[1132]: 2026/09/20 12:23:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 184.695302] nix-grpc-daemon[1490]: time=2026-09-20T12:23:57.725Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 184.700515] nix-grpc-daemon[1490]: time=2026-09-20T12:23:57.727Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 184.839523] niks3-server[1132]: 2026/09/20 12:23:57 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker1 # [ 184.744578] nix-grpc-daemon[1490]: time=2026-09-20T12:23:57.774Z level=INFO msg="Uploading 1 narinfos" lb # [ 184.853535] niks3-server[1132]: 2026/09/20 12:23:57 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst lb # [ 184.863112] niks3-server[1132]: 2026/09/20 12:23:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 184.873521] niks3-server[1132]: 2026/09/20 12:23:57 INFO Signed narinfos id=53 count=1 lb # [ 184.875812] niks3-server[1132]: 2026/09/20 12:23:57 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 184.879994] niks3-server[1132]: 2026/09/20 12:23:57 INFO Completed upload id=53 worker1 # [ 184.771744] nix-grpc-daemon[1490]: time=2026-09-20T12:23:57.802Z level=INFO msg="Upload complete. (343ms)" lb # [ 184.882571] niks3-server[1132]: 2026/09/20 12:23:57 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo lb # [ 184.886775] niks3-server[1132]: 2026/09/20 12:23:57 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls worker1 # [ 184.786997] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=4 outputs=1 worker1 # [ 184.808483] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:57Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 184.817288] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 184.821179] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:57Z level=debug event=want client=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 184.825076] nix-daemon[919]: reaped child process 1794, status = succeeded worker1 # [ 184.833095] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 184.846784] nix-grpc-daemon[1490]: time=2026-09-20T12:23:57.877Z level=INFO msg="All 1 paths already cached" worker1 # [ 184.855429] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 184.867897] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 185.063273] nix-daemon[919]: accepted connection from pid 1820, user nix-grpc-daemon (trusted) worker1 # [ 185.080989] nix-daemon[919]: reaped child process 1823, status = succeeded worker1 # [ 185.262171] nix-daemon[919]: accepted connection from pid 1825, user nix-grpc-daemon (trusted) worker1 # [ 185.280427] nix-daemon[919]: reaped child process 1828, status = succeeded lb # [ 185.398916] niks3-server[1132]: 2026/09/20 12:23:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 185.300816] nix-grpc-daemon[1490]: time=2026-09-20T12:23:58.330Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 185.302302] nix-grpc-daemon[1490]: time=2026-09-20T12:23:58.330Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 185.427709] niks3-server[1132]: 2026/09/20 12:23:58 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst worker1 # [ 185.335033] nix-grpc-daemon[1490]: time=2026-09-20T12:23:58.365Z level=INFO msg="Uploading 1 narinfos" lb # [ 185.446694] niks3-server[1132]: 2026/09/20 12:23:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 185.456924] niks3-server[1132]: 2026/09/20 12:23:58 INFO Signed narinfos id=54 count=1 lb # [ 185.462168] niks3-server[1132]: 2026/09/20 12:23:58 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 185.471192] niks3-server[1132]: 2026/09/20 12:23:58 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 185.475938] niks3-server[1132]: 2026/09/20 12:23:58 INFO Completed upload id=54 worker1 # [ 185.368135] nix-grpc-daemon[1490]: time=2026-09-20T12:23:58.398Z level=INFO msg="Upload complete. (486ms)" lb # [ 185.478616] niks3-server[1132]: 2026/09/20 12:23:58 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 185.376141] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 185.387512] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 185.393429] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 185.398526] nix-daemon[919]: reaped child process 1818, status = succeeded worker1 # [ 185.411774] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 186.445464] nix-daemon[919]: reaped child process 1832, status = succeeded worker1 # [ 186.626020] nix-daemon[919]: accepted connection from pid 1847, user nix-grpc-daemon (trusted) worker1 # [ 186.645100] nix-daemon[919]: reaped child process 1850, status = succeeded lb # [ 186.766848] niks3-server[1132]: 2026/09/20 12:23:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 186.669646] nix-grpc-daemon[1490]: time=2026-09-20T12:23:59.698Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 186.671272] nix-grpc-daemon[1490]: time=2026-09-20T12:23:59.698Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 186.810733] niks3-server[1132]: 2026/09/20 12:23:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker1 # [ 186.709689] nix-grpc-daemon[1490]: time=2026-09-20T12:23:59.739Z level=INFO msg="Uploading 1 narinfos" lb # [ 186.828882] niks3-server[1132]: 2026/09/20 12:23:59 INFO Signed narinfos id=55 count=1 lb # [ 186.836139] niks3-server[1132]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst worker1 # [ 186.745344] nix-grpc-daemon[1490]: time=2026-09-20T12:23:59.775Z level=INFO msg="Upload complete. (323ms)" lb # [ 186.846367] niks3-server[1132]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 186.859471] niks3-server[1132]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 186.863522] niks3-server[1132]: 2026/09/20 12:23:59 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 186.867848] niks3-server[1132]: 2026/09/20 12:23:59 INFO Completed upload id=55 worker1 # [ 186.759257] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=5 outputs=1 lb # [ 186.870998] niks3-server[1132]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker1 # [ 186.780428] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:59Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 186.784682] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 186.787816] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:59Z level=debug event=want client=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 186.792879] nix-daemon[919]: reaped child process 1830, status = succeeded worker1 # [ 186.796234] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 186.807443] nix-grpc-daemon[1490]: time=2026-09-20T12:23:59.837Z level=INFO msg="All 1 paths already cached" worker1 # [ 186.815070] nix-grpc-daemon[1352]: ts=2026-09-20T12:23:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 186.825438] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 187.020182] nix-daemon[919]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 187.038830] nix-daemon[919]: reaped child process 1859, status = succeeded worker1 # [ 187.218330] nix-daemon[919]: accepted connection from pid 1861, user nix-grpc-daemon (trusted) worker1 # [ 187.238412] nix-daemon[919]: reaped child process 1864, status = succeeded lb # [ 187.357960] niks3-server[1132]: 2026/09/20 12:24:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 187.259660] nix-grpc-daemon[1490]: time=2026-09-20T12:24:00.289Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 187.261385] nix-grpc-daemon[1490]: time=2026-09-20T12:24:00.289Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 187.384576] niks3-server[1132]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst lb # [ 187.398982] niks3-server[1132]: 2026/09/20 12:24:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign worker1 # [ 187.298854] nix-grpc-daemon[1490]: time=2026-09-20T12:24:00.329Z level=INFO msg="Uploading 1 narinfos" lb # [ 187.412400] niks3-server[1132]: 2026/09/20 12:24:00 INFO Signed narinfos id=56 count=1 lb # [ 187.415574] niks3-server[1132]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 187.426565] niks3-server[1132]: 2026/09/20 12:24:00 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 187.433456] niks3-server[1132]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo lb # [ 187.439440] niks3-server[1132]: 2026/09/20 12:24:00 INFO Completed upload id=56 worker1 # [ 187.332123] nix-grpc-daemon[1490]: time=2026-09-20T12:24:00.362Z level=INFO msg="Upload complete. (494ms)" worker1 # [ 187.341014] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 187.354402] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 187.361686] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 187.366702] nix-daemon[919]: reaped child process 1854, status = succeeded worker1 # [ 187.378183] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 188.804520] nix-daemon[919]: reaped child process 1868, status = succeeded worker1 # [ 188.971214] nix-daemon[919]: accepted connection from pid 1883, user nix-grpc-daemon (trusted) worker1 # [ 188.989009] nix-daemon[919]: reaped child process 1886, status = succeeded lb # [ 189.111580] niks3-server[1132]: 2026/09/20 12:24:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 189.016384] nix-grpc-daemon[1490]: time=2026-09-20T12:24:02.044Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 189.017901] nix-grpc-daemon[1490]: time=2026-09-20T12:24:02.044Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 189.146661] niks3-server[1132]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 189.161330] niks3-server[1132]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst worker1 # [ 189.067474] nix-grpc-daemon[1490]: time=2026-09-20T12:24:02.097Z level=INFO msg="Uploading 1 narinfos" lb # [ 189.176852] niks3-server[1132]: 2026/09/20 12:24:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 189.186668] niks3-server[1132]: 2026/09/20 12:24:02 INFO Signed narinfos id=57 count=1 lb # [ 189.194016] niks3-server[1132]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls worker1 # [ 189.090662] nix-grpc-daemon[1490]: time=2026-09-20T12:24:02.121Z level=INFO msg="Upload complete. (299ms)" lb # [ 189.198831] niks3-server[1132]: 2026/09/20 12:24:02 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 189.204799] niks3-server[1132]: 2026/09/20 12:24:02 INFO Completed upload id=57 lb # [ 189.208398] niks3-server[1132]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker1 # [ 189.103695] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=6 outputs=1 worker1 # [ 189.123088] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:02Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 189.129110] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 189.134298] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:02Z level=debug event=want client=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 189.139725] nix-daemon[919]: reaped child process 1866, status = succeeded worker1 # [ 189.141951] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 189.150072] nix-grpc-daemon[1490]: time=2026-09-20T12:24:02.180Z level=INFO msg="All 2 paths already cached" worker1 # [ 189.157608] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 189.171264] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 189.356196] nix-daemon[919]: accepted connection from pid 1892, user nix-grpc-daemon (trusted) worker1 # [ 189.376590] nix-daemon[919]: reaped child process 1895, status = succeeded worker1 # [ 189.551961] nix-daemon[919]: accepted connection from pid 1897, user nix-grpc-daemon (trusted) worker1 # [ 189.572905] nix-daemon[919]: reaped child process 1900, status = succeeded lb # [ 189.691582] niks3-server[1132]: 2026/09/20 12:24:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 189.593777] nix-grpc-daemon[1490]: time=2026-09-20T12:24:02.623Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 189.595337] nix-grpc-daemon[1490]: time=2026-09-20T12:24:02.623Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 189.722232] niks3-server[1132]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst worker1 # [ 189.627035] nix-grpc-daemon[1490]: time=2026-09-20T12:24:02.657Z level=INFO msg="Uploading 1 narinfos" lb # [ 189.739405] niks3-server[1132]: 2026/09/20 12:24:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 189.750664] niks3-server[1132]: 2026/09/20 12:24:02 INFO Signed narinfos id=58 count=1 lb # [ 189.754775] niks3-server[1132]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls worker1 # [ 189.656715] nix-grpc-daemon[1490]: time=2026-09-20T12:24:02.687Z level=INFO msg="Upload complete. (473ms)" lb # [ 189.764393] niks3-server[1132]: 2026/09/20 12:24:02 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 189.769623] niks3-server[1132]: 2026/09/20 12:24:02 INFO Completed upload id=58 worker1 # [ 189.664160] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 189.772840] niks3-server[1132]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 189.672861] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 189.683304] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 189.688481] nix-daemon[919]: reaped child process 1890, status = succeeded worker1 # [ 189.702149] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 190.749641] nix-daemon[919]: reaped child process 1904, status = succeeded worker1 # [ 190.928835] nix-daemon[919]: accepted connection from pid 1919, user nix-grpc-daemon (trusted) worker1 # [ 190.949597] nix-daemon[919]: reaped child process 1922, status = succeeded lb # [ 191.070927] niks3-server[1132]: 2026/09/20 12:24:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 190.973311] nix-grpc-daemon[1490]: time=2026-09-20T12:24:04.003Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 190.976679] nix-grpc-daemon[1490]: time=2026-09-20T12:24:04.005Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 191.107499] niks3-server[1132]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 191.123372] niks3-server[1132]: 2026/09/20 12:24:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign worker1 # [ 191.021970] nix-grpc-daemon[1490]: time=2026-09-20T12:24:04.052Z level=INFO msg="Uploading 1 narinfos" lb # [ 191.134987] niks3-server[1132]: 2026/09/20 12:24:04 INFO Signed narinfos id=59 count=1 lb # [ 191.142486] niks3-server[1132]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 191.153474] niks3-server[1132]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst lb # [ 191.160062] niks3-server[1132]: 2026/09/20 12:24:04 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 191.164783] niks3-server[1132]: 2026/09/20 12:24:04 INFO Completed upload id=59 worker1 # [ 191.057078] nix-grpc-daemon[1490]: time=2026-09-20T12:24:04.087Z level=INFO msg="Upload complete. (343ms)" lb # [ 191.167838] niks3-server[1132]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker1 # [ 191.073171] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=7 outputs=1 worker1 # [ 191.092944] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:04Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 191.097424] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 191.102491] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 191.107350] nix-daemon[919]: reaped child process 1902, status = succeeded worker1 # [ 191.110897] nix-grpc-daemon[1490]: time=2026-09-20T12:24:04.141Z level=INFO msg="All 2 paths already cached" worker1 # [ 191.118581] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 191.131152] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 191.327372] nix-daemon[919]: accepted connection from pid 1926, user nix-grpc-daemon (trusted) worker1 # [ 191.344811] nix-daemon[919]: reaped child process 1929, status = succeeded worker1 # [ 191.527238] nix-daemon[919]: accepted connection from pid 1931, user nix-grpc-daemon (trusted) worker1 # [ 191.545068] nix-daemon[919]: reaped child process 1934, status = succeeded lb # [ 191.664220] niks3-server[1132]: 2026/09/20 12:24:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 191.565147] nix-grpc-daemon[1490]: time=2026-09-20T12:24:04.595Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 191.566637] nix-grpc-daemon[1490]: time=2026-09-20T12:24:04.595Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 191.693973] niks3-server[1132]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst worker1 # [ 191.595400] nix-grpc-daemon[1490]: time=2026-09-20T12:24:04.625Z level=INFO msg="Uploading 1 narinfos" lb # [ 191.706884] niks3-server[1132]: 2026/09/20 12:24:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 191.718100] niks3-server[1132]: 2026/09/20 12:24:04 INFO Signed narinfos id=60 count=1 lb # [ 191.727313] niks3-server[1132]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls worker1 # [ 191.624889] nix-grpc-daemon[1490]: time=2026-09-20T12:24:04.655Z level=INFO msg="Upload complete. (480ms)" lb # [ 191.733002] niks3-server[1132]: 2026/09/20 12:24:04 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 191.739043] niks3-server[1132]: 2026/09/20 12:24:04 INFO Completed upload id=60 worker1 # [ 191.631208] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 191.742847] niks3-server[1132]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 191.640510] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 191.653629] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 191.656459] nix-daemon[919]: reaped child process 1924, status = succeeded worker1 # [ 191.669252] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 193.318592] nix-daemon[919]: reaped child process 1938, status = succeeded worker1 # [ 193.498200] nix-daemon[919]: accepted connection from pid 1953, user nix-grpc-daemon (trusted) worker1 # [ 193.517923] nix-daemon[919]: reaped child process 1956, status = succeeded lb # [ 193.637808] niks3-server[1132]: 2026/09/20 12:24:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 193.540406] nix-grpc-daemon[1490]: time=2026-09-20T12:24:06.570Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 193.546425] nix-grpc-daemon[1490]: time=2026-09-20T12:24:06.570Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 193.679419] niks3-server[1132]: 2026/09/20 12:24:06 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 193.692586] niks3-server[1132]: 2026/09/20 12:24:06 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv lb # [ 193.703006] niks3-server[1132]: 2026/09/20 12:24:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign worker1 # [ 193.600853] nix-grpc-daemon[1490]: time=2026-09-20T12:24:06.630Z level=INFO msg="Uploading 1 narinfos" lb # [ 193.711254] niks3-server[1132]: 2026/09/20 12:24:06 INFO Signed narinfos id=61 count=1 lb # [ 193.716726] niks3-server[1132]: 2026/09/20 12:24:06 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 193.725318] niks3-server[1132]: 2026/09/20 12:24:06 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 193.732238] niks3-server[1132]: 2026/09/20 12:24:06 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo lb # [ 193.737004] niks3-server[1132]: 2026/09/20 12:24:06 INFO Completed upload id=61 worker1 # [ 193.629648] nix-grpc-daemon[1490]: time=2026-09-20T12:24:06.660Z level=INFO msg="Upload complete. (348ms)" worker1 # [ 193.645191] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=8 outputs=1 worker1 # [ 193.659982] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:06Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 193.664853] nix-daemon[919]: reaped child process 1936, status = succeeded worker1 # [ 193.685264] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 193.700716] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 193.714705] nix-grpc-daemon[1490]: time=2026-09-20T12:24:06.745Z level=INFO msg="All 2 paths already cached" worker1 # [ 193.724085] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 193.738046] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 193.935470] nix-daemon[919]: accepted connection from pid 1960, user nix-grpc-daemon (trusted) worker1 # [ 193.953471] nix-daemon[919]: reaped child process 1963, status = succeeded worker1 # [ 194.132375] nix-daemon[919]: accepted connection from pid 1965, user nix-grpc-daemon (trusted) worker1 # [ 194.150087] nix-daemon[919]: reaped child process 1968, status = succeeded lb # [ 194.270844] niks3-server[1132]: 2026/09/20 12:24:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 194.175435] nix-grpc-daemon[1490]: time=2026-09-20T12:24:07.205Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 194.177108] nix-grpc-daemon[1490]: time=2026-09-20T12:24:07.205Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 194.301016] niks3-server[1132]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 194.214490] nix-grpc-daemon[1490]: time=2026-09-20T12:24:07.244Z level=INFO msg="Uploading 1 narinfos" lb # [ 194.316529] niks3-server[1132]: 2026/09/20 12:24:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 194.328093] niks3-server[1132]: 2026/09/20 12:24:07 INFO Signed narinfos id=62 count=1 lb # [ 194.335019] niks3-server[1132]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 194.341818] niks3-server[1132]: 2026/09/20 12:24:07 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 194.349988] niks3-server[1132]: 2026/09/20 12:24:07 INFO Completed upload id=62 worker1 # [ 194.239337] nix-grpc-daemon[1490]: time=2026-09-20T12:24:07.269Z level=INFO msg="Upload complete. (485ms)" lb # [ 194.352954] niks3-server[1132]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 194.248410] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 194.262533] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 worker1 # [ 194.268956] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 194.273882] nix-daemon[919]: reaped child process 1958, status = succeeded worker1 # [ 194.288174] nix-daemon[919]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 195.132676] nix-daemon[919]: reaped child process 1972, status = succeeded worker1 # [ 195.322403] nix-daemon[919]: accepted connection from pid 1987, user nix-grpc-daemon (trusted) worker1 # [ 195.341572] nix-daemon[919]: reaped child process 1990, status = succeeded lb # [ 195.461574] niks3-server[1132]: 2026/09/20 12:24:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 195.366997] nix-grpc-daemon[1490]: time=2026-09-20T12:24:08.394Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 195.368628] nix-grpc-daemon[1490]: time=2026-09-20T12:24:08.394Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 195.504207] niks3-server[1132]: 2026/09/20 12:24:08 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst lb # [ 195.514082] niks3-server[1132]: 2026/09/20 12:24:08 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker1 # [ 195.415228] nix-grpc-daemon[1490]: time=2026-09-20T12:24:08.445Z level=INFO msg="Uploading 1 narinfos" lb # [ 195.523109] niks3-server[1132]: 2026/09/20 12:24:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 195.529169] niks3-server[1132]: 2026/09/20 12:24:08 INFO Signed narinfos id=63 count=1 lb # [ 195.530927] niks3-server[1132]: 2026/09/20 12:24:08 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 195.539730] niks3-server[1132]: 2026/09/20 12:24:08 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete worker1 # [ 195.437207] nix-grpc-daemon[1490]: time=2026-09-20T12:24:08.467Z level=INFO msg="Upload complete. (335ms)" lb # [ 195.547566] niks3-server[1132]: 2026/09/20 12:24:08 INFO Completed upload id=63 lb # [ 195.550310] niks3-server[1132]: 2026/09/20 12:24:08 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 195.449023] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41784 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=9 outputs=1 worker1 # [ 195.465379] nix-daemon[919]: reaped child process 1970, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.83 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1 worker2 # [ 195.281823] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48206 worker2 # [ 195.288771] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48206 worker2 # [ 195.305119] nix-grpc-daemon[1923]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 34 ms (attempt 1/5) worker2 # [ 195.339368] nix-grpc-daemon[1923]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 2/5) worker2 # [ 195.395092] nix-grpc-daemon[1923]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 360 ms (attempt 3/5) worker2 # [ 195.755610] nix-grpc-daemon[1923]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 317 ms (attempt 4/5) worker2 # [ 196.081197] nix-grpc-daemon[1923]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 196.684850] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:09Z level=debug event=want client=2 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 lb # [ 205.547291] envoy[882]: conn peer=[2001:db8:1::1]:50474 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27170 tx=10809 ms=19506 client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 31.13 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 51.04 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1 # [ 227.773544] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:40Z level=info event=unhealthy reason=min_free worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.12 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 worker1 # [ 228.147519] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:41784 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 227.594246] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48206 worker1 # [ 228.194558] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:41Z level=debug event=want client=3 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker1 # [ 228.201032] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:41Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 227.674546] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48206 worker2 # [ 227.691173] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48206 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 227.707698] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48206 worker2 # [ 227.725795] nix-daemon[936]: accepted connection from pid 1923, user nix-grpc-daemon (trusted) worker2 # [ 227.755535] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:41Z level=info event=niks3_push_started pid=1979 worker2 # [ 227.976492] nix-grpc-daemon[1979]: time=2026-09-20T12:24:41.489Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 228.156292] nix-daemon[936]: accepted connection from pid 1992, user nix-grpc-daemon (trusted) worker2 # [ 228.174729] nix-daemon[936]: reaped child process 1995, status = succeeded worker2 # [ 228.348533] nix-daemon[936]: accepted connection from pid 1997, user nix-grpc-daemon (trusted) worker2 # [ 228.365546] nix-daemon[936]: reaped child process 2000, status = succeeded lb # [ 229.055931] niks3-server[1132]: 2026/09/20 12:24:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 228.392085] nix-grpc-daemon[1979]: time=2026-09-20T12:24:41.904Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 228.393625] nix-grpc-daemon[1979]: time=2026-09-20T12:24:41.905Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 229.100394] niks3-server[1132]: 2026/09/20 12:24:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker2 # [ 228.436317] nix-grpc-daemon[1979]: time=2026-09-20T12:24:41.948Z level=INFO msg="Uploading 1 narinfos" lb # [ 229.115743] niks3-server[1132]: 2026/09/20 12:24:42 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst lb # [ 229.126007] niks3-server[1132]: 2026/09/20 12:24:42 INFO Signed narinfos id=64 count=1 worker2 # [ 228.458106] nix-grpc-daemon[1979]: time=2026-09-20T12:24:41.971Z level=INFO msg="Upload complete. (477ms)" lb # [ 229.134700] niks3-server[1132]: 2026/09/20 12:24:42 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls worker2 # [ 228.464331] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48206 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 229.140323] niks3-server[1132]: 2026/09/20 12:24:42 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 229.145729] niks3-server[1132]: 2026/09/20 12:24:42 INFO Completed upload id=64 lb # [ 229.148289] niks3-server[1132]: 2026/09/20 12:24:42 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker2 # [ 228.479010] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48206 worker2 # [ 228.484663] nix-daemon[936]: accepted connection from pid 1923, user nix-grpc-daemon (trusted) worker2 # [ 228.489249] nix-daemon[936]: reaped child process 1977, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... worker2 # [ 228.499599] nix-daemon[936]: accepted connection from pid 1923, user nix-grpc-daemon (trusted) client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv client # farm-a> LOG-farm-a-drain worker2 # [ 229.730032] nix-daemon[936]: reaped child process 2004, status = succeeded worker2 # [ 229.892534] nix-daemon[936]: accepted connection from pid 2019, user nix-grpc-daemon (trusted) worker2 # [ 229.910846] nix-daemon[936]: reaped child process 2022, status = succeeded lb # [ 230.600826] niks3-server[1132]: 2026/09/20 12:24:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 229.936446] nix-grpc-daemon[1979]: time=2026-09-20T12:24:43.447Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 229.937974] nix-grpc-daemon[1979]: time=2026-09-20T12:24:43.447Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 230.645634] niks3-server[1132]: 2026/09/20 12:24:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker2 # [ 229.980168] nix-grpc-daemon[1979]: time=2026-09-20T12:24:43.492Z level=INFO msg="Uploading 1 narinfos" lb # [ 230.659969] niks3-server[1132]: 2026/09/20 12:24:43 INFO Signed narinfos id=65 count=1 lb # [ 230.669106] niks3-server[1132]: 2026/09/20 12:24:43 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 230.682894] niks3-server[1132]: 2026/09/20 12:24:43 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 230.687662] niks3-server[1132]: 2026/09/20 12:24:43 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 230.692550] niks3-server[1132]: 2026/09/20 12:24:43 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls worker2 # [ 230.011771] nix-grpc-daemon[1979]: time=2026-09-20T12:24:43.524Z level=INFO msg="Upload complete. (299ms)" lb # [ 230.695934] niks3-server[1132]: 2026/09/20 12:24:43 INFO Completed upload id=65 lb # [ 230.698619] niks3-server[1132]: 2026/09/20 12:24:43 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 230.021104] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48206 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=10 outputs=1 worker2 # [ 230.037369] nix-daemon[936]: reaped child process 2002, status = succeeded worker1 # [ 230.603719] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:43Z level=debug event=want client=3 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker1 # [ 230.609937] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:43Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 230.081526] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48206 worker2 # [ 230.097383] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48206 client # copying 1 paths to 'lb:50051'... worker2 # [ 230.111995] nix-grpc-daemon[1979]: time=2026-09-20T12:24:43.625Z level=INFO msg="All 1 paths already cached" client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 230.118599] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48206 worker2 # [ 230.132905] nix-daemon[936]: accepted connection from pid 1923, user nix-grpc-daemon (trusted) worker2 # [ 230.343345] nix-daemon[936]: accepted connection from pid 2026, user nix-grpc-daemon (trusted) worker2 # [ 230.363224] nix-daemon[936]: reaped child process 2029, status = succeeded worker2 # [ 230.535820] nix-daemon[936]: accepted connection from pid 2031, user nix-grpc-daemon (trusted) worker2 # [ 230.552440] nix-daemon[936]: reaped child process 2034, status = succeeded lb # [ 231.241805] niks3-server[1132]: 2026/09/20 12:24:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 230.575858] nix-grpc-daemon[1979]: time=2026-09-20T12:24:44.088Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 230.577513] nix-grpc-daemon[1979]: time=2026-09-20T12:24:44.088Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 231.269464] niks3-server[1132]: 2026/09/20 12:24:44 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst lb # [ 231.282653] niks3-server[1132]: 2026/09/20 12:24:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign worker2 # [ 230.615036] nix-grpc-daemon[1979]: time=2026-09-20T12:24:44.127Z level=INFO msg="Uploading 1 narinfos" lb # [ 231.291800] niks3-server[1132]: 2026/09/20 12:24:44 INFO Signed narinfos id=66 count=1 lb # [ 231.297910] niks3-server[1132]: 2026/09/20 12:24:44 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 231.305521] niks3-server[1132]: 2026/09/20 12:24:44 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete worker2 # [ 230.635225] nix-grpc-daemon[1979]: time=2026-09-20T12:24:44.148Z level=INFO msg="Upload complete. (485ms)" lb # [ 231.312923] niks3-server[1132]: 2026/09/20 12:24:44 INFO Completed upload id=66 worker2 # [ 230.641188] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48206 duration_s=0 paths=1 nar_bytes_in=632 lb # [ 231.316769] niks3-server[1132]: 2026/09/20 12:24:44 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo worker2 # [ 230.655447] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48206 worker2 # [ 230.661164] nix-daemon[936]: accepted connection from pid 1923, user nix-grpc-daemon (trusted) worker2 # [ 230.665822] nix-daemon[936]: reaped child process 2024, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... worker2 # [ 230.675503] nix-daemon[936]: accepted connection from pid 1923, user nix-grpc-daemon (trusted) client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv client # farm-b> LOG-farm-b-drain worker2 # [ 231.718559] nix-daemon[936]: reaped child process 2038, status = succeeded worker2 # [ 231.886231] nix-daemon[936]: accepted connection from pid 2053, user nix-grpc-daemon (trusted) worker2 # [ 231.905499] nix-daemon[936]: reaped child process 2056, status = succeeded lb # [ 232.593011] niks3-server[1132]: 2026/09/20 12:24:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 231.927733] nix-grpc-daemon[1979]: time=2026-09-20T12:24:45.439Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 231.929365] nix-grpc-daemon[1979]: time=2026-09-20T12:24:45.439Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 232.633943] niks3-server[1132]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst worker2 # [ 231.969582] nix-grpc-daemon[1979]: time=2026-09-20T12:24:45.482Z level=INFO msg="Uploading 1 narinfos" lb # [ 232.644618] niks3-server[1132]: 2026/09/20 12:24:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 232.655687] niks3-server[1132]: 2026/09/20 12:24:45 INFO Signed narinfos id=67 count=1 lb # [ 232.661586] niks3-server[1132]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 232.666830] niks3-server[1132]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 232.676391] niks3-server[1132]: 2026/09/20 12:24:45 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete worker2 # [ 232.005989] nix-grpc-daemon[1979]: time=2026-09-20T12:24:45.519Z level=INFO msg="Upload complete. (317ms)" lb # [ 232.682428] niks3-server[1132]: 2026/09/20 12:24:45 INFO Completed upload id=67 lb # [ 232.686548] niks3-server[1132]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 232.016982] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48206 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=11 outputs=1 worker1 # [ 232.593255] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:45Z level=debug event=want client=3 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker2 # [ 232.032896] nix-daemon[936]: reaped child process 2036, status = succeeded worker1 # [ 232.593672] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:45Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 232.069048] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48206 worker2 # [ 232.085852] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48206 client # copying 1 paths to 'lb:50051'... worker2 # [ 232.101560] nix-grpc-daemon[1979]: time=2026-09-20T12:24:45.613Z level=INFO msg="All 2 paths already cached" client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 232.107462] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48206 worker2 # [ 232.121476] nix-daemon[936]: accepted connection from pid 1923, user nix-grpc-daemon (trusted) worker2 # [ 232.327422] nix-daemon[936]: accepted connection from pid 2060, user nix-grpc-daemon (trusted) worker2 # [ 232.346347] nix-daemon[936]: reaped child process 2063, status = succeeded worker2 # [ 232.524109] nix-daemon[936]: accepted connection from pid 2065, user nix-grpc-daemon (trusted) worker2 # [ 232.541591] nix-daemon[936]: reaped child process 2068, status = succeeded lb # [ 233.230158] niks3-server[1132]: 2026/09/20 12:24:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 232.564102] nix-grpc-daemon[1979]: time=2026-09-20T12:24:46.076Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 232.565617] nix-grpc-daemon[1979]: time=2026-09-20T12:24:46.077Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 233.259237] niks3-server[1132]: 2026/09/20 12:24:46 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst worker2 # [ 232.599375] nix-grpc-daemon[1979]: time=2026-09-20T12:24:46.112Z level=INFO msg="Uploading 1 narinfos" lb # [ 233.274551] niks3-server[1132]: 2026/09/20 12:24:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 233.284846] niks3-server[1132]: 2026/09/20 12:24:46 INFO Signed narinfos id=68 count=1 worker2 # [ 232.621212] nix-grpc-daemon[1979]: time=2026-09-20T12:24:46.134Z level=INFO msg="Upload complete. (483ms)" lb # [ 233.297312] niks3-server[1132]: 2026/09/20 12:24:46 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls worker2 # [ 232.628119] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48206 duration_s=0 paths=1 nar_bytes_in=760 lb # [ 233.304756] niks3-server[1132]: 2026/09/20 12:24:46 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 233.310866] niks3-server[1132]: 2026/09/20 12:24:46 INFO Completed upload id=68 worker2 # [ 232.636872] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48206 lb # [ 233.313582] niks3-server[1132]: 2026/09/20 12:24:46 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo worker2 # [ 232.647344] nix-daemon[936]: accepted connection from pid 1923, user nix-grpc-daemon (trusted) worker2 # [ 232.649332] nix-daemon[936]: reaped child process 2058, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... worker2 # [ 232.662355] nix-daemon[936]: accepted connection from pid 1923, user nix-grpc-daemon (trusted) client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv client # farm-top> LOG-farm-top-drain worker2 # [ 233.684564] nix-daemon[936]: reaped child process 2072, status = succeeded worker2 # [ 233.850523] nix-daemon[936]: accepted connection from pid 2087, user nix-grpc-daemon (trusted) worker2 # [ 233.868853] nix-daemon[936]: reaped child process 2090, status = succeeded lb # [ 234.556814] niks3-server[1132]: 2026/09/20 12:24:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 233.892385] nix-grpc-daemon[1979]: time=2026-09-20T12:24:47.403Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 233.893880] nix-grpc-daemon[1979]: time=2026-09-20T12:24:47.403Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 234.589223] niks3-server[1132]: 2026/09/20 12:24:47 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 234.601678] niks3-server[1132]: 2026/09/20 12:24:47 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst worker2 # [ 233.940598] nix-grpc-daemon[1979]: time=2026-09-20T12:24:47.453Z level=INFO msg="Uploading 1 narinfos" lb # [ 234.615563] niks3-server[1132]: 2026/09/20 12:24:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 234.626032] niks3-server[1132]: 2026/09/20 12:24:47 INFO Signed narinfos id=69 count=1 lb # [ 234.632249] niks3-server[1132]: 2026/09/20 12:24:47 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls lb # [ 234.640979] niks3-server[1132]: 2026/09/20 12:24:47 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 234.646366] niks3-server[1132]: 2026/09/20 12:24:47 INFO Completed upload id=69 worker2 # [ 233.970416] nix-grpc-daemon[1979]: time=2026-09-20T12:24:47.483Z level=INFO msg="Upload complete. (299ms)" lb # [ 234.649418] niks3-server[1132]: 2026/09/20 12:24:47 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 233.981030] nix-grpc-daemon[1923]: ts=2026-09-20T12:24:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48206 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=12 outputs=1 worker2 # [ 233.997236] nix-daemon[936]: reaped child process 2070, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.71 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' lb # [ 235.547518] envoy[882]: conn peer=[2001:db8:1::1]:44846 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=914 tx=540 ms=30859 worker1 # [ 235.778543] nix-grpc-daemon[1352]: ts=2026-09-20T12:24:48Z level=info event=healthy reason=min_free lb # [ 235.554359] envoy[882]: conn peer=[2001:db8:1::1]:57038 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9510 tx=3859 ms=6418 worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 9.48 seconds) (finished: run the VM test script, in 240.05 seconds) test script finished in 240.35s cleanup kill QemuMachine (pid 47) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 48) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 53) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.25 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh