tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker2 # Disk image does not exist, creating the virtualisation disk image... client # Disk image does not exist, creating the virtualisation disk image... client: QEMU running (pid 50) worker1: QEMU running (pid 51) worker1 # Disk image does not exist, creating the virtualisation disk image... lb # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 49) client # Formatting '/build/vm-state-client/tmp.2X2qSWdrsn', fmt=raw size=1073741824 worker2 # Formatting '/build/vm-state-worker2/tmp.LvhZC8jwtE', fmt=raw size=1073741824 worker2: QEMU running (pid 52) client # mke2fs 1.47.4 (6-Mar-2025) worker2 # mke2fs 1.47.4 (6-Mar-2025) lb # Formatting '/build/vm-state-lb/tmp.eyFhjpWBVa', fmt=raw size=1073741824 worker1 # Formatting '/build/vm-state-worker1/tmp.Zq6wS3yVKC', fmt=raw size=1073741824 (finished: start all VMs, in 0.49 seconds) client # Discarding device blocks: 0/262144 done worker2 # Discarding device blocks: 0/262144 done lb # mke2fs 1.47.4 (6-Mar-2025) worker1 # mke2fs 1.47.4 (6-Mar-2025) client: waiting for unit network-addresses-eth1.service client # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Discarding device blocks: 0/262144 done client: waiting for the VM to finish booting client # Filesystem UUID: 3d9162f0-02a6-4fd9-a510-3cdf3892677d worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Discarding device blocks: 0/262144 done worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes client # Superblock backups stored on blocks: worker1 # Filesystem UUID: f7c5d3cd-a4c0-4abb-872c-160b098e5d04 lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Filesystem UUID: e47d3285-a155-4fd1-a63a-734ecaee58fd client # 32768, 98304, 163840, 229376 worker1 # Superblock backups stored on blocks: lb # Filesystem UUID: ff69be9e-844c-4a61-a44f-dbd929a9fa08 worker2 # Superblock backups stored on blocks: client # worker1 # 32768, 98304, 163840, 229376 lb # Superblock backups stored on blocks: worker2 # 32768, 98304, 163840, 229376 client # Allocating group tables: 0/8 done worker1 # lb # 32768, 98304, 163840, 229376 worker2 # client # Writing inode tables: 0/8 done worker1 # Allocating group tables: 0/8 done lb # worker2 # Allocating group tables: 0/8 done client # Creating journal (8192 blocks): done worker1 # Writing inode tables: 0/8 done lb # Allocating group tables: 0/8 done worker2 # Writing inode tables: 0/8 done client # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Creating journal (8192 blocks): done lb # Writing inode tables: 0/8 done worker2 # Creating journal (8192 blocks): done client # worker1 # Writing superblocks and filesystem accounting information: 0/8 done lb # Creating journal (8192 blocks): done worker2 # Writing superblocks and filesystem accounting information: 0/8 done client # Virtualisation disk image created. worker1 # lb # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Virtualisation disk image created. lb # worker2 # lb # Virtualisation disk image created. worker2 # Virtualisation disk image created. client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] KASLR enabled client # [ 0.000000] random: crng init done client # [ 0.000000] Machine model: linux,dummy-virt client # [ 0.000000] efi: UEFI not found. client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] Zone ranges: client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] DMA32 empty client # [ 0.000000] Normal empty client # [ 0.000000] Device empty client # [ 0.000000] Movable zone start for each node client # [ 0.000000] Early memory node ranges client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 client # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test/init regInfo=/nix/store/qv89ps7hlc2xvxz8pzqw4jziggm25i3g-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qv89ps7hlc2xvxz8pzqw4jziggm25i3g-closure-info/registration", will be passed to user space. client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 client # [ 0.000000] Policy zone: DMA client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] KASLR enabled worker2 # [ 0.000000] random: crng init done client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] KASLR enabled client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] random: crng init done worker2 # [ 0.000000] Zone ranges: worker1 # [ 0.000000] Machine model: linux,dummy-virt client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] DMA32 empty client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.000000] Normal empty worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] Device empty client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] KASLR enabled worker2 # [ 0.000000] Early memory node ranges lb # [ 0.000000] random: crng init done worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] Zone ranges: client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] DMA32 empty lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000036] arm-pv: using stolen time PV worker1 # [ 0.000000] Normal empty worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] Device empty lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] Movable zone start for each node client # [ 0.000665] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.000000] Early memory node ranges lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000825] Console: colour dummy device 80x25 lb # [ 0.000000] Zone ranges: worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000832] printk: legacy console [tty0] enabled lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] DMA32 empty worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] Normal empty client # [ 0.001026] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.000000] Device empty worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.001033] pid_max: default: 32768 minimum: 301 lb # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] Early memory node ranges worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.001105] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.001275] landlock: Up and running. worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.001277] Yama: becoming mindful. worker1 # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.001934] LSM support for eBPF active worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.002090] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.002127] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.003277] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 lb # [ 0.000000] psci: Trusted OS migration not required client # [ 0.004069] rcu: Hierarchical SRCU implementation. worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.004073] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.000000] alternatives: applying boot alternatives client # [ 0.005299] fsl-mc MSI: its@8080000 domain created lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.005389] EFI services will not be available. worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 client # [ 0.005500] smp: Bringing up secondary CPUs ... worker1 # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.005509] smp: Brought up 1 node, 1 CPU worker1 # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.005512] SMP: Total of 1 processors activated. worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.005518] CPU: All CPU(s) started at EL1 lb # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.005529] CPU features: detected: Branch Target Identification worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/wykyb0qy7gxax0kbx52lhrandvn5hhwl-nixos-system-worker2-test/init regInfo=/nix/store/vijscrzsxl5jgm579rc9xqvnsymkza5v-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] alternatives: applying boot alternatives client # [ 0.005534] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.005537] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/vijscrzsxl5jgm579rc9xqvnsymkza5v-closure-info/registration", will be passed to user space. lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.005540] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] alternatives: applying boot alternatives client # [ 0.005544] CPU features: detected: Common not Private translations worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/85sl11dh0zky10jc8x3p4y9xadvl89kj-nixos-system-worker1-test/init regInfo=/nix/store/sf77vbcbghgk9hk2xbbk4q5n9r9ql4qy-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.005547] CPU features: detected: CRC32 instructions worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.005550] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/sf77vbcbghgk9hk2xbbk4q5n9r9ql4qy-closure-info/registration", will be passed to user space. client # [ 0.005553] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/sy3pchz5vg22ylc3whvkp4s8qngi8wmd-nixos-system-lb-test/init regInfo=/nix/store/4q693lxjjy3z9gghvdrv4s7qcr63j8a1-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.005556] CPU features: detected: Data independent timing control (DIT) client # [ 0.005560] CPU features: detected: E0PD worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.005562] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/4q693lxjjy3z9gghvdrv4s7qcr63j8a1-closure-info/registration", will be passed to user space. client # [ 0.005565] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.005568] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.000000] software IO TLB: area num 1. client # [ 0.005571] CPU features: detected: Fine Grained Traps worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.005575] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.005580] CPU features: detected: RCpc load-acquire (LDAPR) worker1 # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.005583] CPU features: detected: LSE atomic instructions worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] Policy zone: DMA client # [ 0.005586] CPU features: detected: Privileged Access Never worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.005589] CPU features: detected: PMUv3 worker2 # [ 0.000000] rcu: RCU event tracing is enabled. lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.005591] CPU features: detected: RAS Extension Support worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.005594] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.005597] CPU features: detected: Random Number Generator worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 client # [ 0.005599] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.005602] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.005605] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.005610] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.005653] alternatives: applying system-wide alternatives lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.008665] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.008845] Memory: 1406508K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.009284] devtmpfs: initialized worker2 # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.011192] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.011245] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.011422] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.011427] 0 pages in range for non-PLT usage worker1 # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.011428] 508288 pages in range for PLT usage worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.011536] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.012337] DMI not present or invalid. worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) client # [ 0.016027] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.018362] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.018558] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.018762] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.018792] audit: initializing netlink subsys (disabled) worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) client # [ 0.019376] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.019378] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.019382] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.019388] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker2 # [ 0.000029] arm-pv: using stolen time PV client # [ 0.019391] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.019433] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.000395] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.019441] cpuidle: using governor ladder worker2 # [ 0.000558] Console: colour dummy device 80x25 lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.019448] cpuidle: using governor menu worker2 # [ 0.000565] printk: legacy console [tty0] enabled worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.019645] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.019663] ASID allocator initialised with 65536 entries worker2 # [ 0.000754] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.000029] arm-pv: using stolen time PV lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.020918] Serial: AMBA PL011 UART driver worker2 # [ 0.000760] pid_max: default: 32768 minimum: 301 lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.000837] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.000384] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.026320] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.000964] landlock: Up and running. worker1 # [ 0.000536] Console: colour dummy device 80x25 client # [ 0.026462] printk: console [ttyAMA0] enabled worker2 # [ 0.000967] Yama: becoming mindful. lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000546] printk: legacy console [tty0] enabled worker2 # [ 0.001394] LSM support for eBPF active lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker2 # [ 0.001538] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000029] arm-pv: using stolen time PV worker1 # [ 0.000746] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.000753] pid_max: default: 32768 minimum: 301 worker2 # [ 0.001571] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000400] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.000832] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.002703] cacheinfo: Unable to detect cache hierarchy for CPU 0 lb # [ 0.000562] Console: colour dummy device 80x25 worker1 # [ 0.000961] landlock: Up and running. worker2 # [ 0.003419] rcu: Hierarchical SRCU implementation. worker1 # [ 0.000964] Yama: becoming mindful. lb # [ 0.000570] printk: legacy console [tty0] enabled worker2 # [ 0.003423] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.001393] LSM support for eBPF active worker2 # [ 0.004645] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.001537] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000777] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.004734] EFI services will not be available. lb # [ 0.000784] pid_max: default: 32768 minimum: 301 worker2 # [ 0.004797] smp: Bringing up secondary CPUs ... worker1 # [ 0.001574] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.004805] smp: Brought up 1 node, 1 CPU lb # [ 0.000859] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.002681] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.004808] SMP: Total of 1 processors activated. lb # [ 0.000992] landlock: Up and running. lb # [ 0.000994] Yama: becoming mindful. worker1 # [ 0.003423] rcu: Hierarchical SRCU implementation. worker2 # [ 0.004814] CPU: All CPU(s) started at EL1 client # [ 0.145327] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.001451] LSM support for eBPF active worker1 # [ 0.003427] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.004825] CPU features: detected: Branch Target Identification client # [ 0.145347] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.004641] fsl-mc MSI: its@8080000 domain created lb # [ 0.001592] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.004830] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.004731] EFI services will not be available. client # [ 0.145353] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.001625] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.004842] smp: Bringing up secondary CPUs ... client # [ 0.145357] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.004833] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.004850] smp: Brought up 1 node, 1 CPU lb # [ 0.002765] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.004852] SMP: Total of 1 processors activated. client # [ 0.145362] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.003464] rcu: Hierarchical SRCU implementation. worker2 # [ 0.004837] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.004858] CPU: All CPU(s) started at EL1 client # [ 0.145366] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.003467] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.004840] CPU features: detected: Common not Private translations worker1 # [ 0.004869] CPU features: detected: Branch Target Identification lb # [ 0.004631] fsl-mc MSI: its@8080000 domain created client # [ 0.145370] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.004843] CPU features: detected: CRC32 instructions lb # [ 0.004727] EFI services will not be available. worker1 # [ 0.004874] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.145374] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.004846] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.004809] smp: Bringing up secondary CPUs ... lb # [ 0.004817] smp: Brought up 1 node, 1 CPU worker1 # [ 0.004877] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.004850] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.004820] SMP: Total of 1 processors activated. lb # [ 0.004825] CPU: All CPU(s) started at EL1 worker2 # [ 0.004853] CPU features: detected: Data independent timing control (DIT) worker1 # [ 0.004881] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker2 # [ 0.004856] CPU features: detected: E0PD client # [ 0.152523] fbcon: Taking over console lb # [ 0.004836] CPU features: detected: Branch Target Identification worker1 # [ 0.004884] CPU features: detected: Common not Private translations client # [ 0.152540] ACPI: Interpreter disabled. worker2 # [ 0.004859] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.004887] CPU features: detected: CRC32 instructions lb # [ 0.004841] CPU features: detected: ARMv8.4 Translation Table Level worker2 # [ 0.004862] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.004890] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.004844] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.004865] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.004894] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.004868] CPU features: detected: Fine Grained Traps lb # [ 0.004848] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.004897] CPU features: detected: Data independent timing control (DIT) lb # [ 0.004852] CPU features: detected: Common not Private translations worker1 # [ 0.004900] CPU features: detected: E0PD worker2 # [ 0.004872] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.004855] CPU features: detected: CRC32 instructions worker2 # [ 0.004877] CPU features: detected: RCpc load-acquire (LDAPR) worker1 # [ 0.004902] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.004880] CPU features: detected: LSE atomic instructions lb # [ 0.004858] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.004905] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.004883] CPU features: detected: Privileged Access Never lb # [ 0.004861] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.004908] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.004885] CPU features: detected: PMUv3 worker1 # [ 0.004911] CPU features: detected: Fine Grained Traps worker2 # [ 0.004888] CPU features: detected: RAS Extension Support lb # [ 0.004864] CPU features: detected: Data independent timing control (DIT) lb # [ 0.004867] CPU features: detected: E0PD worker2 # [ 0.004891] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.004914] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.004870] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.004893] CPU features: detected: Random Number Generator worker1 # [ 0.004920] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.004896] CPU features: detected: Speculation barrier (SB) client # [ 0.161510] iommu: Default domain type: Translated lb # [ 0.004873] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.004922] CPU features: detected: LSE atomic instructions worker2 # [ 0.004899] CPU features: detected: Stage-2 Force Write-Back client # [ 0.161522] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.004876] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.004925] CPU features: detected: Privileged Access Never client # [ 0.161877] SCSI subsystem initialized worker1 # [ 0.004928] CPU features: detected: PMUv3 worker2 # [ 0.004902] CPU features: detected: TLB range maintenance instructions lb # [ 0.004879] CPU features: detected: Fine Grained Traps worker1 # [ 0.004930] CPU features: detected: RAS Extension Support worker2 # [ 0.004906] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.004883] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.163786] usbcore: registered new interface driver usbfs worker1 # [ 0.004933] CPU features: detected: RASv1p1 Extension Support lb # [ 0.004888] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.163818] usbcore: registered new interface driver hub worker1 # [ 0.004935] CPU features: detected: Random Number Generator worker2 # [ 0.004943] alternatives: applying system-wide alternatives client # [ 0.163847] usbcore: registered new device driver usb lb # [ 0.004891] CPU features: detected: LSE atomic instructions worker1 # [ 0.004938] CPU features: detected: Speculation barrier (SB) client # [ 0.164113] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.007825] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.004894] CPU features: detected: Privileged Access Never worker1 # [ 0.004941] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.004897] CPU features: detected: PMUv3 client # [ 0.164120] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.004900] CPU features: detected: RAS Extension Support client # [ 0.164129] PTP clock support registered worker2 # [ 0.007958] Memory: 1406504K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) client # [ 0.164174] EDAC MC: Ver: 3.0.0 lb # [ 0.004902] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.008412] devtmpfs: initialized lb # [ 0.004905] CPU features: detected: Random Number Generator client # [ 0.168603] scmi_core: SCMI protocol bus registered worker2 # [ 0.010147] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.004908] CPU features: detected: Speculation barrier (SB) client # [ 0.169549] FPGA manager framework worker2 # [ 0.010169] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.004911] CPU features: detected: Stage-2 Force Write-Back client # [ 0.170521] vgaarb: loaded worker2 # [ 0.010348] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.004914] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.010352] 0 pages in range for non-PLT usage client # [ 0.171141] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.004918] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.010353] 508288 pages in range for PLT usage lb # [ 0.004953] alternatives: applying system-wide alternatives worker2 # [ 0.010459] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.011239] DMI not present or invalid. lb # [ 0.007886] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.014190] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.016403] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.174332] VFS: Disk quotas dquot_6.6.0 lb # [ 0.008069] Memory: 1406552K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) worker1 # [ 0.004944] CPU features: detected: TLB range maintenance instructions lb # [ 0.008432] devtmpfs: initialized client # [ 0.174367] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.016580] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.004949] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.010243] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.016775] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.004986] alternatives: applying system-wide alternatives worker2 # [ 0.016796] audit: initializing netlink subsys (disabled) lb # [ 0.010265] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.007925] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.017397] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.010441] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.177875] netfs: FS-Cache loaded worker2 # [ 0.017399] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.010446] 0 pages in range for non-PLT usage client # [ 0.177993] pnp: PnP ACPI: disabled lb # [ 0.010447] 508288 pages in range for PLT usage worker2 # [ 0.017403] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.008139] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker1 # [ 0.008509] devtmpfs: initialized lb # [ 0.010550] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.017408] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.011332] DMI not present or invalid. worker1 # [ 0.010257] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.017410] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.014490] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.010282] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.017442] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.016642] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.017452] cpuidle: using governor ladder worker1 # [ 0.010476] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.017458] cpuidle: using governor menu lb # [ 0.016813] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.010480] 0 pages in range for non-PLT usage worker2 # [ 0.017647] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.010481] 508288 pages in range for PLT usage client # [ 0.181957] NET: Registered PF_INET protocol family worker2 # [ 0.017662] ASID allocator initialised with 65536 entries worker1 # [ 0.010588] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.018861] Serial: AMBA PL011 UART driver worker1 # [ 0.011343] DMI not present or invalid. client # [ 0.182213] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.014479] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.023999] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.024140] printk: console [ttyAMA0] enabled worker1 # [ 0.016664] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.016835] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.017031] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.017055] audit: initializing netlink subsys (disabled) worker1 # [ 0.017640] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.017642] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.017646] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.017651] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.017007] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.017653] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.017028] audit: initializing netlink subsys (disabled) lb # [ 0.017599] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.017676] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.017686] cpuidle: using governor ladder lb # [ 0.017602] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.017691] cpuidle: using governor menu lb # [ 0.017605] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.017879] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.017610] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.142844] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.017894] ASID allocator initialised with 65536 entries lb # [ 0.017613] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.019092] Serial: AMBA PL011 UART driver worker2 # [ 0.142860] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.017635] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.142865] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.024144] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.017645] cpuidle: using governor ladder worker1 # [ 0.024288] printk: console [ttyAMA0] enabled worker2 # [ 0.142870] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.017651] cpuidle: using governor menu worker2 # [ 0.142874] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.017837] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.143251] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.142878] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.017851] ASID allocator initialised with 65536 entries worker1 # [ 0.143270] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.019010] Serial: AMBA PL011 UART driver worker2 # [ 0.142882] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.143275] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker2 # [ 0.142886] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.024272] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.143280] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.024417] printk: console [ttyAMA0] enabled worker1 # [ 0.143284] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.143978] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.143288] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.150029] fbcon: Taking over console lb # [ 0.143999] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.150045] ACPI: Interpreter disabled. worker1 # [ 0.143293] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.151849] iommu: Default domain type: Translated lb # [ 0.144005] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.143297] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.151859] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.144009] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.153510] SCSI subsystem initialized lb # [ 0.144013] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.144018] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.150536] fbcon: Taking over console worker1 # [ 0.150553] ACPI: Interpreter disabled. lb # [ 0.144022] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.144026] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.151373] fbcon: Taking over console lb # [ 0.151387] ACPI: Interpreter disabled. lb # [ 0.153230] iommu: Default domain type: Translated worker2 # [ 0.159063] usbcore: registered new interface driver usbfs lb # [ 0.153240] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.159096] usbcore: registered new interface driver hub worker2 # [ 0.159113] usbcore: registered new device driver usb lb # [ 0.154969] SCSI subsystem initialized worker2 # [ 0.159378] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.159148] iommu: Default domain type: Translated worker2 # [ 0.159384] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.159401] PTP clock support registered worker1 # [ 0.159159] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.159454] EDAC MC: Ver: 3.0.0 worker1 # [ 0.160885] SCSI subsystem initialized worker2 # [ 0.164047] scmi_core: SCMI protocol bus registered worker1 # [ 0.161549] usbcore: registered new interface driver usbfs worker2 # [ 0.165004] FPGA manager framework worker2 # [ 0.165980] vgaarb: loaded worker1 # [ 0.161573] usbcore: registered new interface driver hub worker1 # [ 0.161598] usbcore: registered new device driver usb worker2 # [ 0.166607] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.161869] pps_core: LinuxPPS API ver. 1 registered client # [ 0.210270] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.161875] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.161885] PTP clock support registered client # [ 0.210316] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.161925] EDAC MC: Ver: 3.0.0 lb # [ 0.162458] usbcore: registered new interface driver usbfs lb # [ 0.162491] usbcore: registered new interface driver hub worker1 # [ 0.166530] scmi_core: SCMI protocol bus registered client # [ 0.210354] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.162509] usbcore: registered new device driver usb worker2 # [ 0.170415] VFS: Disk quotas dquot_6.6.0 client # [ 0.210424] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.162786] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.167453] FPGA manager framework worker2 # [ 0.170448] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.168402] vgaarb: loaded client # [ 0.210569] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.162792] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.210651] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.162803] PTP clock support registered lb # [ 0.162842] EDAC MC: Ver: 3.0.0 worker1 # [ 0.169029] clocksource: Switched to clocksource arch_sys_counter client # [ 0.210688] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.169606] VFS: Disk quotas dquot_6.6.0 lb # [ 0.167389] scmi_core: SCMI protocol bus registered client # [ 0.210723] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.173984] netfs: FS-Cache loaded worker1 # [ 0.169636] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.174105] pnp: PnP ACPI: disabled client # [ 0.210808] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.168311] FPGA manager framework worker1 # [ 0.171886] netfs: FS-Cache loaded client # [ 0.210831] NET: Registered PF_XDP protocol family lb # [ 0.169265] vgaarb: loaded worker1 # [ 0.172433] pnp: PnP ACPI: disabled client # [ 0.210848] PCI: CLS 0 bytes, default 64 client # [ 0.211089] Trying to unpack rootfs image as initramfs... lb # [ 0.169899] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.170485] VFS: Disk quotas dquot_6.6.0 lb # [ 0.170509] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.178012] NET: Registered PF_INET protocol family lb # [ 0.172877] netfs: FS-Cache loaded lb # [ 0.172992] pnp: PnP ACPI: disabled worker2 # [ 0.178272] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.228556] kvm [1]: HYP mode not available worker1 # [ 0.177886] NET: Registered PF_INET protocol family worker1 # [ 0.178146] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.178952] NET: Registered PF_INET protocol family lb # [ 0.179235] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.207719] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.207766] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.209881] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.206883] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.207797] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.206932] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.207866] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.206960] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.208008] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.207029] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.208093] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.207173] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.208128] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.207272] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.208164] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.208255] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.207309] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.208302] NET: Registered PF_XDP protocol family worker1 # [ 0.207345] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.208320] PCI: CLS 0 bytes, default 64 worker1 # [ 0.207439] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.208571] Trying to unpack rootfs image as initramfs... worker1 # [ 0.207463] NET: Registered PF_XDP protocol family lb # [ 0.211147] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.207480] PCI: CLS 0 bytes, default 64 worker1 # [ 0.207754] Trying to unpack rootfs image as initramfs... lb # [ 0.211182] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.211263] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.224227] kvm [1]: HYP mode not available lb # [ 0.211405] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.211497] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.222668] kvm [1]: HYP mode not available lb # [ 0.211540] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.211576] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.211670] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.211736] NET: Registered PF_XDP protocol family lb # [ 0.211754] PCI: CLS 0 bytes, default 64 lb # [ 0.212000] Trying to unpack rootfs image as initramfs... lb # [ 0.233958] kvm [1]: HYP mode not available client # [ 0.319781] Initialise system trusted keyrings client # [ 0.320547] workingset: timestamp_bits=42 max_order=19 bucket_order=0 client # [ 0.321794] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.322557] 9p: Installing v9fs 9p2000 file system support client # [ 0.351313] Key type asymmetric registered client # [ 0.351345] Asymmetric key parser 'x509' registered client # [ 0.351450] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.353562] io scheduler mq-deadline registered client # [ 0.353573] io scheduler kyber registered client # [ 0.363317] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.364755] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.365154] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.365172] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.365185] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.319234] Initialise system trusted keyrings client # [ 0.365193] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.320003] workingset: timestamp_bits=42 max_order=19 bucket_order=0 client # [ 0.365214] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.321274] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.365240] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.322031] 9p: Installing v9fs 9p2000 file system support client # [ 0.365317] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 0.365327] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.365333] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.365338] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.365343] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.365401] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.365854] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.366036] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.325623] Initialise system trusted keyrings client # [ 0.366053] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.326369] workingset: timestamp_bits=42 max_order=19 bucket_order=0 client # [ 0.366088] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.366116] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.327642] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.366895] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.328423] 9p: Installing v9fs 9p2000 file system support client # [ 0.367100] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.367117] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.331504] Initialise system trusted keyrings lb # [ 0.332252] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.333590] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.391240] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.334442] 9p: Installing v9fs 9p2000 file system support client # [ 0.391807] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.392004] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] client # [ 0.392020] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.392050] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.350807] Key type asymmetric registered worker2 # [ 0.350834] Asymmetric key parser 'x509' registered client # [ 0.392498] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.350915] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.392677] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.353018] io scheduler mq-deadline registered client # [ 0.392693] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.353028] io scheduler kyber registered client # [ 0.392725] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.393194] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.393373] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.393389] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.393418] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.393862] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.394043] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.394058] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.394087] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.357201] Key type asymmetric registered lb # [ 0.354466] Key type asymmetric registered worker1 # [ 0.357234] Asymmetric key parser 'x509' registered lb # [ 0.354493] Asymmetric key parser 'x509' registered client # [ 0.394549] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.357345] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.394731] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.354563] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.359469] io scheduler mq-deadline registered client # [ 0.394748] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.359480] io scheduler kyber registered client # [ 0.394777] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.362809] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.394793] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.395305] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.395488] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.364354] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.395517] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.364774] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.395990] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.361959] io scheduler mq-deadline registered client # [ 0.396177] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.361977] io scheduler kyber registered worker2 # [ 0.364795] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.396214] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.364807] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.396608] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.364816] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.396793] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.364838] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.397042] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.397339] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.364866] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker1 # [ 0.369397] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.397355] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.364961] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 0.397385] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.364970] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.364976] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.397835] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.398025] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.364981] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.370826] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.398040] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.364986] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.371232] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.398070] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.365044] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.371251] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.398643] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.365481] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.398655] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.371264] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.365668] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] client # [ 0.398660] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.365684] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.371273] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.374058] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.398705] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.365714] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.371307] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.365729] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.398751] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.371332] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.366185] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.398795] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.371408] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.366369] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.371437] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.398840] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.366384] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.371453] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.366413] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.398885] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.371458] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.398931] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.371463] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.398976] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.371521] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.399022] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.375397] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.371976] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.399068] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.372162] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.375788] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.372179] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.399133] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.375805] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.372209] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.375817] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.372225] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.372702] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.375825] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.372895] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.375847] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.372911] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.372941] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.375874] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.375971] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.375981] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.392178] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.375987] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.392364] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.375992] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.392380] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.375998] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.392409] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.390950] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.447243] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.376054] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.391148] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.392861] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.447278] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.391164] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.376489] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.447300] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.376686] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.391194] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.447322] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.376703] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.391658] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.447348] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.376733] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.391839] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.447371] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.376749] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.391854] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.447394] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.391886] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.377210] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.447416] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.377393] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.392347] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.447438] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.377408] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.392532] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.447461] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned lb # [ 0.377437] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.392547] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.447485] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.392577] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.377936] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.447509] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.378125] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.393031] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.447531] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.378152] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.393213] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.447552] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.378187] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.393229] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.447573] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker2 # [ 0.393258] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.378670] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.447594] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.378854] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.393743] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.447615] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.378869] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.393930] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.447637] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.378901] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.393945] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.447659] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker2 # [ 0.393975] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.379368] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.447680] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned lb # [ 0.379550] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.393990] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.447702] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.379565] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.447730] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.394457] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.379595] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.394661] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.447740] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.405109] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.394694] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.447745] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.380049] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.405135] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.380230] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.448916] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker2 # [ 0.395151] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.405168] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.380246] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.395339] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.380275] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.405657] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.395368] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.405846] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.380771] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.395775] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.405862] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.380955] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.395957] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker1 # [ 0.405892] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.380970] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.396204] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.381000] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.406345] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.396476] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.381016] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.406528] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.396494] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.406543] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.381470] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.396522] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.406573] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.381658] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.396983] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.407070] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.381688] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.397169] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.407254] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.397185] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.407270] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.397214] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.407299] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.397786] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.407315] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.397798] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.407795] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.397804] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.407986] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.408015] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.397851] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.397900] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.408470] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.408660] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.397947] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.408690] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.397994] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.409116] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.398040] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.409298] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.398086] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.409552] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.398133] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.409825] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.426210] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.409843] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.426419] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.398179] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker1 # [ 0.409877] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.426449] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.398225] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.410343] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.426850] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.398288] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.410525] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.427032] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.398333] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.410541] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.427288] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.398355] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.410571] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.427569] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.398376] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.411146] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.427587] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.398399] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.411158] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.427616] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.398423] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.411164] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.428073] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.398444] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.494097] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.428257] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.411208] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.398465] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.428273] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.411255] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.398486] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.428302] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.398508] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.411302] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.428916] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.398531] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.411348] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.428928] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.398554] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.497069] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.411394] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.428934] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.398577] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.411440] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker2 # [ 0.398598] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.428986] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.411491] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.429033] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.411539] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.429079] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.411599] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.429126] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.411671] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.429173] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.411717] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.429232] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.411739] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.429287] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.411760] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.429333] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker1 # [ 0.411782] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.411806] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.429390] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.411828] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.454665] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.429476] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.454712] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.411850] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.429523] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.454737] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.411872] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.429545] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.454771] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.411894] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.429565] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.454794] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.411916] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned lb # [ 0.429587] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.454817] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.411938] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.429612] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.454848] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.411962] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.429634] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.454870] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.411983] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.454901] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.429656] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned client # [ 0.507224] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker1 # [ 0.412005] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.454912] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.429679] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.509133] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.412027] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker2 # [ 0.454917] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.510984] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.429700] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.412049] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.456146] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.429722] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.412070] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.429745] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.412091] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.513078] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) lb # [ 0.429767] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.412113] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.429789] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.412135] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned lb # [ 0.429810] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.412157] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.412185] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.429831] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.412195] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.429852] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.429873] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.412199] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.429894] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.523335] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) client # [ 0.525365] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.477459] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.474039] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.474066] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned lb # [ 0.474089] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.474122] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.474132] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.474137] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.535317] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.475334] pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.537796] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.490137] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) client # [ 0.549276] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.500052] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.498656] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.500916] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.504408] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.506462] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.501533] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) client # [ 0.560426] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.563085] msm_serial: driver initialized client # [ 0.563784] SuperH (H)SCI(F) driver initialized client # [ 0.563845] STM32 USART driver initialized worker1 # [ 0.511757] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.511383] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.520241] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.522246] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.525972] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.515784] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.517748] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.519806] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker1 # [ 0.521699] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.525381] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker1 # [ 0.527335] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.534375] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) lb # [ 0.530220] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) lb # [ 0.532283] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.537632] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.540063] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.596360] loop: module loaded client # [ 0.596547] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 0.544728] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) client # [ 0.597282] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 0.547736] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.550027] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) lb # [ 0.542152] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) lb # [ 0.545214] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.550496] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.552327] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.607800] megasas: 07.734.00.00-rc1 client # [ 0.608567] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.556393] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.610644] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.610672] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.556320] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.559585] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.615642] Using buffer write method worker2 # [ 0.567837] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.615719] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.617540] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.570466] msm_serial: driver initialized client # [ 0.617599] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.571242] SuperH (H)SCI(F) driver initialized worker2 # [ 0.571306] STM32 USART driver initialized worker1 # [ 0.574468] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.575201] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.635205] Using buffer write method client # [ 0.635239] Concatenating MTD devices: worker1 # [ 0.577341] msm_serial: driver initialized client # [ 0.635243] (0): "0.flash" worker1 # [ 0.577485] SuperH (H)SCI(F) driver initialized client # [ 0.635247] (1): "0.flash" worker1 # [ 0.577540] STM32 USART driver initialized client # [ 0.635251] into device "0.flash" lb # [ 0.577979] msm_serial: driver initialized lb # [ 0.578132] SuperH (H)SCI(F) driver initialized lb # [ 0.578188] STM32 USART driver initialized worker2 # [ 0.604492] loop: module loaded worker2 # [ 0.604677] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 0.605441] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 0.611303] megasas: 07.734.00.00-rc1 worker2 # [ 0.611991] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.612128] loop: module loaded worker1 # [ 0.612322] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 0.614296] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.614320] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.610899] loop: module loaded worker1 # [ 0.614220] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.611088] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.611849] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.617629] megasas: 07.734.00.00-rc1 worker1 # [ 0.618337] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.623727] Using buffer write method worker2 # [ 0.623802] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.622650] megasas: 07.734.00.00-rc1 lb # [ 0.623489] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.629111] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.634651] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.629139] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.634710] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.625362] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.630879] Using buffer write method worker2 # [ 0.636243] Using buffer write method lb # [ 0.625396] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.636272] Concatenating MTD devices: worker2 # [ 0.636276] (0): "0.flash" lb # [ 0.627010] Using buffer write method worker1 # [ 0.630951] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.636280] (1): "0.flash" worker2 # [ 0.636283] into device "0.flash" worker1 # [ 0.632675] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.627070] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.632707] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.628872] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.628909] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.646241] Using buffer write method worker1 # [ 0.646329] Concatenating MTD devices: worker1 # [ 0.646347] (0): "0.flash" worker1 # [ 0.646354] (1): "0.flash" worker1 # [ 0.646357] into device "0.flash" lb # [ 0.648530] Using buffer write method lb # [ 0.648593] Concatenating MTD devices: lb # [ 0.648610] (0): "0.flash" lb # [ 0.648615] (1): "0.flash" lb # [ 0.648618] into device "0.flash" client # [ 0.889170] Freeing initrd memory: 26160K client # [ 0.896051] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.899975] thunder_xcv, ver 1.0 client # [ 0.900019] thunder_bgx, ver 1.0 client # [ 0.900044] nicpf, ver 1.0 client # [ 0.900597] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.900606] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 0.900633] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.900641] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.900676] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.900681] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.900704] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.900710] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.900841] sky2: driver version 1.30 client # [ 0.902545] usbcore: registered new interface driver usb-storage client # [ 0.902607] usbcore: registered new interface driver usbserial_generic client # [ 0.902624] usbserial: USB Serial support registered for generic client # [ 0.903921] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.903957] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.904253] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 client # [ 0.915924] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 client # [ 0.916284] hub 1-0:1.0: USB hub found client # [ 0.916301] hub 1-0:1.0: 6 ports detected client # [ 0.918450] hv_vmbus: registering driver hyperv_keyboard client # [ 0.920098] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 0.920126] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T10:42:09 UTC (1789987329) client # [ 0.920434] i2c_dev: i2c /dev entries driver client # [ 0.925698] sdhci: Secure Digital Host Controller Interface driver client # [ 0.925714] sdhci: Copyright(c) Pierre Ossman client # [ 0.926001] Synopsys Designware Multimedia Card Interface Driver client # [ 0.926382] sdhci-pltfm: SDHCI platform and OF driver helper client # [ 0.930943] hid: raw HID events driver (C) Jiri Kosina client # [ 0.931882] usbcore: registered new interface driver usbhid client # [ 0.931892] usbhid: USB HID core driver client # [ 0.934253] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 0.937026] drop_monitor: Initializing network drop monitor service client # [ 0.937265] NET: Registered PF_INET6 protocol family client # [ 0.939445] Segment Routing with IPv6 client # [ 0.939468] In-situ OAM (IOAM) with IPv6 client # [ 0.939501] NET: Registered PF_PACKET protocol family worker2 # [ 0.888933] Freeing initrd memory: 26148K client # [ 0.941107] 9pnet: Installing 9P2000 support worker2 # [ 0.895332] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.943833] Key type dns_resolver registered worker1 # [ 0.895795] Freeing initrd memory: 26148K client # [ 0.950477] registered taskstats version 1 client # [ 0.950669] Loading compiled-in X.509 certificates worker2 # [ 0.899145] thunder_xcv, ver 1.0 worker2 # [ 0.899191] thunder_bgx, ver 1.0 worker2 # [ 0.899215] nicpf, ver 1.0 worker2 # [ 0.899870] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.899093] Freeing initrd memory: 26140K worker1 # [ 0.902379] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.899881] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.899907] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.899914] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.899943] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.899948] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.959560] Demotion targets for Node 0: null client # [ 0.959683] Key type .fscrypt registered worker2 # [ 0.899971] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.959689] Key type fscrypt-provisioning registered worker2 # [ 0.899976] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.959793] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.900125] sky2: driver version 1.30 client # [ 0.959819] ima: Allocated hash algorithm: sha1 worker2 # [ 0.901788] usbcore: registered new interface driver usb-storage client # [ 0.959845] ima: No architecture policies found worker2 # [ 0.901851] usbcore: registered new interface driver usbserial_generic lb # [ 0.905667] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.901868] usbserial: USB Serial support registered for generic client # [ 0.964107] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 0.906223] thunder_xcv, ver 1.0 worker2 # [ 0.902493] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.906269] thunder_bgx, ver 1.0 worker1 # [ 0.906295] nicpf, ver 1.0 worker2 # [ 0.903480] ehci-pci 0000:00:0a.0: EHCI Host Controller worker1 # [ 0.906831] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.903518] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.906840] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.903801] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 0.906864] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 0.906871] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.916043] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.906906] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.916436] hub 1-0:1.0: USB hub found worker1 # [ 0.906914] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.916468] hub 1-0:1.0: 6 ports detected worker1 # [ 0.906936] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 0.906944] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.907072] sky2: driver version 1.30 worker1 # [ 0.908721] usbcore: registered new interface driver usb-storage worker2 # [ 0.919443] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.910004] thunder_xcv, ver 1.0 lb # [ 0.910060] thunder_bgx, ver 1.0 worker1 # [ 0.908820] usbcore: registered new interface driver usbserial_generic lb # [ 0.910087] nicpf, ver 1.0 worker2 # [ 0.919473] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T10:42:09 UTC (1789987329) worker1 # [ 0.908835] usbserial: USB Serial support registered for generic lb # [ 0.910878] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.919783] i2c_dev: i2c /dev entries driver worker1 # [ 0.909818] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 0.910888] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.910913] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 0.909850] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 lb # [ 0.910920] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 0.910021] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.910954] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.910960] igb: Copyright (c) 2007-2014 Intel Corporation. worker1 # [ 0.921792] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.910985] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 0.922203] hub 1-0:1.0: USB hub found worker1 # [ 0.922225] hub 1-0:1.0: 6 ports detected worker2 # [ 0.924977] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.910990] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.924992] sdhci: Copyright(c) Pierre Ossman lb # [ 0.911130] sky2: driver version 1.30 worker2 # [ 0.925274] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.912971] usbcore: registered new interface driver usb-storage worker1 # [ 0.924761] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 0.925671] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.913067] usbcore: registered new interface driver usbserial_generic lb # [ 0.913083] usbserial: USB Serial support registered for generic lb # [ 0.913736] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 0.930374] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.926365] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.914542] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.982861] clk: Disabling unused clocks worker1 # [ 0.926401] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T10:42:09 UTC (1789987329) lb # [ 0.914572] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.982884] PM: genpd: Disabling unused power domains worker1 # [ 0.926718] i2c_dev: i2c /dev entries driver worker2 # [ 0.931312] usbcore: registered new interface driver usbhid worker2 # [ 0.931323] usbhid: USB HID core driver lb # [ 0.914772] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.926540] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.926903] hub 1-0:1.0: USB hub found lb # [ 0.926924] hub 1-0:1.0: 6 ports detected worker2 # [ 0.933605] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.931818] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 0.936312] drop_monitor: Initializing network drop monitor service worker1 # [ 0.931834] sdhci: Copyright(c) Pierre Ossman client # [ 0.988531] Freeing unused kernel memory: 4736K worker2 # [ 0.936460] NET: Registered PF_INET6 protocol family worker1 # [ 0.932119] Synopsys Designware Multimedia Card Interface Driver client # [ 0.988727] Run /init as init process lb # [ 0.930607] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.932493] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.938502] Segment Routing with IPv6 lb # [ 0.930651] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T10:42:09 UTC (1789987329) worker2 # [ 0.938523] In-situ OAM (IOAM) with IPv6 lb # [ 0.930956] i2c_dev: i2c /dev entries driver worker2 # [ 0.938583] NET: Registered PF_PACKET protocol family worker1 # [ 0.936981] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.938023] usbcore: registered new interface driver usbhid worker2 # [ 0.940429] 9pnet: Installing 9P2000 support worker1 # [ 0.938037] usbhid: USB HID core driver worker2 # [ 0.942545] Key type dns_resolver registered lb # [ 0.936179] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.940389] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 0.936194] sdhci: Copyright(c) Pierre Ossman lb # [ 0.936470] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.936870] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.943063] drop_monitor: Initializing network drop monitor service worker1 # [ 0.943238] NET: Registered PF_INET6 protocol family lb # [ 0.941635] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.945448] Segment Routing with IPv6 worker1 # [ 0.945474] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.945523] NET: Registered PF_PACKET protocol family lb # [ 0.942558] usbcore: registered new interface driver usbhid lb # [ 0.942569] usbhid: USB HID core driver worker2 # [ 0.950216] registered taskstats version 1 worker2 # [ 0.950395] Loading compiled-in X.509 certificates worker1 # [ 0.947175] 9pnet: Installing 9P2000 support lb # [ 0.944916] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 1.005512] systemd[1]: Successfully made /usr/ read-only. lb # [ 0.947632] drop_monitor: Initializing network drop monitor service lb # [ 0.947804] NET: Registered PF_INET6 protocol family worker1 # [ 0.949989] Key type dns_resolver registered lb # [ 0.950140] Segment Routing with IPv6 lb # [ 0.950162] In-situ OAM (IOAM) with IPv6 lb # [ 0.950208] NET: Registered PF_PACKET protocol family lb # [ 0.951886] 9pnet: Installing 9P2000 support worker2 # [ 0.959734] Demotion targets for Node 0: null worker2 # [ 0.959849] Key type .fscrypt registered worker2 # [ 0.959855] Key type fscrypt-provisioning registered worker2 # [ 0.959960] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.959980] ima: Allocated hash algorithm: sha1 worker2 # [ 0.960014] ima: No architecture policies found lb # [ 0.954768] Key type dns_resolver registered worker1 # [ 0.957347] registered taskstats version 1 worker2 # [ 0.964400] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 0.957537] Loading compiled-in X.509 certificates worker1 # [ 0.966428] Demotion targets for Node 0: null worker1 # [ 0.966554] Key type .fscrypt registered worker1 # [ 0.966560] Key type fscrypt-provisioning registered worker1 # [ 0.966659] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.962149] registered taskstats version 1 worker1 # [ 0.966678] ima: Allocated hash algorithm: sha1 lb # [ 0.962359] Loading compiled-in X.509 certificates worker1 # [ 0.966699] ima: No architecture policies found worker1 # [ 0.970759] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.971717] Demotion targets for Node 0: null lb # [ 0.971867] Key type .fscrypt registered lb # [ 0.971877] Key type fscrypt-provisioning registered lb # [ 0.971994] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.972016] ima: Allocated hash algorithm: sha1 lb # [ 0.972039] ima: No architecture policies found lb # [ 0.976087] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 0.982588] clk: Disabling unused clocks worker2 # [ 0.983183] PM: genpd: Disabling unused power domains worker2 # [ 0.987000] Freeing unused kernel memory: 4736K worker2 # [ 0.987223] Run /init as init process worker1 # [ 0.989110] clk: Disabling unused clocks worker1 # [ 0.989135] PM: genpd: Disabling unused power domains worker1 # [ 0.993563] Freeing unused kernel memory: 4736K worker1 # [ 0.993871] Run /init as init process lb # [ 0.995096] clk: Disabling unused clocks lb # [ 0.995128] PM: genpd: Disabling unused power domains worker2 # [ 1.005003] systemd[1]: Successfully made /usr/ read-only. lb # [ 0.999568] Freeing unused kernel memory: 4736K lb # [ 0.999764] Run /init as init process worker1 # [ 1.011440] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.016266] systemd[1]: Successfully made /usr/ read-only. client # [ 1.163210] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.162716] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.169093] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.173982] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.315452] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.340364] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.346691] systemd[1]: Detected virtualization qemu. client # [ 1.347740] systemd[1]: Detected architecture arm64. client # [ 1.348730] systemd[1]: Running in initrd. client # [ 1.350116] systemd[1]: Initializing machine ID from random generator. client # [ 1.351543] systemd[1]: Hostname set to . worker2 # [ 1.315148] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.325653] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.328611] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.339597] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.351839] systemd[1]: Detected virtualization qemu. worker1 # [ 1.346225] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.403427] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.351596] systemd[1]: Detected virtualization qemu. worker2 # [ 1.353922] systemd[1]: Detected architecture arm64. worker1 # [ 1.352592] systemd[1]: Detected architecture arm64. worker1 # [ 1.353557] systemd[1]: Running in initrd. worker2 # [ 1.355955] systemd[1]: Running in initrd. worker1 # [ 1.354925] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.356302] systemd[1]: Hostname set to . worker2 # [ 1.358800] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.361866] systemd[1]: Hostname set to . lb # [ 1.350978] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.357941] systemd[1]: Detected virtualization qemu. lb # [ 1.359022] systemd[1]: Detected architecture arm64. lb # [ 1.360120] systemd[1]: Running in initrd. lb # [ 1.361705] systemd[1]: Initializing machine ID from random generator. lb # [ 1.363381] systemd[1]: Hostname set to . worker1 # [ 1.405349] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.407113] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.414152] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.527211] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.525086] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.534649] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.533985] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.614302] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.673519] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.688628] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.693646] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 lb # [ 1.651257] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.677156] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.680565] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker1 # [ 1.682563] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.687836] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.687286] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.688498] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.689705] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.689738] systemd[1]: Reached target Path Units. worker1 # [ 1.689756] systemd[1]: Reached target Slice Units. worker1 # [ 1.689773] systemd[1]: Reached target Swaps. worker1 # [ 1.689790] systemd[1]: Reached target Timer Units. worker1 # [ 1.689958] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.690087] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.690209] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.690318] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.690420] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.690439] systemd[1]: Reached target Socket Units. lb # [ 1.693267] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.698179] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker1 # [ 1.699315] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.698169] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.706577] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker1 # [ 1.708858] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.710067] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.725869] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.741261] systemd[1]: Starting Journal Service... client # [ 1.796956] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.743680] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.744465] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.805774] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.806911] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.808333] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.809313] systemd[1]: Reached target Path Units. client # [ 1.810064] systemd[1]: Reached target Slice Units. client # [ 1.810838] systemd[1]: Reached target Swaps. client # [ 1.811594] systemd[1]: Reached target Timer Units. worker1 # [ 1.757412] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.812539] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.813686] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.814757] systemd[1]: Listening on Journal Sockets. client # [ 1.815794] systemd[1]: Listening on udev Control Socket. client # [ 1.815919] systemd[1]: Listening on udev Kernel Socket. client # [ 1.815940] systemd[1]: Reached target Socket Units. lb # [ 1.761825] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.820023] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.830381] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.773234] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.831650] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.774745] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.776178] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.777170] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.777321] systemd[1]: Reached target Path Units. worker1 # [ 1.778132] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.778300] systemd[1]: Reached target Slice Units. worker1 # [ 1.778424] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.779211] systemd[1]: Reached target Swaps. worker1 # [ 1.778659] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.780026] systemd[1]: Reached target Timer Units. lb # [ 1.781285] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.782740] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.783998] systemd[1]: Listening on Journal Sockets. lb # [ 1.785108] systemd[1]: Listening on udev Control Socket. lb # [ 1.786313] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.787251] systemd[1]: Reached target Socket Units. lb # [ 1.790969] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.844642] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.797418] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.802157] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.803325] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.863407] systemd[1]: Starting Journal Service... lb # [ 1.810214] systemd[1]: Mounting Kernel Configuration File System... client # [ 1.872522] systemd[1]: Starting Load Kernel Modules... client # [ 1.873399] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.822314] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.820509] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.834194] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.835450] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.836640] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.837601] systemd[1]: Reached target Path Units. worker2 # [ 1.838325] systemd[1]: Reached target Slice Units. worker2 # [ 1.839201] systemd[1]: Reached target Swaps. worker2 # [ 1.839867] systemd[1]: Reached target Timer Units. lb # [ 1.830402] systemd[1]: Starting Journal Service... worker2 # [ 1.840932] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.833919] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.842070] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.839175] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.843171] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.841800] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.843325] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.843436] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.843459] systemd[1]: Reached target Socket Units. worker2 # [ 1.848393] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.845009] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.855667] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.856806] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.907738] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.853115] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.857868] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.858107] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 1.858164] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.858117] [drm] features: -context_init worker1 # [ 1.858881] [drm] number of scanouts: 1 worker1 # [ 1.858899] [drm] number of cap sets: 0 worker2 # [ 1.867803] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.870155] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.927353] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.928716] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 1.929057] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.883102] systemd[1]: Starting Journal Service... worker1 # [ 1.873538] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker1 # [ 1.873561] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 client # [ 1.936676] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.939717] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.878121] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.940987] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.887600] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.889448] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 1.948157] systemd-journald[73]: Collecting audit messages is disabled. client # [ 1.949105] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.898407] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.898910] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.906983] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.907824] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.901613] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.904134] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.963815] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.964079] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.909753] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.964090] [drm] features: -context_init worker1 # [ 1.910195] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.910230] systemd[1]: Reached target Local File Systems. lb # [ 1.910292] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 1.910592] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 1.910617] [drm] features: -context_init client # [ 1.964868] [drm] number of scanouts: 1 lb # [ 1.911374] [drm] number of scanouts: 1 client # [ 1.964886] [drm] number of cap sets: 0 worker2 # [ 1.919903] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.911391] [drm] number of cap sets: 0 worker1 # [ 1.914149] Console: switching to colour frame buffer device 160x50 worker1 # [ 1.922638] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.987567] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.987599] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 1.930545] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 1.930573] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 1.946843] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.945774] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 1.947942] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 1.948258] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.948498] systemd[1]: Mounted Kernel Configuration File System. client # [ 2.007953] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.959245] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 2.015528] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.958926] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.963569] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.968099] systemd-journald[73]: Collecting audit messages is disabled. lb # [ 1.962021] systemd-journald[73]: Collecting audit messages is disabled. lb # [ 1.970275] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 2.023715] Console: switching to colour frame buffer device 160x50 client # [ 2.030321] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 1.982165] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.977436] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.974237] Console: switching to colour frame buffer device 160x50 lb # [ 1.981000] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 1.994681] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.999415] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker2 # [ 1.999651] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.999660] [drm] features: -context_init worker2 # [ 2.000433] [drm] number of scanouts: 1 worker2 # [ 2.000451] [drm] number of cap sets: 0 client # [ 2.056217] systemd[1]: Finished Load Kernel Modules. client # [ 2.063861] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.006872] systemd[1]: Finished Load Kernel Modules. lb # [ 2.009178] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.017561] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker2 # [ 2.017583] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 2.023375] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 2.026024] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 2.022128] systemd[1]: Started Journal Service. worker1 # [ 2.016459] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.017813] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.018938] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 2.087457] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 2.089649] systemd[1]: Reached target Preparation for Local File Systems. client # [ 2.089692] systemd[1]: Reached target Local File Systems. lb # [ 2.038252] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 2.038506] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 2.038542] systemd[1]: Reached target Local File Systems. worker1 # [ 2.019993] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.036177] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.046375] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.103522] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 2.044502] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.047983] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker1 # [ 2.053602] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.063089] Console: switching to colour frame buffer device 160x50 worker2 # [ 2.069616] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 2.127544] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.061256] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.079357] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 2.081441] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 2.078255] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.086755] systemd[1]: Reached target Local File Systems. worker2 # [ 2.090211] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 2.077678] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.103342] systemd[1]: Finished Load Kernel Modules. client # [ 2.159360] systemd[1]: Started Journal Service. client # [ 2.147706] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 2.152408] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 2.154645] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 2.164211] systemd-modules-load[74]: Inserted module 'virtio_gpu' lb # [ 2.120681] systemd[1]: Started Journal Service. client # [ 2.168384] systemd-modules-load[74]: Module 'virtio_rng' is built in client # [ 2.169471] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.138819] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.117837] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.119007] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.124277] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.128871] systemd-modules-load[74]: Inserted module 'virtio_gpu' lb # [ 2.131299] systemd-modules-load[74]: Module 'virtio_rng' is built in client # [ 2.192605] systemd-udevd[81]: Using default interface naming scheme 'v261'. worker1 # [ 2.144141] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.159331] systemd[1]: Finished Apply Kernel Variables. lb # [ 2.140485] systemd[1]: Starting Create System Files and Directories... lb # [ 2.141859] systemd-udevd[81]: Using default interface naming scheme 'v261'. worker2 # [ 2.165297] systemd[1]: Started Journal Service. worker2 # [ 2.160369] systemd-modules-load[74]: Inserted module 'dm_mod' worker2 # [ 2.161612] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker2 # [ 2.162674] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 2.163702] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.220300] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.173968] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.164850] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.176735] systemd[1]: Starting Create System Files and Directories... client # [ 2.233373] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.180823] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.188515] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.192052] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.198601] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker2 # [ 2.213282] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.238650] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.240337] systemd[1]: Starting Virtual Console Setup... client # [ 2.304115] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.296125] systemd[1]: Starting Virtual Console Setup... client # [ 2.348582] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.356184] systemd[1]: Finished Virtual Console Setup. lb # [ 2.296529] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.300512] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.352630] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.356531] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.833592] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.834555] systemd[1]: Reached target System Initialization. worker1 # [ 2.840161] systemd[1]: Reached target Basic System. client # [ 2.993751] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.994944] systemd[1]: Reached target System Initialization. client # [ 2.996181] systemd[1]: Reached target Basic System. lb # [ 2.940785] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.942651] systemd[1]: Reached target System Initialization. lb # [ 2.944209] systemd[1]: Reached target Basic System. worker1 # [ 2.960370] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.985062] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.986875] systemd[1]: Reached target System Initialization. worker2 # [ 2.992867] systemd[1]: Reached target Basic System. worker1 # [ 3.007465] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.012301] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.083992] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 3.148336] (udev-worker)[99]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.097269] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.101755] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.106069] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.109585] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.185538] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.129369] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.139637] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 3.192952] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.150382] (udev-worker)[105]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.153420] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.161188] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.167674] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.168379] systemd[1]: Mounting /sysroot... worker1 # [ 3.209082] EXT4-fs (vda): mounted filesystem f7c5d3cd-a4c0-4abb-872c-160b098e5d04 r/w with ordered data mode. Quota mode: none. lb # [ 3.191746] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.253991] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.256223] systemd[1]: Reached target Initrd Root Device. lb # [ 3.195870] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.204071] systemd[1]: Mounted /sysroot. lb # [ 3.198244] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.206421] systemd[1]: Reached target Initrd Root File System. client # [ 3.260149] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.209964] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.234330] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.239695] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.241599] systemd[1]: Reloading... worker2 # [ 3.259022] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.260956] systemd[1]: Reached target Initrd Root Device. lb # [ 3.254548] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.264127] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 3.318836] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.262048] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 3.325003] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.268455] systemd[1]: Mounting /sysroot... client # [ 3.332488] systemd[1]: Mounting /sysroot... worker2 # [ 3.307310] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.316179] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.320260] systemd[1]: Mounting /sysroot... lb # [ 3.327812] EXT4-fs (vda): mounted filesystem ff69be9e-844c-4a61-a44f-dbd929a9fa08 r/w with ordered data mode. Quota mode: none. client # [ 3.384829] EXT4-fs (vda): mounted filesystem 3d9162f0-02a6-4fd9-a510-3cdf3892677d r/w with ordered data mode. Quota mode: none. client # [ 3.375592] systemd[1]: Mounted /sysroot. lb # [ 3.315534] systemd[1]: Mounted /sysroot. client # [ 3.378399] systemd[1]: Reached target Initrd Root File System. lb # [ 3.318297] systemd[1]: Reached target Initrd Root File System. client # [ 3.382868] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.323547] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.373323] EXT4-fs (vda): mounted filesystem e47d3285-a155-4fd1-a63a-734ecaee58fd r/w with ordered data mode. Quota mode: none. lb # [ 3.351713] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.364558] systemd[1]: Mounted /sysroot. worker2 # [ 3.365532] systemd[1]: Reached target Initrd Root File System. client # [ 3.416512] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.368635] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.358499] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.363962] systemd[1]: Reloading... client # [ 3.427043] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.430951] systemd[1]: Reloading... worker2 # [ 3.395727] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.404354] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 3.406682] systemd[1]: Reloading... worker1 # [ 3.476215] systemd[1]: Reloading finished in 228 ms. worker1 # [ 3.503425] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.508501] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker1 # [ 3.514311] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 3.524866] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.526988] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.528881] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.551511] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.553118] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.606355] systemd[1]: Reloading finished in 244 ms. client # [ 3.670210] systemd[1]: Reloading finished in 245 ms. worker2 # [ 3.641217] systemd[1]: Reloading finished in 237 ms. client # [ 3.698503] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... client # [ 3.703490] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 3.643518] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... client # [ 3.708126] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 3.648227] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 3.652361] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.714547] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.717117] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.720143] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.660101] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.661907] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.664793] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.675801] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.683125] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... client # [ 3.741609] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 3.691276] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.743958] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.694676] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.691126] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.694171] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.704263] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.705441] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.722910] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 3.725349] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.767890] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.779037] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.795681] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.812522] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.835293] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.898498] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.908496] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.927327] systemd[1]: Mounting /sysroot/run... lb # [ 3.871689] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.881833] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.944986] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.890581] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.899862] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.903322] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.913212] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.914692] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.910596] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.923037] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.924161] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.980978] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.933647] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.930695] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.942649] systemd[1]: Mounting /sysroot/run... client # [ 4.001257] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.952915] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.963204] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.964864] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.959806] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 4.025482] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 4.033494] systemd[1]: Mounted /sysroot/run. lb # [ 3.980720] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.991686] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 4.056274] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.058905] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 4.067329] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 4.013406] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.038052] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 4.091363] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.092878] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.033647] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 4.038356] systemd[1]: Mounted /sysroot/run. worker2 # [ 4.049921] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 4.053173] systemd[1]: Mounted /sysroot/run. lb # [ 4.048803] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 4.051527] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 4.072368] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.076933] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 4.070954] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.083195] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 4.073870] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.075790] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.108329] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.111094] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.116270] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.119029] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.121300] systemd[1]: Reached target Initrd File Systems. lb # [ 4.126510] systemd[1]: Starting Find NixOS closure... lb # [ 4.143692] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.159272] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.162171] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.167170] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.178229] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.184809] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.204493] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.214037] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.208114] systemd[1]: Reached target Initrd Default Target. lb # [ 4.213608] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.235592] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.239622] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.245859] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.247708] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.252186] systemd[1]: Stopped target Basic System. lb # [ 4.253276] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.257008] systemd[1]: Stopped target Path Units. lb # [ 4.258337] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 4.263024] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 4.267780] systemd[1]: Stopped target Slice Units. lb # [ 4.268661] systemd[1]: Stopped target Socket Units. lb # [ 4.272175] systemd[1]: Stopped target System Initialization. lb # [ 4.274222] systemd[1]: Stopped target Swaps. lb # [ 4.276734] systemd[1]: Stopped target Timer Units. worker2 # [ 4.286407] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 4.288210] systemd[1]: Stopped target Basic System. lb # [ 4.278828] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.289194] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.290330] systemd[1]: Stopped target Path Units. worker2 # [ 4.292359] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 4.284698] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.286579] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 4.289202] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.300182] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.302446] systemd[1]: Stopped target Slice Units. lb # [ 4.293404] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 4.294368] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.305365] systemd[1]: Stopped target Socket Units. worker2 # [ 4.309050] systemd[1]: Stopped target System Initialization. lb # [ 4.299441] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 4.300731] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.311013] systemd[1]: Stopped target Swaps. worker2 # [ 4.313051] systemd[1]: Stopped target Timer Units. lb # [ 4.304208] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 4.315161] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 4.306171] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 4.319571] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.321524] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 4.314604] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 4.324462] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.328166] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 4.320301] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 4.330092] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.324311] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.328263] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 4.340677] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.342191] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.344301] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 4.336288] systemd[1]: Stopped target Local File Systems. worker2 # [ 4.346341] systemd[1]: Stopped Load Kernel Modules. lb # [ 4.340269] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 4.352218] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 4.344371] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 4.354382] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 4.347452] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 4.360985] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.352798] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 4.353863] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.364124] systemd[1]: Stopped Create System Files and Directories. lb # [ 4.354934] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.355683] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.366000] systemd[1]: Stopped target Local File Systems. worker2 # [ 4.367735] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 4.363261] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 4.375706] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 4.367871] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 4.369463] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 4.381146] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 4.372308] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.384407] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 4.376604] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.377522] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 4.378471] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 4.389242] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.380691] systemd[1]: systemd-udevd.service: Consumed 1.047s CPU time over 2.337s wall clock time, 16.6M memory peak. lb # [ 4.382273] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 4.392445] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.383342] systemd[1]: Closed udev Control Socket. lb # [ 4.384126] systemd[1]: Starting Cleanup udev Database... lb # [ 4.384929] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 4.394845] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 4.386009] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 4.396111] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 4.386904] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 4.399283] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.400652] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.392201] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 4.403886] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.405104] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.396182] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.397512] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 4.412139] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 4.413958] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 4.416169] systemd[1]: systemd-udevd.service: Consumed 1.052s CPU time over 2.335s wall clock time, 16.8M memory peak. worker2 # [ 4.420650] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 4.421723] systemd[1]: Closed udev Control Socket. worker2 # [ 4.422591] systemd[1]: Starting Cleanup udev Database... worker2 # [ 4.426901] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 4.428198] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 4.429240] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 4.430390] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 4.431382] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.422225] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 4.432439] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.424490] systemd[1]: Finished Cleanup udev Database. lb # [ 4.428227] systemd[1]: Reached target Switch Root. lb # [ 4.429050] systemd[1]: Starting NixOS Activation... worker2 # [ 4.467163] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 4.469312] systemd[1]: Finished Cleanup udev Database. worker2 # [ 4.472569] systemd[1]: Reached target Switch Root. worker2 # [ 4.474109] systemd[1]: Starting NixOS Activation... worker1 # [ 4.524822] (udev-worker)[98]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.530124] (udev-worker)[98]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.550450] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.553468] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.555577] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 4.559780] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.567964] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.569799] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.576463] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.607096] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 4.610718] systemd[1]: Finished Virtual Console Setup. lb # [ 4.614596] initrd-nixos-activation-start[172]: booting system configuration /nix/store/sy3pchz5vg22ylc3whvkp4s8qngi8wmd-nixos-system-lb-test worker2 # [ 4.644659] initrd-nixos-activation-start[172]: booting system configuration /nix/store/wykyb0qy7gxax0kbx52lhrandvn5hhwl-nixos-system-worker2-test client # [ 4.731425] (udev-worker)[95]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory lb # [ 4.675508] initrd-nixos-activation-start[172]: running activation script... client # [ 4.738232] (udev-worker)[95]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.765967] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.714883] initrd-nixos-activation-start[172]: running activation script... client # [ 4.767135] systemd[1]: Stopped Virtual Console Setup. client # [ 4.767880] systemd[1]: Stopping Virtual Console Setup... client # [ 4.772402] systemd[1]: Starting Virtual Console Setup... client # [ 4.792112] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.793947] systemd[1]: Stopped Virtual Console Setup. client # [ 4.798003] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.767257] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.825003] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 4.828518] systemd[1]: Finished Virtual Console Setup. worker1 # [ 4.816063] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.818799] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.823439] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.836762] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.896567] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.929352] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.931014] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.879861] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.933751] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.881841] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.943271] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.895838] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.898748] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.900358] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.974572] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.979988] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.931901] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 4.933834] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 4.989041] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.937350] systemd[1]: Stopped target Initrd Default Target. client # [ 4.991028] systemd[1]: Reached target Initrd Default Target. client # [ 4.992515] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.940186] systemd[1]: Stopped target Basic System. worker1 # [ 4.942010] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 4.944241] systemd[1]: Stopped target Path Units. worker1 # [ 4.948184] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 4.949426] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 4.950617] systemd[1]: Stopped target Slice Units. worker1 # [ 4.951372] systemd[1]: Stopped target Socket Units. worker1 # [ 4.956212] systemd[1]: Stopped target System Initialization. worker1 # [ 4.957118] systemd[1]: Stopped target Swaps. worker1 # [ 4.957809] systemd[1]: Stopped target Timer Units. worker1 # [ 4.958594] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 4.959436] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 4.963160] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.017585] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.965928] systemd[1]: Stopped Find NixOS closure. client # [ 5.020487] systemd[1]: Stopped target Basic System. client # [ 5.021360] systemd[1]: Stopped target Initrd Root Device. client # [ 5.022956] systemd[1]: Stopped target Path Units. client # [ 5.025396] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.027048] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 4.967442] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 4.977549] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.978420] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.032229] systemd[1]: Stopped target Slice Units. client # [ 5.032988] systemd[1]: Stopped target Socket Units. client # [ 5.033703] systemd[1]: Stopped target System Initialization. client # [ 5.034518] systemd[1]: Stopped target Swaps. client # [ 5.035167] systemd[1]: Stopped target Timer Units. worker1 # [ 4.982940] systemd[1]: Stopped Apply Kernel Variables. client # [ 5.035870] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.040213] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 5.041082] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 4.988537] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 5.043159] systemd[1]: Stopped Find NixOS closure. worker1 # [ 4.992380] systemd[1]: Stopped Load Kernel Modules. client # [ 5.045882] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 4.993795] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 4.994922] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.048323] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.995986] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.053253] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.054909] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.004265] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.005275] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.006065] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.058829] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.008475] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.010524] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 5.011421] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 5.012566] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.013566] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 5.014289] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 5.015282] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.071066] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 5.020260] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 5.021404] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.074753] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 5.024272] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.077434] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.025398] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.080772] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.028234] systemd[1]: systemd-udevd.service: Consumed 1.537s CPU time over 3.088s wall clock time, 25.3M memory peak. client # [ 5.083640] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.032136] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.033160] systemd[1]: Closed udev Control Socket. client # [ 5.087584] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.036126] systemd[1]: Starting Cleanup udev Database... client # [ 5.089489] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.036906] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.037947] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.092196] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.040278] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.093485] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.095615] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 5.044438] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.045448] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.046391] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 5.100463] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.101483] systemd[1]: Stopped Virtual Console Setup. client # [ 5.102195] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.103088] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.103981] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 5.105830] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.106680] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.107661] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.108576] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.109483] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.110453] systemd[1]: systemd-udevd.service: Consumed 1.582s CPU time over 3.000s wall clock time, 22.3M memory peak. client # [ 5.111842] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.116232] systemd[1]: Closed udev Control Socket. client # [ 5.116999] systemd[1]: Starting Cleanup udev Database... client # [ 5.120265] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.068446] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.121504] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 5.070802] systemd[1]: Finished Cleanup udev Database. client # [ 5.124439] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 5.072488] systemd[1]: Reached target Switch Root. client # [ 5.125608] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.128136] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.076535] systemd[1]: Starting NixOS Activation... client # [ 5.132137] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.084537] initrd-nixos-activation-start[195]: setting up /etc... client # [ 5.157060] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.158558] systemd[1]: Finished Cleanup udev Database. client # [ 5.160476] systemd[1]: Reached target Switch Root. client # [ 5.162207] systemd[1]: Starting NixOS Activation... worker2 # [ 5.135885] initrd-nixos-activation-start[195]: setting up /etc... worker1 # [ 5.241748] initrd-nixos-activation-start[180]: booting system configuration /nix/store/85sl11dh0zky10jc8x3p4y9xadvl89kj-nixos-system-worker1-test client # [ 5.320674] initrd-nixos-activation-start[181]: booting system configuration /nix/store/llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test worker1 # [ 5.308140] initrd-nixos-activation-start[180]: running activation script... client # [ 5.382587] initrd-nixos-activation-start[181]: running activation script... lb # [ 5.342413] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.345321] systemd[1]: Finished NixOS Activation. lb # [ 5.346548] systemd[1]: Starting Switch Root... lb # [ 5.367186] systemd[1]: Switching root. worker2 # [ 5.392762] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.395589] systemd[1]: Finished NixOS Activation. worker2 # [ 5.400389] systemd[1]: Starting Switch Root... worker2 # [ 5.420304] systemd[1]: Switching root. lb # [ 5.561564] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.605903] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). client # [ 5.755787] initrd-nixos-activation-start[204]: setting up /etc... worker1 # [ 5.710018] initrd-nixos-activation-start[203]: setting up /etc... client # [ 6.005798] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.008154] systemd[1]: Finished NixOS Activation. client # [ 6.009650] systemd[1]: Starting Switch Root... worker1 # [ 5.961503] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 5.964167] systemd[1]: Finished NixOS Activation. worker1 # [ 5.968203] systemd[1]: Starting Switch Root... client # [ 6.031283] systemd[1]: Switching root. worker1 # [ 5.987628] systemd[1]: Switching root. worker1 # [ 6.165775] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 6.165184] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.177261] systemd[1]: Detected virtualization qemu. client # [ 6.229003] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 6.168820] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 6.175444] systemd[1]: Detected virtualization qemu. worker2 # [ 6.180404] systemd[1]: Detected architecture arm64. worker2 # [ 6.184378] systemd[1]: Detected first boot. lb # [ 6.177417] systemd[1]: Detected architecture arm64. lb # [ 6.180257] systemd[1]: Detected first boot. worker2 # [ 6.191140] systemd[1]: Initializing machine ID from random generator. lb # [ 6.186979] systemd[1]: Initializing machine ID from random generator. lb # [ 6.512678] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.523074] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 6.695033] systemd[1]: Applying preset policy. worker2 # [ 6.718099] systemd[1]: Applying preset policy. worker1 # [ 6.739080] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.751131] systemd[1]: Detected virtualization qemu. worker1 # [ 6.754282] systemd[1]: Detected architecture arm64. worker1 # [ 6.757263] systemd[1]: Detected first boot. worker1 # [ 6.762237] systemd[1]: Initializing machine ID from random generator. client # [ 6.808692] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 6.820867] systemd[1]: Detected virtualization qemu. client # [ 6.824571] systemd[1]: Detected architecture arm64. client # [ 6.826672] systemd[1]: Detected first boot. client # [ 6.833269] systemd[1]: Initializing machine ID from random generator. worker1 # [ 7.082183] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.153463] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 7.167005] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.195540] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.270311] systemd[1]: Applying preset policy. client # [ 7.351738] systemd[1]: Applying preset policy. lb # [ 7.674736] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 7.676023] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 7.682591] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 7.684264] systemd[1]: Stopped initrd-switch-root.service. lb # [ 7.679349] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 7.686586] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 7.682813] systemd[1]: Created slice Slice /system/getty. worker2 # [ 7.690470] systemd[1]: Created slice Slice /system/getty. lb # [ 7.684800] systemd[1]: Created slice User and Session Slice. worker2 # [ 7.692782] systemd[1]: Created slice User and Session Slice. lb # [ 7.686740] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 7.694020] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 7.688399] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 7.690090] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 7.695847] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 7.691270] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 7.697647] systemd[1]: Expecting device /dev/hvc0... lb # [ 7.692528] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.699240] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 7.700778] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 7.694472] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 7.702126] systemd[1]: Stopped target initrd-fs.target. lb # [ 7.696091] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.703491] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 7.697748] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 7.704770] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 7.699496] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.706124] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.707663] systemd[1]: Reached target Path Units. lb # [ 7.701284] systemd[1]: Reached target Path Units. worker2 # [ 7.708943] systemd[1]: Reached target Remote File Systems. lb # [ 7.702998] systemd[1]: Reached target Remote File Systems. worker2 # [ 7.710220] systemd[1]: Reached target Slice Units. lb # [ 7.704757] systemd[1]: Reached target Slice Units. worker2 # [ 7.711533] systemd[1]: Reached target Swaps. lb # [ 7.706507] systemd[1]: Reached target Swaps. worker2 # [ 7.715126] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 7.710546] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 7.719905] systemd[1]: Listening on Process Core Dump Socket. lb # [ 7.715374] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 7.723862] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 7.719619] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 7.727745] systemd[1]: Listening on Factory Reset Management. worker2 # [ 7.728933] systemd[1]: Listening on Hostname Service Socket. lb # [ 7.723598] systemd[1]: Listening on Factory Reset Management. lb # [ 7.725646] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 7.734554] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 7.736613] systemd[1]: Listening on Journal Audit Socket. lb # [ 7.731104] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 7.735112] systemd[1]: Populated /etc with preset unit settings. lb # [ 7.733993] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 7.740655] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 7.742882] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 7.738421] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 7.744942] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.740960] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 7.747494] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 7.743602] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.745225] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 7.758448] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 7.760657] systemd[1]: Listening on udev Control Socket. lb # [ 7.756327] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 7.814414] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.762562] systemd[1]: Listening on udev Varlink Socket. lb # [ 7.757692] systemd[1]: Listening on udev Control Socket. lb # [ 7.759154] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 7.767394] systemd[1]: Mounting Huge Pages File System... lb # [ 7.763219] systemd[1]: Mounting Huge Pages File System... worker2 # [ 7.772665] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 7.767258] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 7.775221] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 7.783135] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 7.791068] systemd[1]: Mounting Kernel Trace File System... lb # [ 7.789338] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 7.805795] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 7.802944] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 7.814549] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 7.819787] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 7.816716] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 7.822765] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 7.832143] systemd[1]: Mounting Kernel Configuration File System... lb # [ 7.830921] systemd[1]: Mounting Kernel Configuration File System... lb # [ 7.832779] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 7.835862] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.842821] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 7.845942] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.855435] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 7.855821] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.877056] systemd[1]: Starting Journal Service... lb # [ 7.894861] systemd[1]: Starting Load Kernel Module fuse... lb # [ 7.895331] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.929093] systemd[1]: Starting Load Kernel Modules... lb # [ 7.926991] systemd[1]: Starting Journal Service... lb # [ 7.949471] systemd[1]: Starting Load Kernel Modules... worker2 # [ 7.959034] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 7.966504] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 7.966993] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.971534] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 7.983625] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 7.988822] systemd[1]: Listening on Journal Log Access Socket. lb # [ 7.986163] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 7.994149] systemd[1]: Mounted Huge Pages File System. lb # [ 7.986532] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.996396] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 7.996878] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 7.997248] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 7.997609] systemd[1]: Mounted Kernel Configuration File System. lb # [ 8.008451] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.025095] systemd[1]: Listening on Journal Log Access Socket. lb # [ 8.029868] fuse: init (API version 7.45) lb # [ 8.052138] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.059746] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.055601] systemd-journald[267]: Collecting audit messages is enabled. worker2 # [ 8.069715] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 8.065005] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 8.069227] systemd[1]: Mounted Kernel Debug File System. lb # [ 8.073314] systemd[1]: Mounted Kernel Trace File System. lb # [ 8.080990] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.068880] systemd[1]: Queued start job for default target Multi-User System. lb # [ 8.088007] systemd[1]: Started Journal Service. lb # [ 8.075009] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.078476] systemd-modules-load[268]: Module 'atkbd' is built in lb # [ 8.079539] systemd-modules-load[268]: Module 'loop' is built in worker2 # [ 8.111089] EXT4-fs (vda): re-mounted e47d3285-a155-4fd1-a63a-734ecaee58fd. lb # [ 8.091038] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.100188] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 8.101210] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 8.124129] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 8.102173] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 8.103219] systemd[1]: Finished Load Kernel Module fuse. worker2 # [ 8.126841] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 8.127194] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.135987] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 8.138181] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.117186] systemd[1]: Finished Load Kernel Modules. worker2 # [ 8.142357] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 8.145796] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 8.121091] systemd[1]: Mounting FUSE Control File System... lb # [ 8.128455] systemd[1]: Starting Firewall... worker2 # [ 8.164421] systemd[1]: Finished Load Kernel Modules. lb # [ 8.163585] EXT4-fs (vda): re-mounted ff69be9e-844c-4a61-a44f-dbd929a9fa08. worker2 # [ 8.171834] systemd-journald[267]: Collecting audit messages is enabled. lb # [ 8.150024] systemd[1]: Starting Apply Kernel Variables... lb # [ 8.155227] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 8.182050] systemd[1]: Starting Firewall... lb # [ 8.171553] systemd-oomd[270]: No swap; memory pressure usage will be degraded lb # [ 8.181011] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 8.203592] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 8.204132] systemd[1]: Started Journal Service. lb # [ 8.190240] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 8.201874] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 8.216282] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 8.235787] fuse: init (API version 7.45) client # [ 8.292794] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 8.228474] systemd-modules-load[268]: Module 'atkbd' is built in client # [ 8.294059] systemd[1]: Stopped initrd-switch-root.service. client # [ 8.297511] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.233640] systemd-modules-load[268]: Module 'loop' is built in client # [ 8.301460] systemd[1]: Created slice Slice /system/getty. worker1 # [ 8.247158] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.303642] systemd[1]: Created slice User and Session Slice. worker1 # [ 8.248466] systemd[1]: Stopped initrd-switch-root.service. client # [ 8.304882] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 8.251590] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 8.306699] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 8.308535] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 8.255252] systemd[1]: Created slice Slice /system/getty. client # [ 8.310691] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 8.256864] systemd[1]: Created slice User and Session Slice. client # [ 8.311817] systemd[1]: Reached target Local Encrypted Volumes. client # [ 8.314065] systemd[1]: Stopped target initrd-fs.target. client # [ 8.315100] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 8.258174] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 8.258282] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 8.316623] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 8.258322] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 8.258702] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 8.243758] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 8.258976] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 8.259239] systemd[1]: Stopped target initrd-fs.target. client # [ 8.318176] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 8.259499] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 8.259742] systemd[1]: Stopped target initrd-switch-root.target. client # [ 8.320651] systemd[1]: Reached target Path Units. worker1 # [ 8.259987] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 8.260236] systemd[1]: Reached target Path Units. worker1 # [ 8.260475] systemd[1]: Reached target Remote File Systems. client # [ 8.322399] systemd[1]: Reached target Remote File Systems. worker1 # [ 8.260703] systemd[1]: Reached target Slice Units. worker1 # [ 8.260932] systemd[1]: Reached target Swaps. lb # [ 8.249354] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 8.324341] systemd[1]: Reached target Slice Units. client # [ 8.326103] systemd[1]: Reached target Swaps. worker1 # [ 8.273370] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 8.330165] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 8.278317] systemd[1]: Listening on Process Core Dump Socket. client # [ 8.335057] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 8.268981] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 8.282383] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 8.338953] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 8.286693] systemd[1]: Listening on Factory Reset Management. client # [ 8.343026] systemd[1]: Listening on Factory Reset Management. worker1 # [ 8.287944] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 8.277648] systemd[1]: Finished Load Kernel Module fuse. client # [ 8.344345] systemd[1]: Listening on Hostname Service Socket. lb # [ 8.270197] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.272326] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 8.349578] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 8.294281] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 8.297307] systemd[1]: Listening on Journal Audit Socket. client # [ 8.352224] systemd[1]: Listening on Journal Audit Socket. client # [ 8.356913] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 8.302138] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.359457] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 8.305168] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.362040] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.307631] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.364669] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 8.310370] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 8.301358] systemd-oomd[269]: No swap; memory pressure usage will be degraded lb # [ 8.296506] systemd[1]: Starting Load/Save OS Random Seed... client # [ 8.373913] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 8.375933] systemd[1]: Listening on udev Control Socket. lb # [ 8.302367] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.377678] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 8.321666] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 8.322098] systemd[1]: Listening on udev Control Socket. worker1 # [ 8.322445] systemd[1]: Listening on udev Varlink Socket. lb # [ 8.306346] systemd[1]: Mounted FUSE Control File System. client # [ 8.382016] systemd[1]: Mounting Huge Pages File System... worker2 # [ 8.329648] systemd-journald[267]: Received client request to flush runtime journal. worker1 # [ 8.328775] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.333096] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.387618] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.397324] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 8.344254] systemd[1]: Mounting Kernel Debug File System... lb # [ 8.330029] systemd[1]: Finished Apply Kernel Variables. client # [ 8.408055] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 8.354553] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 8.361254] systemd[1]: Starting Create List of Static Device Nodes... client # [ 8.421031] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 8.378446] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 8.433956] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 8.436520] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 8.381189] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 8.449152] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.375915] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 8.450593] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 8.453723] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.400670] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 8.401099] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 8.401372] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.398942] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 8.408136] systemd-journald[267]: Received client request to flush runtime journal. worker2 # [ 8.404620] systemd[1]: Reached target First Boot Complete. worker1 # [ 8.415241] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.472851] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 8.407225] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 8.474317] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.412467] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 8.424663] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.415478] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 8.420645] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 8.424517] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 8.445451] systemd[1]: Starting Journal Service... client # [ 8.543371] systemd[1]: Starting Journal Service... lb # [ 8.472723] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 8.499121] systemd[1]: Starting Load Kernel Modules... lb # [ 8.481156] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 8.483131] systemd[1]: Reached target First Boot Complete. lb # [ 8.484631] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 8.572736] systemd[1]: Starting Load Kernel Modules... worker2 # [ 8.515827] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 8.517346] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 8.528348] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 8.519355] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 8.538188] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.541172] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.526462] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 8.527598] systemd[1]: Reached target Preparation for Local File Systems. client # [ 8.604897] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 8.530732] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 8.554688] systemd[1]: Starting Coldplug All udev Devices... client # [ 8.618937] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.564707] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 8.567087] systemd[1]: Mounted Huge Pages File System. client # [ 8.623451] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.567587] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 8.567973] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 8.568344] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 8.568705] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.667068] fuse: init (API version 7.45) client # [ 8.669872] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 8.631435] systemd[1]: Finished Create List of Static Device Nodes. client # [ 8.692300] systemd-journald[275]: Collecting audit messages is enabled. worker1 # [ 8.637988] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 8.687789] systemd[1]: Queued start job for default target Multi-User System. client # [ 8.707495] systemd[1]: Started Journal Service. client # [ 8.704564] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 8.707223] systemd-modules-load[276]: Module 'atkbd' is built in client # [ 8.708468] systemd-modules-load[276]: Module 'loop' is built in client # [ 8.711404] systemd[1]: Listening on Journal Log Access Socket. client # [ 8.720247] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.672170] systemd[1]: Mounting /run/wrappers... lb # [ 8.663786] systemd[1]: Mounting /run/wrappers... client # [ 8.725631] systemd[1]: Mounted POSIX Message Queue File System. client # [ 8.726610] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 8.685461] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 8.675298] systemd[1]: Mounting FUSE Control File System... client # [ 8.727501] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 8.688902] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.747773] EXT4-fs (vda): re-mounted 3d9162f0-02a6-4fd9-a510-3cdf3892677d. client # [ 8.739965] systemd[1]: Finished Create List of Static Device Nodes. client # [ 8.745317] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 8.705795] EXT4-fs (vda): re-mounted f7c5d3cd-a4c0-4abb-872c-160b098e5d04. worker1 # [ 8.711418] systemd[1]: Finished Load Kernel Modules. client # [ 8.752268] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.754408] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 8.717470] systemd-journald[274]: Collecting audit messages is enabled. client # [ 8.759955] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 8.761105] systemd[1]: Finished Load Kernel Module fuse. client # [ 8.762286] systemd[1]: Finished Load Kernel Modules. client # [ 8.764233] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 8.765607] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 8.726632] systemd[1]: Starting Firewall... client # [ 8.771835] systemd[1]: Mounting FUSE Control File System... worker2 # [ 8.720860] systemd[1]: Mounted FUSE Control File System. client # [ 8.778681] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 8.726281] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 8.740984] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 8.742545] systemd[1]: Started Journal Service. client # [ 8.785618] systemd-oomd[278]: No swap; memory pressure usage will be degraded worker1 # [ 8.751087] fuse: init (API version 7.45) lb # [ 8.733345] systemd[1]: Mounted /run/wrappers. lb # [ 8.734778] systemd[1]: Reached target Local File Systems. client # [ 8.794354] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.752280] systemd[1]: Mounted /run/wrappers. worker1 # [ 8.750684] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 8.753463] systemd[1]: Reached target Local File Systems. client # [ 8.805363] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 8.747426] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 8.751438] systemd[1]: Starting register-nix-paths.service... worker2 # [ 8.764367] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 8.763241] systemd-modules-load[275]: Module 'atkbd' is built in lb # [ 8.756340] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 8.768328] systemd[1]: Starting register-nix-paths.service... lb # [ 8.761284] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 8.771765] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 8.827127] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 8.781380] systemd-modules-load[275]: Module 'loop' is built in client # [ 8.836131] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 8.785095] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 8.777710] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 8.838682] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.790448] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 8.796835] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 8.801900] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 8.843473] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 8.807393] systemd[1]: Starting Create System Files and Directories... worker1 # [ 8.812546] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.821610] systemd[1]: Starting Create System Files and Directories... client # [ 8.900252] systemd-journald[275]: Received client request to flush runtime journal. worker1 # [ 8.827220] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 8.842623] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 8.851075] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.864262] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 8.876400] systemd[1]: Finished Load Kernel Module fuse. worker1 # [ 8.886428] systemd-oomd[276]: No swap; memory pressure usage will be degraded worker1 # [ 8.908384] systemd-journald[274]: Received client request to flush runtime journal. worker2 # [ 8.903660] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 8.911742] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 8.968415] systemd[1]: Finished Load/Save OS Random Seed. client # [ 8.971514] systemd[1]: Reached target First Boot Complete. client # [ 8.976466] systemd[1]: Mounted FUSE Control File System. lb # [ 8.918233] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 8.979682] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 8.933318] systemd-udevd[311]: Using default interface naming scheme 'v261'. client # [ 9.001546] systemd[1]: Finished Apply Kernel Variables. lb # [ 8.937669] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 8.977483] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 9.037177] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 8.982521] systemd[1]: Finished Load/Save OS Random Seed. client # [ 9.040851] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 8.989048] systemd[1]: Reached target First Boot Complete. worker1 # [ 8.993139] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 9.001075] systemd-udevd[306]: Using default interface naming scheme 'v261'. worker1 # [ 9.003171] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 9.005820] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 9.013977] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 9.021837] systemd[1]: Finished Create System Files and Directories. lb # [ 9.039749] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 9.050526] systemd[1]: Finished Create System Files and Directories. lb # [ 9.047068] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 9.060402] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.122308] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 9.071323] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 9.123492] systemd[1]: Reached target Preparation for Local File Systems. client # [ 9.125618] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 9.093518] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 9.096325] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 9.099962] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 9.165163] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 9.168894] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 9.234478] systemd-udevd[307]: Using default interface naming scheme 'v261'. worker1 # [ 9.221169] systemd-udevd[316]: Using default interface naming scheme 'v261'. client # [ 9.282851] systemd[1]: Mounting /run/wrappers... lb # [ 9.232292] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 9.243348] systemd[1]: Mounting /run/wrappers... worker1 # [ 9.254216] systemd[1]: Mounting FUSE Control File System... lb # [ 9.252937] systemd[1]: Starting Update is Completed... worker2 # [ 9.263248] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 9.255023] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 9.272404] systemd[1]: Starting Update is Completed... worker1 # [ 9.285625] systemd[1]: Mounted FUSE Control File System. client # [ 9.343796] systemd[1]: Mounted /run/wrappers. client # [ 9.345515] systemd[1]: Reached target Local File Systems. client # [ 9.349577] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 9.357729] systemd[1]: Starting register-nix-paths.service... client # [ 9.360079] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 9.308657] systemd[1]: Mounted /run/wrappers. worker1 # [ 9.310786] systemd[1]: Reached target Local File Systems. client # [ 9.368224] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 9.317063] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 9.320274] systemd[1]: Starting register-nix-paths.service... worker2 # [ 9.327748] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.379650] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.333654] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 9.334927] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 9.389990] systemd[1]: Starting Create System Files and Directories... worker1 # [ 9.342431] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.358314] systemd[1]: Starting Create System Files and Directories... lb # [ 9.354747] systemd[1]: Finished Update is Completed. worker2 # [ 9.376671] systemd[1]: Finished Update is Completed. client # [ 9.493257] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 9.440695] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.497229] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 9.446413] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.517945] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.589343] systemd[1]: Finished Create System Files and Directories. client # [ 9.602847] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.608951] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.567714] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 9.578717] systemd[1]: Finished Create System Files and Directories. worker1 # [ 9.592498] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 9.601765] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 9.693668] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 9.763499] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 9.719783] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 9.773956] systemd[1]: Starting Update is Completed... client # [ 9.838535] systemd[1]: Finished Update is Completed. worker1 # [ 9.790303] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 9.796645] systemd[1]: Starting Update is Completed... worker1 # [ 9.867114] systemd[1]: Finished Update is Completed. lb # [ 9.886552] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 9.908701] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 9.933168] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 9.934911] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.274600] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.277337] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 10.297959] systemd[1]: Finished register-nix-paths.service. worker1 # [ 10.337680] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 10.339129] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.404842] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 10.373707] systemd[1]: Finished Firewall. client # [ 10.464509] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 10.549710] systemd[1]: Finished Coldplug All udev Devices. lb # [ 10.551785] systemd[1]: Reached target System Initialization. lb # [ 10.555175] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 10.564105] systemd[1]: Started niks3 garbage collection timer. lb # [ 10.565561] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 10.566731] systemd[1]: Reached target Timer Units. lb # [ 10.567839] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 10.575096] systemd[1]: Listening on niks3 server socket. lb # [ 10.579221] systemd[1]: Listening on Nix Daemon Socket. lb # [ 10.584826] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 10.588702] systemd[1]: Reached target Socket Units. lb # [ 10.596296] systemd[1]: Reached target Basic System. lb # [ 10.597068] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 10.598065] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 10.661796] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 10.601814] systemd[1]: Starting Post-Boot Actions... worker2 # [ 10.618388] systemd[1]: Finished Coldplug All udev Devices. lb # [ 10.630060] systemd[1]: Started Reset console on configuration changes. client # [ 10.721835] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 10.671957] systemd[1]: Starting resolvconf update... lb # [ 10.712239] systemd[1]: Started rustfs.service. lb # [ 10.730143] systemd[1]: Starting rustfs-bucket.service... lb # [ 10.741579] nsncd[482]: Sep 21 10:42:19.326 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 10.752100] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 10.768274] systemd[1]: Finished Post-Boot Actions. worker1 # [ 10.790280] systemd[1]: Finished Firewall. lb # [ 10.829868] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 10.836948] systemd[1]: Reached target User and Group Name Lookups. lb # [ 10.850669] systemd[1]: Starting D-Bus System Message Bus... lb # [ 10.881965] systemd[1]: Starting User Login Management... lb # [ 10.888374] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 10.924214] systemd[1]: Finished register-nix-paths.service. worker2 # [ 10.928718] systemd[1]: Reached target System Initialization. worker2 # [ 10.930837] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 10.921710] systemd[1]: Finished Firewall. worker2 # [ 10.933816] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 10.938005] systemd[1]: Reached target Timer Units. client # [ 10.991161] (udev-worker)[366]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 10.940447] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 10.948141] systemd[1]: Listening on Nix Daemon Socket. client # [ 10.995382] (udev-worker)[323]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 11.001018] (udev-worker)[323]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 10.956676] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 10.962780] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 10.964205] systemd[1]: Finished Coldplug All udev Devices. client # [ 11.022026] systemd[1]: Finished register-nix-paths.service. client # [ 11.025480] systemd[1]: Reached target System Initialization. client # [ 11.029221] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 10.971760] systemd[1]: Reached target Socket Units. client # [ 11.031327] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 10.981005] systemd[1]: Reached target Basic System. client # [ 11.033979] systemd[1]: Reached target Timer Units. client # [ 11.037387] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.039728] systemd[1]: Listening on Nix Daemon Socket. client # [ 11.043557] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 10.994292] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 11.049414] systemd[1]: Reached target Socket Units. client # [ 11.050191] systemd[1]: Reached target Basic System. client # [ 11.050914] systemd[1]: Started backdoor.service. client # [ 11.051637] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 11.001451] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.058717] systemd[1]: Starting nftables firewall... worker2 # [ 11.010249] systemd[1]: Starting Post-Boot Actions... worker1 # [ 11.014762] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 11.019821] systemd[1]: Started Reset console on configuration changes. client # [ 11.075651] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.025113] systemd[1]: Starting resolvconf update... worker2 # [ 11.041163] systemd[1]: Starting D-Bus System Message Bus... client # [ 11.095029] systemd[1]: Starting Post-Boot Actions... client # [ 11.123815] systemd[1]: Started Reset console on configuration changes. lb # [ 11.074030] dbus-broker-launch[516]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 11.092308] systemd[1]: Finished Post-Boot Actions. lb # [ 11.084262] dbus-broker-launch[516]: NSS returned no entry for 'systemd-timesync' lb # [ 11.092701] dbus-broker-launch[516]: Invalid user-name in /nix/store/kxmx3smba321l9v2dpmh9zahhsbc77yh-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 11.162057] systemd[1]: Starting resolvconf update... worker2 # [ 11.128721] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.134738] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.127584] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 11.142630] nsncd[488]: Sep 21 10:42:19.725 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.155158] systemd[1]: Reached target User and Group Name Lookups. client # connecting to host... worker2 # [ 11.159583] systemd[1]: Starting User Login Management... lb # [ 11.157819] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 11.165572] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.172954] systemd[1]: Stopped target User and Group Name Lookups. client # [ 11.240917] systemd[1]: Finished Post-Boot Actions. worker2 # [ 11.192448] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 11.180953] systemd[1]: Stopping User and Group Name Lookups... lb # [ 11.193197] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 11.200301] systemd-logind[520]: New seat seat0. worker1 # [ 11.214565] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 11.207823] systemd[1]: nscd.service: Deactivated successfully. client: Guest shell says: b'Spawning backdoor root shell...\n' lb # [ 11.214678] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 11.221122] systemd[1]: Started User Login Management. worker2 # [ 11.252741] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 11.296397] nsncd[400]: Sep 21 10:42:19.886 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.244489] dbus-broker-launch[493]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 11.225845] dbus-broker-launch[516]: Ready client # [ 11.304521] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 11.259560] dbus-broker-launch[493]: NSS returned no entry for 'systemd-timesync' lb # [ 11.238727] systemd[1]: Starting linger-users.service... client # [ 11.305592] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.264376] dbus-broker-launch[493]: Invalid user-name in /nix/store/a9ijqx61hpssavy5d9lh27li51m8hnl7-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.260655] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client: connected to guest root shell worker1 # [ 11.271439] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. client: (connecting took 11.70 seconds) client # [ 11.314197] systemd[1]: Reached target Host and Network Name Lookups. client: (finished: waiting for the VM to finish booting, in 11.70 seconds) client # [ 11.318346] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.332142] systemd[1]: Starting D-Bus System Message Bus... client # [ 11.352379] systemd[1]: Starting User Login Management... worker2 # [ 11.306209] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 11.316415] systemd[1]: Finished register-nix-paths.service. worker1 # [ 11.318703] systemd[1]: Reached target System Initialization. worker2 # [ 11.320774] systemd-logind[501]: New seat seat0. worker1 # [ 11.320775] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 11.322852] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 11.326234] systemd[1]: Reached target Timer Units. worker2 # [ 11.328398] systemd[1]: Started User Login Management. worker1 # [ 11.330058] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 11.334950] systemd[1]: Starting linger-users.service... worker1 # [ 11.334630] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 11.340394] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 11.349740] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 11.362955] systemd[1]: Reached target Socket Units. worker2 # [ 11.366104] dbus-broker-launch[493]: Ready worker1 # [ 11.366787] systemd[1]: Reached target Basic System. lb # [ 11.359306] systemd[1]: Finished resolvconf update. lb # [ 11.365993] systemd[1]: Reached target Preparation for Network. worker1 # [ 11.374463] systemd[1]: Started backdoor.service. worker2 # [ 11.375885] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 11.380402] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 11.379943] systemd[1]: Starting DHCP Client... worker1 # [ 11.388467] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.387465] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.389765] nsncd[583]: Sep 21 10:42:19.973 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.395870] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 11.400839] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.404163] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 11.406605] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 11.397879] systemd[1]: Starting Extra networking commands.... worker1 # [ 11.406650] systemd[1]: Started Reset console on configuration changes. lb # [ 11.402711] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.414127] systemd[1]: nscd.service: Deactivated successfully. lb # [ 11.406636] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 11.417304] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 11.416695] systemd[1]: Starting resolvconf update... lb # [ 11.413359] systemd[1]: Finished linger-users.service. worker2 # [ 11.422877] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.427435] systemd[1]: Starting D-Bus System Message Bus... lb # [ 11.436365] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.450240] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 11.441658] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.456444] systemd[1]: Finished linger-users.service. worker2 # [ 11.483056] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.488796] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.491433] nsncd[559]: Sep 21 10:42:20.080 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.501613] systemd[1]: Finished Post-Boot Actions. worker2 # [ 11.495429] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.572181] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 11.531790] systemd[1]: Finished resolvconf update. worker2 # [ 11.533022] systemd[1]: Reached target Preparation for Network. worker2 # [ 11.536323] systemd[1]: Starting DHCP Client... worker2 # [ 11.540370] systemd[1]: Starting Extra networking commands.... worker1 # [ 11.541159] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.549143] systemd[1]: Reached target Host and Network Name Lookups. worker1 # connecting to host... client # [ 11.612895] systemd-logind[437]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 11.560818] nsncd[498]: Sep 21 10:42:20.129 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.562917] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.563773] systemd[1]: Starting User Login Management... client # [ 11.624514] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 11.625755] dbus-broker-launch[432]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.626888] systemd[1]: Stopping Host and Network Name Lookups... client # [ 11.627713] systemd[1]: Stopped target User and Group Name Lookups. client # [ 11.641907] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 11.591103] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 11.650259] dbus-broker-launch[432]: NSS returned no entry for 'systemd-timesync' client # [ 11.655409] dbus-broker-launch[432]: Invalid user-name in /nix/store/ydh4ywywm30g15n5m6x5vfz42682s2cc-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 11.669516] systemd-logind[437]: New seat seat0. client # [ 11.675378] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 11.682853] systemd[1]: Started User Login Management. client # [ 11.688986] systemd[1]: nscd.service: Deactivated successfully. client # [ 11.689883] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 11.690730] systemd[1]: Starting linger-users.service... client # [ 11.713061] mousedev: PS/2 mouse device common for all mice client # [ 11.710853] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.720191] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 11.667954] dbus-broker-launch[502]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 11.690008] dbus-broker-launch[502]: NSS returned no entry for 'systemd-timesync' client # [ 11.753511] dbus-broker-launch[432]: Ready worker1 # [ 11.694402] dbus-broker-launch[502]: Invalid user-name in /nix/store/a9ijqx61hpssavy5d9lh27li51m8hnl7-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.702965] dhcpcd[609]: dhcpcd-10.3.2 starting lb # [ 11.719355] dhcpcd[651]: dev: loaded udev worker1 # [ 11.734801] systemd[1]: Started D-Bus System Message Bus. lb # [ 11.744020] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 11.730163] dhcpcd[651]: no valid interfaces found lb # [ 11.730990] dhcpcd[651]: no valid interfaces found client # [ 11.801835] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 11.753827] systemd-logind[512]: New seat seat0. worker2 # [ 11.757720] dhcpcd[591]: dhcpcd-10.3.2 starting client # [ 11.809017] systemd[1]: Finished linger-users.service. worker1 # [ 11.762007] systemd[1]: Started User Login Management. worker1 # [ 11.764897] systemd[1]: Starting linger-users.service... worker2 # [ 11.771174] dhcpcd[626]: dev: loaded udev client # [ 11.823129] systemd[1]: Finished resolvconf update. client # [ 11.830326] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.780137] dhcpcd[626]: no valid interfaces found client # [ 11.831462] nsncd[497]: Sep 21 10:42:20.420 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.782259] dhcpcd[626]: no valid interfaces found worker2 # [ 11.783567] dhcpcd[626]: libudev: received NULL device worker2 # [ 11.784701] dhcpcd[626]: libudev: received NULL device lb # [ 11.776204] systemd[1]: Finished Extra networking commands.. lb # [ 11.778789] systemd[1]: Reached target Network. client # [ 11.840549] systemd[1]: Reached target Host and Network Name Lookups. client # [ 11.841737] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.844664] systemd[1]: Starting DHCP Client... lb # [ 11.788352] systemd[1]: Starting PostgreSQL Server... worker1 # [ 11.796238] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 11.803737] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.800575] systemd[1]: Starting Permit User Sessions... worker1 # [ 11.810729] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 11.811762] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 11.822225] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 11.828000] systemd[1]: Finished Extra networking commands.. worker1 # [ 11.826876] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 11.829198] systemd[1]: Reached target Network. worker2 # [ 11.832748] systemd[1]: Starting Permit User Sessions... worker1 # [ 11.832337] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 11.833513] dbus-broker-launch[502]: Ready worker1 # [ 11.834152] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.892353] systemd-logind[437]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 11.877492] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 11.878515] systemd[1]: Finished linger-users.service. worker2 # [ 11.884269] systemd[1]: Finished Permit User Sessions. lb # [ 11.877268] systemd[1]: Finished Permit User Sessions. worker2 # [ 11.889655] systemd[1]: Started Getty on tty1. worker2 # [ 11.891494] systemd[1]: Reached target Login Prompts. lb # [ 11.890065] systemd[1]: Started Getty on tty1. worker1 # [ 11.900946] (udev-worker)[379]: Network interface NamePolicy= disabled on kernel command line. lb # [ 11.894534] systemd[1]: Reached target Login Prompts. worker1 # [ 11.907134] (udev-worker)[472]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 11.917434] (udev-worker)[472]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 11.920958] nsncd[571]: Sep 21 10:42:20.499 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.926491] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.929731] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.932706] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.962713] systemd[1]: Finished resolvconf update. worker1 # [ 11.967932] systemd[1]: Reached target Preparation for Network. worker1 # [ 11.972589] systemd[1]: Starting DHCP Client... worker2 # [ 11.978426] systemd[1]: Starting Virtual Console Setup... worker1 # [ 11.975761] systemd[1]: Starting Extra networking commands.... worker2 # [ 11.998578] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 12.003749] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 12.007501] systemd[1]: Starting Virtual Console Setup... client # [ 12.072927] dhcpcd[530]: dhcpcd-10.3.2 starting client # [ 12.087729] dhcpcd[540]: dev: loaded udev client # [ 12.148258] 8021q: 802.1Q VLAN Support v1.8 client # [ 12.171413] systemd[1]: Finished nftables firewall. worker1 # [ 12.119960] systemd-logind[512]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 12.175583] systemd[1]: Reached target Preparation for Network. worker2 # [ 12.128839] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 12.183835] systemd[1]: Starting Address configuration of eth1... client # [ 12.192776] systemd[1]: Starting Extra networking commands.... lb # [ 12.158454] postgresql-pre-start[678]: The files belonging to this database system will be owned by user "postgres". lb # [ 12.164737] postgresql-pre-start[678]: This user must also own the server process. lb # [ 12.175788] postgresql-pre-start[678]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 12.177540] postgresql-pre-start[678]: The default database encoding has accordingly been set to "UTF8". lb # [ 12.181143] postgresql-pre-start[678]: The default text search configuration will be set to "english". lb # [ 12.184393] postgresql-pre-start[678]: Data page checksums are enabled. lb # [ 12.187989] postgresql-pre-start[678]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 12.192409] postgresql-pre-start[678]: creating subdirectories ... ok lb # [ 12.196308] postgresql-pre-start[678]: selecting dynamic shared memory implementation ... posix worker1 # [ 12.206005] dhcpcd[606]: dhcpcd-10.3.2 starting client # [ 12.276663] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 12.221561] dhcpcd[644]: dev: loaded udev worker1 # [ 12.232731] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 12.241468] systemd[1]: Starting Address configuration of eth1... client # [ 12.318822] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 12.321221] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.273556] 8021q: 802.1Q VLAN Support v1.8 client # [ 12.327968] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 12.328301] cfg80211: failed to load regulatory.db client # [ 12.357441] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 12.302517] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 12.315231] mousedev: PS/2 mouse device common for all mice worker1 # [ 12.318088] systemd[1]: Finished Extra networking commands.. client # [ 12.372875] network-addresses-eth1-start[548]: adding address 192.168.1.1/24... done worker1 # [ 12.326159] systemd[1]: Reached target Network. client # [ 12.392781] network-addresses-eth1-start[548]: adding address 2001:db8:1::1/64... done worker1 # [ 12.331940] systemd[1]: Starting Permit User Sessions... client # [ 12.406313] dhcpcd[566]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (551) - Operation not permitted worker1 # [ 12.367152] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 12.359536] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. client # [ 12.414165] dhcpcd[566]: .resolvconf-wrapped: clearing stale lock pid 551 worker2 # [ 12.365461] systemd[1]: Started backdoor.service. client # [ 12.428552] systemd[1]: Finished Address configuration of eth1. worker1 # [ 12.399005] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 12.399523] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.404307] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 12.404640] cfg80211: failed to load regulatory.db lb # [ 12.387783] postgresql-pre-start[678]: selecting default "max_connections" ... 100 client # [ 12.483524] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.471349] dhcpcd[540]: eth0: waiting for carrier client # [ 12.474938] dhcpcd[540]: libudev: received NULL device client # [ 12.475720] dhcpcd[540]: libudev: received NULL device worker2 # [ 12.440575] 8021q: 802.1Q VLAN Support v1.8 client # [ 12.480396] dhcpcd[540]: eth0: carrier acquired worker1 # [ 12.427866] systemd[1]: Finished Permit User Sessions. worker1 # [ 12.433062] systemd[1]: Started Getty on tty1. worker1 # [ 12.433784] systemd[1]: Reached target Login Prompts. worker1 # [ 12.448250] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 12.494800] dhcpcd[540]: DUID 00:01:00:01:32:43:c6:8d:52:54:00:12:34:56 client # [ 12.495812] dhcpcd[540]: eth0: IAID 00:12:34:56 client # [ 12.499441] dhcpcd[540]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 12.459261] network-addresses-eth1-start[651]: adding address 192.168.1.3/24... done worker1 # [ 12.478192] network-addresses-eth1-start[651]: adding address 2001:db8:1::3/64... done client # [ 12.535552] systemd[1]: Finished Extra networking commands.. client # [ 12.539981] systemd[1]: Reached target Network. client # [ 12.544503] systemd[1]: Starting Permit User Sessions... worker1 # [ 12.516503] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # connecting to host... worker1 # [ 12.505941] dhcpcd[644]: eth0: waiting for carrier worker1 # [ 12.509725] systemd[1]: Finished Address configuration of eth1. worker1 # [ 12.513323] dhcpcd[644]: eth0: waiting for carrier worker1 # [ 12.515253] dhcpcd[644]: eth0: carrier acquired worker2 # [ 12.530213] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 12.531246] dhcpcd[644]: DUID 00:01:00:01:32:43:c6:8d:52:54:00:12:34:56 worker1 # [ 12.533167] dhcpcd[644]: eth0: IAID 00:12:34:56 worker1 # [ 12.533838] dhcpcd[644]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 12.593499] systemd[1]: Finished Permit User Sessions. client # [ 12.601010] systemd[1]: Started Getty on tty1. client # [ 12.603453] systemd[1]: Reached target Login Prompts. worker2 # [ 12.568641] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 12.569143] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.574247] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 12.574599] cfg80211: failed to load regulatory.db lb # [ 12.569341] postgresql-pre-start[678]: selecting default "shared_buffers" ... 128MB worker2 # [ 12.580335] (udev-worker)[652]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.585325] systemd-logind[512]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 12.588560] (udev-worker)[656]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 12.593261] (udev-worker)[656]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.621390] systemd-vconsole-setup[648]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 12.628463] systemd[1]: Finished Virtual Console Setup. lb # [ 12.687502] systemd[1]: Starting Virtual Console Setup... client: (finished: waiting for unit network-addresses-eth1.service, in 13.13 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } lb # [ 12.721301] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 12.726158] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 12.740122] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 12.745577] systemd[1]: Starting Address configuration of eth1... lb # [ 12.745359] systemd[1]: Starting Virtual Console Setup... client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb # [ 12.778521] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 12.853003] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 12.841441] dhcpcd[626]: eth0: waiting for carrier worker2 # [ 12.843059] dhcpcd[626]: eth0: carrier acquired worker2 # [ 12.860812] dhcpcd[626]: DUID 00:01:00:01:32:43:c6:8d:52:54:00:12:34:56 worker2 # [ 12.863870] dhcpcd[626]: eth0: IAID 00:12:34:56 worker2 # [ 12.880853] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 12.869481] systemd-logind[501]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 12.870583] dhcpcd[626]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 12.886695] network-addresses-eth1-start[678]: adding address 192.168.1.4/24... done worker2 # [ 12.901052] network-addresses-eth1-start[678]: adding address 2001:db8:1::4/64... done worker2 # [ 12.921930] systemd[1]: Finished Address configuration of eth1. worker2 # [ 13.032390] mousedev: PS/2 mouse device common for all mice lb # [ 13.062077] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 13.092109] systemd-logind[501]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 13.198614] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.126579] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 13.138841] systemd[1]: Started backdoor.service. lb # [ 13.228574] 8021q: 802.1Q VLAN Support v1.8 lb # connecting to host... worker1 # [ 13.285494] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.277014] (udev-worker)[682]: Network interface NamePolicy= disabled on kernel command line. lb # [ 13.294385] (udev-worker)[685]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.54 seconds) lb: (finished: waiting for the VM to finish booting, in 0.54 seconds) lb # [ 13.304466] (udev-worker)[685]: Network interface NamePolicy= disabled on kernel command line. lb # [ 13.335216] systemd-vconsole-setup[707]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 13.345949] systemd[1]: Finished Virtual Console Setup. lb # [ 13.399697] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 13.438727] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 13.439216] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 13.444717] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 13.445048] cfg80211: failed to load regulatory.db client # [ 13.518085] systemd[1]: Starting Virtual Console Setup... client # [ 13.545640] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 13.565013] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 13.567868] systemd[1]: Stopped Virtual Console Setup. client # [ 13.575737] systemd[1]: Starting Virtual Console Setup... client # [ 13.611112] systemd-logind[437]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 13.574067] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 13.590820] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 13.585024] systemd[1]: Starting Address configuration of eth1... worker1 # [ 13.605066] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.630653] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 13.632780] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 13.635327] systemd[1]: Starting Virtual Console Setup... lb # [ 13.692102] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 13.678483] dhcpcd[651]: eth0: waiting for carrier worker1 # [ 13.686535] systemd-logind[512]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 13.680612] dhcpcd[651]: eth0: carrier acquired lb # [ 13.698873] dhcpcd[651]: DUID 00:01:00:01:32:43:c6:8e:52:54:00:12:34:56 lb # [ 13.701363] dhcpcd[651]: eth0: IAID 00:12:34:56 lb # [ 13.703927] dhcpcd[651]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 13.727605] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 13.728766] network-addresses-eth1-start[735]: adding address 192.168.1.2/24... done lb # [ 13.742173] network-addresses-eth1-start[735]: adding address 2001:db8:1::2/64... done lb # [ 13.762327] systemd[1]: Finished Address configuration of eth1. lb # [ 13.838953] systemd-logind[520]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 13.903467] dhcpcd[540]: eth0: soliciting a DHCP lease client # [ 13.908571] dhcpcd[540]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 13.916193] dhcpcd[540]: eth0: probing address 10.0.2.15/24 client # [ 13.989146] systemd-vconsole-setup[650]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 13.993114] systemd[1]: Finished Virtual Console Setup. lb # [ 13.961355] mousedev: PS/2 mouse device common for all mice worker2 # [ 14.001983] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 14.005058] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 14.010083] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 14.010913] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 14.014356] systemd[1]: Starting Virtual Console Setup... worker1 # [ 14.034708] dhcpcd[644]: eth0: soliciting a DHCP lease worker2 # [ 14.040296] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 14.040497] dhcpcd[644]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 14.044604] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 14.046178] systemd[1]: Starting Virtual Console Setup... worker1 # [ 14.048226] dhcpcd[644]: eth0: probing address 10.0.2.15/24 worker1 # [ 14.057719] systemd-vconsole-setup[701]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 14.062574] systemd[1]: Finished Virtual Console Setup. worker2 # [ 14.078633] systemd-logind[501]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 14.069240] systemd-logind[520]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 14.146809] dhcpcd[540]: eth0: soliciting an IPv6 router client # [ 14.148845] dhcpcd[540]: eth0: Router Advertisement from fe80::2 client # [ 14.150030] dhcpcd[540]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 14.151343] dhcpcd[540]: eth0: adding route to fec0::/64 client # [ 14.152421] dhcpcd[540]: eth0: adding default route via fe80::2 worker2 # [ 14.190235] dhcpcd[626]: eth0: soliciting a DHCP lease worker2 # [ 14.196496] dhcpcd[626]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 14.204203] dhcpcd[626]: eth0: probing address 10.0.2.15/24 worker2 # [ 14.369841] systemd-vconsole-setup[702]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 14.375570] systemd[1]: Finished Virtual Console Setup. lb: (finished: waiting for unit network-addresses-eth1.service, in 1.84 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.06 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 14.895766] dhcpcd[644]: eth0: soliciting an IPv6 router worker1 # [ 14.899013] dhcpcd[644]: eth0: Router Advertisement from fe80::2 worker1 # [ 14.902263] dhcpcd[644]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker1 # [ 14.905181] dhcpcd[644]: eth0: adding route to fec0::/64 worker1 # [ 14.907371] dhcpcd[644]: eth0: adding default route via fe80::2 worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit niks3.service worker2 # [ 15.185608] dhcpcd[626]: eth0: soliciting an IPv6 router worker2 # [ 15.188727] dhcpcd[626]: eth0: Router Advertisement from fe80::2 worker2 # [ 15.192750] dhcpcd[626]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 15.195481] dhcpcd[626]: eth0: adding route to fec0::/64 worker2 # [ 15.198500] dhcpcd[626]: eth0: adding default route via fe80::2 lb # [ 15.495827] dhcpcd[651]: eth0: soliciting a DHCP lease lb # [ 15.500459] dhcpcd[651]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 15.504192] dhcpcd[651]: eth0: probing address 10.0.2.15/24 lb # [ 15.540323] postgresql-pre-start[678]: selecting default time zone ... UTC lb # [ 15.544724] postgresql-pre-start[678]: creating configuration files ... ok lb # [ 15.849619] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 15.863222] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 15.868177] systemd[1]: Stopped Virtual Console Setup. lb # [ 15.868934] systemd[1]: Stopping Virtual Console Setup... lb # [ 15.875350] systemd[1]: Starting Virtual Console Setup... lb # [ 15.912088] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 15.913147] systemd[1]: Stopped Virtual Console Setup. lb # [ 15.917915] systemd[1]: Starting Virtual Console Setup... lb # [ 15.986919] dhcpcd[651]: eth0: soliciting an IPv6 router lb # [ 15.988647] dhcpcd[651]: eth0: Router Advertisement from fe80::2 lb # [ 15.989760] dhcpcd[651]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 15.996576] dhcpcd[651]: eth0: adding route to fec0::/64 lb # [ 15.997621] systemd-logind[520]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 15.998827] dhcpcd[651]: eth0: adding default route via fe80::2 lb # [ 16.072143] postgresql-pre-start[678]: running bootstrap script ... ok lb # [ 16.365553] systemd-vconsole-setup[789]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 16.370628] systemd[1]: Finished Virtual Console Setup. lb # [ 16.771007] postgresql-pre-start[678]: performing post-bootstrap initialization ... ok lb # [ 16.918626] postgresql-pre-start[678]: syncing data to disk ... ok lb # [ 16.919674] postgresql-pre-start[678]: initdb: warning: enabling "trust" authentication for local connections lb # [ 16.922193] postgresql-pre-start[678]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 16.927825] postgresql-pre-start[678]: Success. You can now start the database server using: lb # [ 16.929864] postgresql-pre-start[678]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 17.062095] postgres[807]: [807] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 17.066356] postgres[807]: [807] LOG: listening on IPv6 address "::1", port 5432 lb # [ 17.067551] postgres[807]: [807] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 17.070310] postgres[807]: [807] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 17.083079] postgres[816]: [816] LOG: database system was shut down at 2026-09-21 10:42:25 GMT lb # [ 17.088161] postgres[807]: [807] LOG: database system is ready to accept connections lb # [ 17.093573] systemd[1]: Started PostgreSQL Server. lb # [ 17.099354] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 17.362129] postgresql-setup-start[827]: CREATE DATABASE lb # [ 17.412998] postgresql-setup-start[841]: CREATE ROLE lb # [ 17.436659] postgresql-setup-start[843]: ALTER DATABASE lb # [ 17.443330] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 17.445100] systemd[1]: Reached target PostgreSQL. worker1 # [ 18.560579] dhcpcd[644]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 18.564446] dhcpcd[644]: eth0: adding route to 10.0.2.0/24 worker1 # [ 18.566966] dhcpcd[644]: eth0: adding default route via 10.0.2.2 worker1 # [ 18.722873] systemd[1]: Started DHCP Client. worker1 # [ 18.724701] systemd[1]: Reached target Multi-User System. worker1 # [ 18.726180] systemd[1]: Startup finished in 985ms (kernel) + 5.269s (initrd) + 12.470s (userspace) = 18.725s. client # [ 18.912622] dhcpcd[540]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 18.916245] dhcpcd[540]: eth0: adding route to 10.0.2.0/24 client # [ 18.918548] dhcpcd[540]: eth0: adding default route via 10.0.2.2 client # [ 19.112171] systemd[1]: Started DHCP Client. client # [ 19.114683] systemd[1]: Reached target Multi-User System. client # [ 19.116323] systemd[1]: Startup finished in 978ms (kernel) + 5.346s (initrd) + 12.791s (userspace) = 19.115s. worker2 # [ 19.397162] dhcpcd[626]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 19.401477] dhcpcd[626]: eth0: adding route to 10.0.2.0/24 worker2 # [ 19.404563] dhcpcd[626]: eth0: adding default route via 10.0.2.2 worker2 # [ 19.555594] systemd[1]: Started DHCP Client. worker2 # [ 19.557998] systemd[1]: Reached target Multi-User System. worker2 # [ 19.558893] systemd[1]: Startup finished in 977ms (kernel) + 4.709s (initrd) + 13.871s (userspace) = 19.557s. lb # [ 20.489051] dhcpcd[651]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 20.493084] dhcpcd[651]: eth0: adding route to 10.0.2.0/24 lb # [ 20.495403] dhcpcd[651]: eth0: adding default route via 10.0.2.2 lb # [ 20.686196] systemd[1]: Started DHCP Client. lb # [ 20.689710] systemd[1]: Reached target Network is Online. lb # [ 20.692952] systemd[1]: Started Envoy reverse proxy. lb # [ 20.697217] systemd[1]: Started mock-oidc.service. lb # [ 20.791469] mock-oidc-server[935]: Mock OIDC Server running lb # [ 20.792779] mock-oidc-server[935]: OIDC Address: 192.168.1.2:8080 lb # [ 20.793883] mock-oidc-server[935]: Issue Address: 0.0.0.0:8081 lb # [ 20.794968] mock-oidc-server[935]: Issuer: http://192.168.1.2:8080/oidc lb # [ 20.796167] mock-oidc-server[935]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 20.797642] mock-oidc-server[935]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 20.799317] mock-oidc-server[935]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 21.435080] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 21.435242] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 21.435279] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 21.435312] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 21.458914] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 21.464087] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 21.467501] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 21.472249] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 21.474356] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 21.476418] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 21.479156] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 21.510601] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 21.513777] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 21.521223] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 21.524096] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 21.526197] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 21.528086] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 21.531161] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 21.533689] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 21.540365] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 21.549349] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 21.551951] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 21.555164] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 21.560783] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 21.562747] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 21.565927] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 21.568519] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 21.571311] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 21.575921] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 21.577960] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 21.580838] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 21.585127] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 21.587064] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 21.594430] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 21.601373] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 21.605235] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 21.610736] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 21.614964] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 21.618500] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 21.620593] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 21.627908] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 21.631548] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 21.634582] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 21.636845] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 21.639886] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 21.643103] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 21.644889] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 21.649930] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 21.658910] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 21.661443] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 21.663400] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 21.666550] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 21.669235] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 21.673698] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 21.675858] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 21.677797] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 21.681555] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 21.683800] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 21.688255] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 21.690484] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 21.693381] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 21.698328] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 21.700674] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 21.702875] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 21.708344] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 21.711436] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 21.714079] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 21.716925] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 21.720865] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 21.724592] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 21.726595] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 21.730677] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 21.733063] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 21.736664] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 21.741724] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 21.747714] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 21.754444] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 21.757327] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 21.759812] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 21.763552] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 21.768842] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 21.771299] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 21.774045] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 21.789308] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 21.791088] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 21.794450] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 21.797199] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 21.799110] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 21.802065] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 21.806868] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 21.810546] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 21.814681] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 21.817746] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 21.821166] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 21.823776] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 21.827727] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 21.829896] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 21.833665] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 21.836064] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 21.838271] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 21.841283] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 21.853138] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 21.854920] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 21.857888] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 21.859711] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 21.862185] envoy[934]: [2026-09-21 10:42:30.021][934][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 21.864739] envoy[934]: [2026-09-21 10:42:30.042][934][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 21.868141] envoy[934]: [2026-09-21 10:42:30.044][934][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 21.885097] envoy[934]: [2026-09-21 10:42:30.044][934][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 21.889435] envoy[934]: [2026-09-21 10:42:30.044][934][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 21.899535] envoy[934]: [2026-09-21 10:42:30.044][934][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 21.906187] envoy[934]: [2026-09-21 10:42:30.298][934][info][main] [source/server/server.cc:968] runtime: {} lb # [ 21.907654] envoy[934]: [2026-09-21 10:42:30.311][934][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 21.909815] envoy[934]: [2026-09-21 10:42:30.311][934][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 21.911813] envoy[934]: [2026-09-21 10:42:30.311][934][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 21.915380] envoy[934]: [2026-09-21 10:42:30.317][934][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 21.917385] envoy[934]: [2026-09-21 10:42:30.317][934][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 21.919074] envoy[934]: [2026-09-21 10:42:30.317][934][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 21.934560] envoy[934]: [2026-09-21 10:42:30.521][934][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker2 # [ 21.947613] systemd[1]: Reached target Network is Online. worker1 # [ 21.950751] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 21.945211] envoy[934]: [2026-09-21 10:42:30.532][934][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker2 # [ 21.959508] systemd[1]: Starting scheduler-token.service... lb # [ 21.948284] envoy[934]: [2026-09-21 10:42:30.534][934][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 21.952973] envoy[934]: [2026-09-21 10:42:30.534][934][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 22.080589] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 22.087716] systemd[1]: Finished scheduler-token.service. worker2 # [ 22.089673] systemd[1]: scheduler-token.service: Consumed 54ms CPU time over 124ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 22.097036] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 22.198990] nix-grpc-daemon[775]: ts=2026-09-21T10:42:30Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 22.211360] nix-grpc-daemon[775]: ts=2026-09-21T10:42:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 22.213719] nix-grpc-daemon[775]: ts=2026-09-21T10:42:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 22.255353] nix-grpc-daemon[775]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 22.260057] nix-grpc-daemon[775]: E0000 00:00:1789987350.841715 775 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 22.274177] nix-grpc-daemon[775]: E0000 00:00:1789987350.860522 775 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 22.280629] nix-grpc-daemon[775]: ts=2026-09-21T10:42:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 22.282517] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 22.315719] nix-grpc-daemon[779]: ts=2026-09-21T10:42:30Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" lb # [ 22.313050] envoy[934]: [2026-09-21 10:42:30.899][934][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization worker1 # [ 22.323422] nix-grpc-daemon[775]: E0000 00:00:1789987350.908686 816 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 22.327725] nix-grpc-daemon[779]: ts=2026-09-21T10:42:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 22.330361] nix-grpc-daemon[779]: ts=2026-09-21T10:42:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 22.318457] envoy[934]: [2026-09-21 10:42:30.899][934][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 22.325343] envoy[934]: [2026-09-21 10:42:30.899][934][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker1 # [ 22.343945] nix-grpc-daemon[775]: E0000 00:00:1789987350.930462 816 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 22.335380] envoy[934]: [2026-09-21 10:42:30.922][934][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 22.348052] nix-grpc-daemon[775]: E0000 00:00:1789987350.933997 816 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 22.366532] nix-grpc-daemon[779]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 22.368374] nix-grpc-daemon[779]: E0000 00:00:1789987350.961424 779 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 22.367032] nix-grpc-daemon[775]: E0000 00:00:1789987350.952469 816 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 22.381866] nix-grpc-daemon[779]: E0000 00:00:1789987350.976812 779 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 22.381810] nix-grpc-daemon[775]: ts=2026-09-21T10:42:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.385580] nix-grpc-daemon[779]: ts=2026-09-21T10:42:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 22.387288] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 22.385595] nix-grpc-daemon[775]: ts=2026-09-21T10:42:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.423069] nix-grpc-daemon[779]: E0000 00:00:1789987351.016894 820 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 22.442084] nix-grpc-daemon[779]: E0000 00:00:1789987351.036988 820 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 22.448179] nix-grpc-daemon[779]: E0000 00:00:1789987351.040111 820 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 22.465162] nix-grpc-daemon[779]: E0000 00:00:1789987351.059303 820 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 22.479211] nix-grpc-daemon[779]: ts=2026-09-21T10:42:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.481011] nix-grpc-daemon[779]: ts=2026-09-21T10:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.587052] nix-grpc-daemon[775]: ts=2026-09-21T10:42:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.592837] nix-grpc-daemon[775]: ts=2026-09-21T10:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.682550] nix-grpc-daemon[779]: ts=2026-09-21T10:42:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.687783] nix-grpc-daemon[779]: ts=2026-09-21T10:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.793609] nix-grpc-daemon[775]: ts=2026-09-21T10:42:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.798691] nix-grpc-daemon[775]: ts=2026-09-21T10:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.888843] nix-grpc-daemon[779]: ts=2026-09-21T10:42:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.893895] nix-grpc-daemon[779]: ts=2026-09-21T10:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.999623] nix-grpc-daemon[775]: ts=2026-09-21T10:42:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.004813] nix-grpc-daemon[775]: ts=2026-09-21T10:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.095002] nix-grpc-daemon[779]: ts=2026-09-21T10:42:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.100157] nix-grpc-daemon[779]: ts=2026-09-21T10:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.207448] nix-grpc-daemon[775]: ts=2026-09-21T10:42:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.211597] nix-grpc-daemon[775]: ts=2026-09-21T10:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.301153] nix-grpc-daemon[779]: ts=2026-09-21T10:42:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.305810] nix-grpc-daemon[779]: ts=2026-09-21T10:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.408059] nix-grpc-daemon[775]: ts=2026-09-21T10:42:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.412985] nix-grpc-daemon[775]: ts=2026-09-21T10:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.508768] nix-grpc-daemon[779]: ts=2026-09-21T10:42:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.512790] nix-grpc-daemon[779]: ts=2026-09-21T10:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.613679] nix-grpc-daemon[775]: ts=2026-09-21T10:42:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.618743] nix-grpc-daemon[775]: ts=2026-09-21T10:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.709394] nix-grpc-daemon[779]: ts=2026-09-21T10:42:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.714384] nix-grpc-daemon[779]: ts=2026-09-21T10:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.819643] nix-grpc-daemon[775]: ts=2026-09-21T10:42:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.824773] nix-grpc-daemon[775]: ts=2026-09-21T10:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.915612] nix-grpc-daemon[779]: ts=2026-09-21T10:42:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.920700] nix-grpc-daemon[779]: ts=2026-09-21T10:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.025555] nix-grpc-daemon[775]: ts=2026-09-21T10:42:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.030612] nix-grpc-daemon[775]: ts=2026-09-21T10:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.121881] nix-grpc-daemon[779]: ts=2026-09-21T10:42:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.126890] nix-grpc-daemon[779]: ts=2026-09-21T10:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.232757] nix-grpc-daemon[775]: ts=2026-09-21T10:42:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.235449] nix-grpc-daemon[775]: ts=2026-09-21T10:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.327963] nix-grpc-daemon[779]: ts=2026-09-21T10:42:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.332633] nix-grpc-daemon[779]: ts=2026-09-21T10:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.433658] nix-grpc-daemon[775]: ts=2026-09-21T10:42:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.438795] nix-grpc-daemon[775]: ts=2026-09-21T10:42:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.535325] nix-grpc-daemon[779]: ts=2026-09-21T10:42:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.539541] nix-grpc-daemon[779]: ts=2026-09-21T10:42:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.639645] nix-grpc-daemon[775]: ts=2026-09-21T10:42:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.644843] nix-grpc-daemon[775]: ts=2026-09-21T10:42:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.736477] nix-grpc-daemon[779]: ts=2026-09-21T10:42:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.741475] nix-grpc-daemon[779]: ts=2026-09-21T10:42:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.845648] nix-grpc-daemon[775]: ts=2026-09-21T10:42:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.850681] nix-grpc-daemon[775]: ts=2026-09-21T10:42:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.942638] nix-grpc-daemon[779]: ts=2026-09-21T10:42:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.947717] nix-grpc-daemon[779]: ts=2026-09-21T10:42:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.051601] nix-grpc-daemon[775]: ts=2026-09-21T10:42:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.056831] nix-grpc-daemon[775]: ts=2026-09-21T10:42:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.148943] nix-grpc-daemon[779]: ts=2026-09-21T10:42:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.153910] nix-grpc-daemon[779]: ts=2026-09-21T10:42:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.259505] nix-grpc-daemon[775]: ts=2026-09-21T10:42:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.263817] nix-grpc-daemon[775]: ts=2026-09-21T10:42:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.355201] nix-grpc-daemon[779]: ts=2026-09-21T10:42:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.360555] nix-grpc-daemon[779]: ts=2026-09-21T10:42:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.460242] nix-grpc-daemon[775]: ts=2026-09-21T10:42:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.465523] nix-grpc-daemon[775]: ts=2026-09-21T10:42:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.563529] nix-grpc-daemon[779]: ts=2026-09-21T10:42:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.567757] nix-grpc-daemon[779]: ts=2026-09-21T10:42:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.666268] nix-grpc-daemon[775]: ts=2026-09-21T10:42:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.669564] nix-grpc-daemon[775]: ts=2026-09-21T10:42:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.764356] nix-grpc-daemon[779]: ts=2026-09-21T10:42:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.769386] nix-grpc-daemon[779]: ts=2026-09-21T10:42:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.870566] nix-grpc-daemon[775]: ts=2026-09-21T10:42:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.875794] nix-grpc-daemon[775]: ts=2026-09-21T10:42:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.970870] nix-grpc-daemon[779]: ts=2026-09-21T10:42:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.976106] nix-grpc-daemon[779]: ts=2026-09-21T10:42:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.076673] nix-grpc-daemon[775]: ts=2026-09-21T10:42:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.081732] nix-grpc-daemon[775]: ts=2026-09-21T10:42:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.177135] nix-grpc-daemon[779]: ts=2026-09-21T10:42:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.182232] nix-grpc-daemon[779]: ts=2026-09-21T10:42:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.284515] nix-grpc-daemon[775]: ts=2026-09-21T10:42:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.289310] nix-grpc-daemon[775]: ts=2026-09-21T10:42:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.383440] nix-grpc-daemon[779]: ts=2026-09-21T10:42:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.389219] nix-grpc-daemon[779]: ts=2026-09-21T10:42:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.484664] nix-grpc-daemon[775]: ts=2026-09-21T10:42:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.489752] nix-grpc-daemon[775]: ts=2026-09-21T10:42:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.592252] nix-grpc-daemon[779]: ts=2026-09-21T10:42:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.596347] nix-grpc-daemon[779]: ts=2026-09-21T10:42:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.690657] nix-grpc-daemon[775]: ts=2026-09-21T10:42:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.695609] nix-grpc-daemon[775]: ts=2026-09-21T10:42:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.793031] nix-grpc-daemon[779]: ts=2026-09-21T10:42:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.798451] nix-grpc-daemon[779]: ts=2026-09-21T10:42:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.896492] nix-grpc-daemon[775]: ts=2026-09-21T10:42:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.901206] nix-grpc-daemon[775]: ts=2026-09-21T10:42:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.999703] nix-grpc-daemon[779]: ts=2026-09-21T10:42:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.005142] nix-grpc-daemon[779]: ts=2026-09-21T10:42:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.102121] nix-grpc-daemon[775]: ts=2026-09-21T10:42:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.107321] nix-grpc-daemon[775]: ts=2026-09-21T10:42:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.206674] nix-grpc-daemon[779]: ts=2026-09-21T10:42:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.212164] nix-grpc-daemon[779]: ts=2026-09-21T10:42:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.309706] nix-grpc-daemon[775]: ts=2026-09-21T10:42:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.313659] nix-grpc-daemon[775]: ts=2026-09-21T10:42:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.413175] nix-grpc-daemon[779]: ts=2026-09-21T10:42:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.418292] nix-grpc-daemon[779]: ts=2026-09-21T10:42:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.510253] nix-grpc-daemon[775]: ts=2026-09-21T10:42:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.515419] nix-grpc-daemon[775]: ts=2026-09-21T10:42:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.621144] nix-grpc-daemon[779]: ts=2026-09-21T10:42:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.625974] nix-grpc-daemon[779]: ts=2026-09-21T10:42:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.715919] nix-grpc-daemon[775]: ts=2026-09-21T10:42:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.720953] nix-grpc-daemon[775]: ts=2026-09-21T10:42:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.826937] nix-grpc-daemon[779]: ts=2026-09-21T10:42:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.832116] nix-grpc-daemon[779]: ts=2026-09-21T10:42:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.921770] nix-grpc-daemon[775]: ts=2026-09-21T10:42:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.926791] nix-grpc-daemon[775]: ts=2026-09-21T10:42:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.033510] nix-grpc-daemon[779]: ts=2026-09-21T10:42:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.038449] nix-grpc-daemon[779]: ts=2026-09-21T10:42:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.127590] nix-grpc-daemon[775]: ts=2026-09-21T10:42:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.132705] nix-grpc-daemon[775]: ts=2026-09-21T10:42:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.239596] nix-grpc-daemon[779]: ts=2026-09-21T10:42:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.244632] nix-grpc-daemon[779]: ts=2026-09-21T10:42:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.334983] nix-grpc-daemon[775]: ts=2026-09-21T10:42:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.339090] nix-grpc-daemon[775]: ts=2026-09-21T10:42:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.445755] nix-grpc-daemon[779]: ts=2026-09-21T10:42:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.450436] nix-grpc-daemon[779]: ts=2026-09-21T10:42:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.535356] nix-grpc-daemon[775]: ts=2026-09-21T10:42:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.540627] nix-grpc-daemon[775]: ts=2026-09-21T10:42:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.653328] nix-grpc-daemon[779]: ts=2026-09-21T10:42:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.657714] nix-grpc-daemon[779]: ts=2026-09-21T10:42:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.741400] nix-grpc-daemon[775]: ts=2026-09-21T10:42:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.746580] nix-grpc-daemon[775]: ts=2026-09-21T10:42:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.858953] nix-grpc-daemon[779]: ts=2026-09-21T10:42:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.864305] nix-grpc-daemon[779]: ts=2026-09-21T10:42:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.947424] nix-grpc-daemon[775]: ts=2026-09-21T10:42:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.953656] nix-grpc-daemon[775]: ts=2026-09-21T10:42:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.065316] nix-grpc-daemon[779]: ts=2026-09-21T10:42:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.070443] nix-grpc-daemon[779]: ts=2026-09-21T10:42:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.153744] nix-grpc-daemon[775]: ts=2026-09-21T10:42:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.159061] nix-grpc-daemon[775]: ts=2026-09-21T10:42:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 29.227267] rustfs-bucket-start[1016]: mb s3://farm lb # [ 29.241005] systemd[1]: Finished rustfs-bucket.service. lb # [ 29.252696] systemd[1]: Starting niks3 server... worker2 # [ 29.271253] nix-grpc-daemon[779]: ts=2026-09-21T10:42:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.274578] nix-grpc-daemon[779]: ts=2026-09-21T10:42:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.361399] nix-grpc-daemon[775]: ts=2026-09-21T10:42:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.365564] nix-grpc-daemon[775]: ts=2026-09-21T10:42:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.475658] nix-grpc-daemon[779]: ts=2026-09-21T10:42:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.480993] nix-grpc-daemon[779]: ts=2026-09-21T10:42:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 29.508414] postgres[1032]: [1032] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 29.509704] postgres[1032]: [1032] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 29.542641] niks3-server[1025]: 2026/09/21 10:42:38 OK 20241026095416_initial_model.sql (19.76ms) lb # [ 29.545948] niks3-server[1025]: 2026/09/21 10:42:38 OK 20251210153512_drop_unused_gin_index.sql (3.61ms) lb # [ 29.551506] niks3-server[1025]: 2026/09/21 10:42:38 OK 20251218171726_add_pins.sql (5.57ms) worker1 # [ 29.561716] nix-grpc-daemon[775]: ts=2026-09-21T10:42:38Z level=info event=scheduler_connected addr=lb:50051 lb # [ 29.557255] niks3-server[1025]: 2026/09/21 10:42:38 OK 20260628120000_add_object_size_and_stats.sql (4.38ms) lb # [ 29.562264] niks3-server[1025]: 2026/09/21 10:42:38 OK 20260905000000_add_claims.sql (4.98ms) worker1 # [ 29.566881] nix-grpc-daemon[775]: ts=2026-09-21T10:42:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 29.566846] niks3-server[1025]: 2026/09/21 10:42:38 OK 20260920000000_drop_claims.sql (4.41ms) lb # [ 29.568698] niks3-server[1025]: 2026/09/21 10:42:38 goose: successfully migrated database to version: 20260920000000 lb # [ 29.573274] niks3-server[1025]: 2026/09/21 10:42:38 OK 1_commit_pending_closure.sql (6.43ms) lb # [ 29.575909] niks3-server[1025]: 2026/09/21 10:42:38 OK 2_object_stats_trigger.sql (2.51ms) lb # [ 29.577463] niks3-server[1025]: 2026/09/21 10:42:38 goose: up to current file version: 2 lb # [ 29.581258] niks3-server[1025]: 2026/09/21 10:42:38 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key lb # [ 29.629217] niks3-server[1025]: 2026/09/21 10:42:38 INFO Read proxy enabled — serving cache objects from S3 lb # [ 29.630781] niks3-server[1025]: 2026/09/21 10:42:38 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 29.634774] niks3-server[1025]: 2026/09/21 10:42:38 INFO systemd watchdog enabled interval=15s lb # [ 29.635946] niks3-server[1025]: 2026/09/21 10:42:38 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 29.640203] systemd[1]: Started niks3 server. lb # [ 29.641372] systemd[1]: Reached target Multi-User System. lb # [ 29.642632] systemd[1]: Startup finished in 986ms (kernel) + 4.690s (initrd) + 23.962s (userspace) = 29.639s. lb # [ 29.646568] niks3-server[1025]: 2026/09/21 10:42:38 INFO lead: acquired remote=192.168.1.4:60488 worker2 # [ 29.661407] nix-grpc-daemon[779]: ts=2026-09-21T10:42:38Z level=info event=scheduler_take_over worker2 # [ 29.682036] nix-grpc-daemon[779]: ts=2026-09-21T10:42:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.687013] nix-grpc-daemon[779]: ts=2026-09-21T10:42:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.767816] nix-grpc-daemon[775]: ts=2026-09-21T10:42:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.772877] nix-grpc-daemon[775]: ts=2026-09-21T10:42:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 14.83 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds) lb: waiting for unit envoy.service worker2 # [ 29.888300] nix-grpc-daemon[779]: ts=2026-09-21T10:42:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.893278] nix-grpc-daemon[779]: ts=2026-09-21T10:42:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit envoy.service, in 0.06 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 29.945520] envoy[934]: conn peer=[::1]:49966 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=4 lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds) worker1 # [ 29.974785] nix-grpc-daemon[775]: ts=2026-09-21T10:42:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.980795] nix-grpc-daemon[775]: ts=2026-09-21T10:42:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.094560] nix-grpc-daemon[779]: ts=2026-09-21T10:42:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.101235] nix-grpc-daemon[779]: ts=2026-09-21T10:42:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.152901] systemd[1]: Starting scheduler-token.service... worker1 # [ 30.175846] nix-grpc-daemon[775]: ts=2026-09-21T10:42:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.181113] nix-grpc-daemon[775]: ts=2026-09-21T10:42:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.249577] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 30.254745] systemd[1]: Finished scheduler-token.service. worker2 # [ 30.255883] systemd[1]: scheduler-token.service: Consumed 37ms CPU time over 100ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 30.300770] nix-grpc-daemon[779]: ts=2026-09-21T10:42:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.304496] nix-grpc-daemon[779]: ts=2026-09-21T10:42:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 30.383453] nix-grpc-daemon[775]: ts=2026-09-21T10:42:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.387658] nix-grpc-daemon[775]: ts=2026-09-21T10:42:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 30.505731] nix-grpc-daemon[779]: ts=2026-09-21T10:42:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.527235] nix-grpc-daemon[779]: ts=2026-09-21T10:42:39Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 30.531658] nix-grpc-daemon[779]: ts=2026-09-21T10:42:39Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:47716 worker2 # [ 30.537004] nix-grpc-daemon[779]: ts=2026-09-21T10:42:39Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 30.583738] nix-grpc-daemon[775]: ts=2026-09-21T10:42:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.586957] nix-grpc-daemon[779]: ts=2026-09-21T10:42:39Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:47716 worker2 # [ 30.591907] nix-grpc-daemon[779]: ts=2026-09-21T10:42:39Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 1.95 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 32.657667] nix-grpc-daemon[775]: ts=2026-09-21T10:42:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 32.669947] systemd[1]: Started Nix Daemon. worker1 # [ 32.946082] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 32.970018] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 100 ms (attempt 1/5) worker1 # [ 33.072760] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 189 ms (attempt 2/5) worker1 # [ 33.262271] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 368 ms (attempt 3/5) worker1 # [ 33.630703] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 289 ms (attempt 4/5) worker1 # [ 33.930465] nix-grpc-daemon[775]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 33.937575] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 33.961745] nix-grpc-daemon[775]: ts=2026-09-21T10:42:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 33.976275] nix-grpc-daemon[775]: ts=2026-09-21T10:42:42Z level=debug event=path_info_miss path=llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test error="error: path '/nix/store/llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 34.004930] nix-grpc-daemon[779]: ts=2026-09-21T10:42:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 34.016998] systemd[1]: Started Nix Daemon. worker2 # [ 34.311970] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 34.333777] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 80 ms (attempt 1/5) worker2 # [ 34.418291] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 2/5) worker2 # [ 34.510849] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 203 ms (attempt 3/5) worker2 # [ 34.721295] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 225 ms (attempt 4/5) worker2 # [ 34.955749] nix-grpc-daemon[779]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 34.961400] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 34.974037] nix-grpc-daemon[779]: ts=2026-09-21T10:42:43Z level=debug event=path_info_miss path=llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test error="error: path '/nix/store/llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds) client: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds) worker1 # [ 35.433507] nix-grpc-daemon[775]: ts=2026-09-21T10:42:44Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 35.438208] nix-grpc-daemon[775]: ts=2026-09-21T10:42:44Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:37950 worker1 # [ 35.452323] nix-grpc-daemon[775]: ts=2026-09-21T10:42:44Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:37950 worker1 # [ 35.463427] nix-grpc-daemon[775]: ts=2026-09-21T10:42:44Z level=debug event=path_info_miss path=llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test error="error: path '/nix/store/llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 35.477636] nix-grpc-daemon[775]: ts=2026-09-21T10:42:44Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:37950 worker1 # [ 35.485604] nix-grpc-daemon[775]: ts=2026-09-21T10:42:44Z level=debug event=path_info_miss path=llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test error="error: path '/nix/store/llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds) worker1 # [ 35.834789] nix-grpc-daemon[775]: ts=2026-09-21T10:42:44Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 36.099371] nix-grpc-daemon[779]: ts=2026-09-21T10:42:44Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.82 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 36.359524] nix-grpc-daemon[775]: ts=2026-09-21T10:42:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37950 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 36.372281] nix-grpc-daemon[775]: ts=2026-09-21T10:42:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37950 worker2 # [ 36.410597] nix-grpc-daemon[779]: ts=2026-09-21T10:42:45Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 36.417803] nix-grpc-daemon[779]: ts=2026-09-21T10:42:45Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 36.469412] nix-grpc-daemon[779]: ts=2026-09-21T10:42:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 36.491549] nix-grpc-daemon[779]: ts=2026-09-21T10:42:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56686 client # copying 1 paths to 'lb:50051'... worker2 # [ 36.506885] nix-grpc-daemon[779]: ts=2026-09-21T10:42:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker2 # [ 36.533124] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 36.567628] nix-grpc-daemon[779]: ts=2026-09-21T10:42:45Z level=info event=niks3_push_started pid=878 worker2 # [ 36.862756] nix-grpc-daemon[878]: time=2026-09-21T10:42:45.456Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 37.052795] nix-daemon[863]: accepted connection from pid 891, user nix-grpc-daemon (trusted) worker2 # [ 37.073586] nix-daemon[863]: reaped child process 894, status = succeeded worker2 # [ 37.283114] nix-daemon[863]: accepted connection from pid 896, user nix-grpc-daemon (trusted) worker2 # [ 37.303648] nix-daemon[863]: reaped child process 899, status = succeeded lb # [ 37.310031] niks3-server[1025]: 2026/09/21 10:42:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 37.355978] nix-grpc-daemon[878]: time=2026-09-21T10:42:45.950Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 37.359384] nix-grpc-daemon[878]: time=2026-09-21T10:42:45.951Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 37.406142] niks3-server[1025]: 2026/09/21 10:42:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 37.415720] niks3-server[1025]: 2026/09/21 10:42:46 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 37.445313] niks3-server[1025]: 2026/09/21 10:42:46 INFO Signed narinfos id=1 count=1 worker2 # [ 37.458494] nix-grpc-daemon[878]: time=2026-09-21T10:42:46.052Z level=INFO msg="Uploading 1 narinfos" lb # [ 37.468376] niks3-server[1025]: 2026/09/21 10:42:46 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 37.476907] niks3-server[1025]: 2026/09/21 10:42:46 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 37.485480] niks3-server[1025]: 2026/09/21 10:42:46 INFO Completed upload id=1 worker2 # [ 37.495457] nix-grpc-daemon[878]: time=2026-09-21T10:42:46.090Z level=INFO msg="Upload complete. (624ms)" lb # [ 37.494134] niks3-server[1025]: 2026/09/21 10:42:46 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo worker2 # [ 37.513316] nix-grpc-daemon[779]: ts=2026-09-21T10:42:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=0 paths=1 nar_bytes_in=504 worker2 # [ 37.532612] nix-grpc-daemon[779]: ts=2026-09-21T10:42:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 37.550429] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 37.561906] nix-daemon[863]: reaped child process 876, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker2 # [ 37.580577] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker2 # [ 38.841560] nix-daemon[863]: reaped child process 903, status = succeeded worker2 # [ 39.076101] nix-daemon[863]: accepted connection from pid 919, user nix-grpc-daemon (trusted) worker2 # [ 39.095481] nix-daemon[863]: reaped child process 922, status = succeeded lb # [ 39.102756] niks3-server[1025]: 2026/09/21 10:42:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 39.139136] nix-grpc-daemon[878]: time=2026-09-21T10:42:47.733Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 39.143008] nix-grpc-daemon[878]: time=2026-09-21T10:42:47.736Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 39.193035] niks3-server[1025]: 2026/09/21 10:42:47 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 39.204494] niks3-server[1025]: 2026/09/21 10:42:47 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 39.215778] niks3-server[1025]: 2026/09/21 10:42:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign worker2 # [ 39.230755] nix-grpc-daemon[878]: time=2026-09-21T10:42:47.825Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.222699] niks3-server[1025]: 2026/09/21 10:42:47 INFO Signed narinfos id=2 count=1 lb # [ 39.227520] niks3-server[1025]: 2026/09/21 10:42:47 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 39.242634] niks3-server[1025]: 2026/09/21 10:42:47 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete worker2 # [ 39.262873] nix-grpc-daemon[878]: time=2026-09-21T10:42:47.857Z level=INFO msg="Upload complete. (461ms)" lb # [ 39.253397] niks3-server[1025]: 2026/09/21 10:42:47 INFO Completed upload id=2 lb # [ 39.259317] niks3-server[1025]: 2026/09/21 10:42:47 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker2 # [ 39.271010] nix-grpc-daemon[779]: ts=2026-09-21T10:42:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker2 # [ 39.284972] nix-grpc-daemon[779]: ts=2026-09-21T10:42:47Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker2 # [ 39.287378] nix-grpc-daemon[779]: ts=2026-09-21T10:42:47Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 39.289849] nix-daemon[863]: reaped child process 901, status = succeeded worker2 # [ 39.334007] nix-grpc-daemon[779]: ts=2026-09-21T10:42:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 39.351801] nix-grpc-daemon[779]: ts=2026-09-21T10:42:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 39.369419] nix-grpc-daemon[878]: time=2026-09-21T10:42:47.964Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker2 # [ 39.382653] nix-grpc-daemon[779]: ts=2026-09-21T10:42:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 39.411772] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 39.653597] nix-daemon[863]: accepted connection from pid 929, user nix-grpc-daemon (trusted) worker2 # [ 39.675340] nix-daemon[863]: reaped child process 933, status = succeeded worker2 # [ 39.873229] nix-daemon[863]: accepted connection from pid 935, user nix-grpc-daemon (trusted) worker2 # [ 39.892276] nix-daemon[863]: reaped child process 938, status = succeeded lb # [ 39.896239] niks3-server[1025]: 2026/09/21 10:42:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 39.937381] nix-grpc-daemon[878]: time=2026-09-21T10:42:48.531Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 39.939532] nix-grpc-daemon[878]: time=2026-09-21T10:42:48.531Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 39.990928] niks3-server[1025]: 2026/09/21 10:42:48 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst lb # [ 40.001826] niks3-server[1025]: 2026/09/21 10:42:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign worker2 # [ 40.018470] nix-grpc-daemon[878]: time=2026-09-21T10:42:48.612Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.012743] niks3-server[1025]: 2026/09/21 10:42:48 INFO Signed narinfos id=3 count=1 lb # [ 40.023601] niks3-server[1025]: 2026/09/21 10:42:48 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 40.044098] niks3-server[1025]: 2026/09/21 10:42:48 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 40.052632] niks3-server[1025]: 2026/09/21 10:42:48 INFO Completed upload id=3 worker2 # [ 40.062505] nix-grpc-daemon[878]: time=2026-09-21T10:42:48.657Z level=INFO msg="Upload complete. (624ms)" lb # [ 40.054935] niks3-server[1025]: 2026/09/21 10:42:48 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker2 # [ 40.075203] nix-grpc-daemon[779]: ts=2026-09-21T10:42:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 40.089551] nix-grpc-daemon[779]: ts=2026-09-21T10:42:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 40.108160] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 40.124447] nix-daemon[863]: reaped child process 927, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... worker2 # [ 40.133908] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker2 # [ 41.189811] nix-daemon[863]: reaped child process 942, status = succeeded worker2 # [ 41.379873] nix-daemon[863]: accepted connection from pid 958, user nix-grpc-daemon (trusted) worker2 # [ 41.396124] nix-daemon[863]: reaped child process 961, status = succeeded lb # [ 41.399965] niks3-server[1025]: 2026/09/21 10:42:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 41.423746] nix-grpc-daemon[878]: time=2026-09-21T10:42:50.017Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 41.426655] nix-grpc-daemon[878]: time=2026-09-21T10:42:50.017Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 41.441826] niks3-server[1025]: 2026/09/21 10:42:50 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 41.455737] niks3-server[1025]: 2026/09/21 10:42:50 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker2 # [ 41.475320] nix-grpc-daemon[878]: time=2026-09-21T10:42:50.069Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.465304] niks3-server[1025]: 2026/09/21 10:42:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 41.473246] niks3-server[1025]: 2026/09/21 10:42:50 INFO Signed narinfos id=4 count=1 lb # [ 41.475948] niks3-server[1025]: 2026/09/21 10:42:50 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 41.484094] niks3-server[1025]: 2026/09/21 10:42:50 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 41.493431] niks3-server[1025]: 2026/09/21 10:42:50 INFO Completed upload id=4 worker2 # [ 41.503105] nix-grpc-daemon[878]: time=2026-09-21T10:42:50.098Z level=INFO msg="Upload complete. (349ms)" lb # [ 41.496419] niks3-server[1025]: 2026/09/21 10:42:50 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker2 # [ 41.524912] nix-grpc-daemon[779]: ts=2026-09-21T10:42:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker2 # [ 41.536414] nix-grpc-daemon[779]: ts=2026-09-21T10:42:50Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker2 # [ 41.541312] nix-grpc-daemon[779]: ts=2026-09-21T10:42:50Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 41.545374] nix-daemon[863]: reaped child process 940, status = succeeded worker2 # [ 41.566022] nix-grpc-daemon[779]: ts=2026-09-21T10:42:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 41.581842] nix-grpc-daemon[779]: ts=2026-09-21T10:42:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 41.596772] nix-grpc-daemon[878]: time=2026-09-21T10:42:50.191Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker2 # [ 41.606838] nix-grpc-daemon[779]: ts=2026-09-21T10:42:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 41.625304] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 41.820199] nix-daemon[863]: accepted connection from pid 967, user nix-grpc-daemon (trusted) worker2 # [ 41.838830] nix-daemon[863]: reaped child process 970, status = succeeded lb # [ 41.942179] envoy[934]: conn peer=[2001:db8:1::1]:39018 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=2373 lb # [ 41.947495] envoy[934]: conn peer=[2001:db8:1::1]:39024 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=387 ms=81 lb # [ 41.952958] envoy[934]: conn peer=[2001:db8:1::1]:39028 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=11 lb # [ 41.959071] envoy[934]: conn peer=[2001:db8:1::1]:39034 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=18 worker2 # [ 42.006788] nix-daemon[863]: accepted connection from pid 972, user nix-grpc-daemon (trusted) worker2 # [ 42.024263] nix-daemon[863]: reaped child process 975, status = succeeded lb # [ 42.026554] niks3-server[1025]: 2026/09/21 10:42:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 42.045354] nix-grpc-daemon[878]: time=2026-09-21T10:42:50.640Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 42.047266] nix-grpc-daemon[878]: time=2026-09-21T10:42:50.642Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 42.058913] niks3-server[1025]: 2026/09/21 10:42:50 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 42.071082] niks3-server[1025]: 2026/09/21 10:42:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign worker2 # [ 42.086998] nix-grpc-daemon[878]: time=2026-09-21T10:42:50.681Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.081822] niks3-server[1025]: 2026/09/21 10:42:50 INFO Signed narinfos id=5 count=1 lb # [ 42.087687] niks3-server[1025]: 2026/09/21 10:42:50 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 42.098446] niks3-server[1025]: 2026/09/21 10:42:50 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete worker2 # [ 42.112001] nix-grpc-daemon[878]: time=2026-09-21T10:42:50.707Z level=INFO msg="Upload complete. (469ms)" lb # [ 42.105746] niks3-server[1025]: 2026/09/21 10:42:50 INFO Completed upload id=5 lb # [ 42.108609] niks3-server[1025]: 2026/09/21 10:42:50 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker2 # [ 42.124484] nix-grpc-daemon[779]: ts=2026-09-21T10:42:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 42.133332] nix-grpc-daemon[779]: ts=2026-09-21T10:42:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 42.140779] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 42.143269] nix-daemon[863]: reaped child process 965, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 42.155907] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker2 # [ 43.395611] nix-daemon[863]: reaped child process 979, status = succeeded worker2 # [ 43.575929] nix-daemon[863]: accepted connection from pid 996, user nix-grpc-daemon (trusted) worker2 # [ 43.594113] nix-daemon[863]: reaped child process 999, status = succeeded lb # [ 43.598016] niks3-server[1025]: 2026/09/21 10:42:52 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 43.619031] nix-grpc-daemon[878]: time=2026-09-21T10:42:52.212Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 43.620679] nix-grpc-daemon[878]: time=2026-09-21T10:42:52.212Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 43.635812] niks3-server[1025]: 2026/09/21 10:42:52 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst lb # [ 43.651281] niks3-server[1025]: 2026/09/21 10:42:52 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 43.675794] nix-grpc-daemon[878]: time=2026-09-21T10:42:52.270Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.661115] niks3-server[1025]: 2026/09/21 10:42:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 43.669792] niks3-server[1025]: 2026/09/21 10:42:52 INFO Signed narinfos id=6 count=1 lb # [ 43.674724] niks3-server[1025]: 2026/09/21 10:42:52 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 43.684296] niks3-server[1025]: 2026/09/21 10:42:52 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 43.690017] niks3-server[1025]: 2026/09/21 10:42:52 INFO Completed upload id=6 worker2 # [ 43.699758] nix-grpc-daemon[878]: time=2026-09-21T10:42:52.294Z level=INFO msg="Upload complete. (330ms)" lb # [ 43.692749] niks3-server[1025]: 2026/09/21 10:42:52 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo worker2 # [ 43.713163] nix-grpc-daemon[779]: ts=2026-09-21T10:42:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker2 # [ 43.730498] nix-daemon[863]: reaped child process 977, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.64 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.25 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.33 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.32 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker2 # [ 45.336779] nix-grpc-daemon[779]: ts=2026-09-21T10:42:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56686 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # [ 45.356877] nix-grpc-daemon[779]: ts=2026-09-21T10:42:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 45.367917] nix-grpc-daemon[878]: time=2026-09-21T10:42:53.962Z level=INFO msg="All 2 paths already cached" worker2 # [ 45.386239] nix-grpc-daemon[779]: ts=2026-09-21T10:42:53Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.37 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.49 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 46.413964] nix-grpc-daemon[775]: ts=2026-09-21T10:42:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 46.421524] nix-grpc-daemon[775]: ts=2026-09-21T10:42:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37950 worker2 # [ 46.453356] nix-grpc-daemon[779]: ts=2026-09-21T10:42:55Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker2 # [ 46.460854] nix-grpc-daemon[779]: ts=2026-09-21T10:42:55Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 46.510551] nix-grpc-daemon[779]: ts=2026-09-21T10:42:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 46.526400] nix-grpc-daemon[779]: ts=2026-09-21T10:42:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 46.542274] nix-grpc-daemon[878]: time=2026-09-21T10:42:55.136Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker2 # [ 46.552433] nix-grpc-daemon[779]: ts=2026-09-21T10:42:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 46.570565] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 46.778062] nix-daemon[863]: accepted connection from pid 1029, user nix-grpc-daemon (trusted) worker2 # [ 46.796995] nix-daemon[863]: reaped child process 1032, status = succeeded worker2 # [ 46.967051] nix-daemon[863]: accepted connection from pid 1034, user nix-grpc-daemon (trusted) worker2 # [ 46.983828] nix-daemon[863]: reaped child process 1037, status = succeeded lb # [ 46.990010] niks3-server[1025]: 2026/09/21 10:42:55 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 47.009167] nix-grpc-daemon[878]: time=2026-09-21T10:42:55.603Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 47.010636] nix-grpc-daemon[878]: time=2026-09-21T10:42:55.603Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 47.017270] niks3-server[1025]: 2026/09/21 10:42:55 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst worker2 # [ 47.040138] nix-grpc-daemon[878]: time=2026-09-21T10:42:55.634Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.031296] niks3-server[1025]: 2026/09/21 10:42:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 47.042543] niks3-server[1025]: 2026/09/21 10:42:55 INFO Signed narinfos id=7 count=1 lb # [ 47.046799] niks3-server[1025]: 2026/09/21 10:42:55 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 47.056288] niks3-server[1025]: 2026/09/21 10:42:55 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 47.063939] niks3-server[1025]: 2026/09/21 10:42:55 INFO Completed upload id=7 worker2 # [ 47.073555] nix-grpc-daemon[878]: time=2026-09-21T10:42:55.668Z level=INFO msg="Upload complete. (483ms)" lb # [ 47.067191] niks3-server[1025]: 2026/09/21 10:42:55 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker2 # [ 47.080125] nix-grpc-daemon[779]: ts=2026-09-21T10:42:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 47.092276] nix-grpc-daemon[779]: ts=2026-09-21T10:42:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 47.100221] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 47.102984] nix-daemon[863]: reaped child process 1027, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 47.114222] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker2 # [ 48.361512] nix-daemon[863]: reaped child process 1041, status = succeeded worker2 # [ 48.539148] nix-daemon[863]: accepted connection from pid 1057, user nix-grpc-daemon (trusted) worker2 # [ 48.555438] nix-daemon[863]: reaped child process 1060, status = succeeded lb # [ 48.561525] niks3-server[1025]: 2026/09/21 10:42:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 48.584046] nix-grpc-daemon[878]: time=2026-09-21T10:42:57.176Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 48.585500] nix-grpc-daemon[878]: time=2026-09-21T10:42:57.176Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 48.602658] niks3-server[1025]: 2026/09/21 10:42:57 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst worker2 # [ 48.626406] nix-grpc-daemon[878]: time=2026-09-21T10:42:57.221Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.620169] niks3-server[1025]: 2026/09/21 10:42:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 48.629000] niks3-server[1025]: 2026/09/21 10:42:57 INFO Signed narinfos id=8 count=1 lb # [ 48.631286] niks3-server[1025]: 2026/09/21 10:42:57 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 48.636234] niks3-server[1025]: 2026/09/21 10:42:57 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv lb # [ 48.646540] niks3-server[1025]: 2026/09/21 10:42:57 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 48.649732] niks3-server[1025]: 2026/09/21 10:42:57 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker2 # [ 48.659275] nix-grpc-daemon[878]: time=2026-09-21T10:42:57.254Z level=INFO msg="Upload complete. (332ms)" lb # [ 48.652331] niks3-server[1025]: 2026/09/21 10:42:57 INFO Completed upload id=8 worker2 # [ 48.672980] nix-grpc-daemon[779]: ts=2026-09-21T10:42:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker2 # [ 48.686358] nix-daemon[863]: reaped child process 1039, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.58 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.23 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.22 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 49.301767] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 3adf71e90b7c496884639d26143ec71f client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 49.571123] nix[879]: don't know how to build these paths: client # [ 49.572246] nix[879]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 49.517976] nix-grpc-daemon[775]: ts=2026-09-21T10:42:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37950 worker2 # [ 49.531778] nix-grpc-daemon[779]: ts=2026-09-21T10:42:58Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 49.538320] nix-grpc-daemon[779]: ts=2026-09-21T10:42:58Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 49.584879] nix-grpc-daemon[775]: ts=2026-09-21T10:42:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 49.604935] nix-grpc-daemon[775]: ts=2026-09-21T10:42:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37950 client # [ 49.672264] nix[879]: copying 1 paths to 'lb:50051'... worker1 # [ 49.619533] nix-grpc-daemon[775]: ts=2026-09-21T10:42:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37950 client # [ 49.674781] nix[879]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker1 # [ 49.635938] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 49.668339] nix-grpc-daemon[775]: ts=2026-09-21T10:42:58Z level=info event=niks3_push_started pid=868 worker1 # [ 49.934226] nix-grpc-daemon[868]: time=2026-09-21T10:42:58.518Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 50.125548] nix-daemon[839]: accepted connection from pid 881, user nix-grpc-daemon (trusted) worker1 # [ 50.144735] nix-daemon[839]: reaped child process 884, status = succeeded worker1 # [ 50.321454] nix-daemon[839]: accepted connection from pid 886, user nix-grpc-daemon (trusted) worker1 # [ 50.338599] nix-daemon[839]: reaped child process 889, status = succeeded lb # [ 50.343829] niks3-server[1025]: 2026/09/21 10:42:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 50.362102] nix-grpc-daemon[868]: time=2026-09-21T10:42:58.948Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 50.366143] nix-grpc-daemon[868]: time=2026-09-21T10:42:58.950Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" client # [ 50.419032] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: 5d52c945ce854b598c9d8ca60f95c5b7 lb # [ 50.384911] niks3-server[1025]: 2026/09/21 10:42:58 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds) lb # [ 50.398445] niks3-server[1025]: 2026/09/21 10:42:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign worker1 # [ 50.413392] nix-grpc-daemon[868]: time=2026-09-21T10:42:58.999Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.409306] niks3-server[1025]: 2026/09/21 10:42:58 INFO Signed narinfos id=9 count=1 lb # [ 50.417695] niks3-server[1025]: 2026/09/21 10:42:59 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 50.428355] niks3-server[1025]: 2026/09/21 10:42:59 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete worker1 # [ 50.444710] nix-grpc-daemon[868]: time=2026-09-21T10:42:59.031Z level=INFO msg="Upload complete. (502ms)" lb # [ 50.437428] niks3-server[1025]: 2026/09/21 10:42:59 INFO Completed upload id=9 worker1 # [ 50.452222] nix-grpc-daemon[775]: ts=2026-09-21T10:42:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37950 duration_s=0 paths=1 nar_bytes_in=432 lb # [ 50.441344] niks3-server[1025]: 2026/09/21 10:42:59 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker1 # [ 50.455631] nix-grpc-daemon[775]: ts=2026-09-21T10:42:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 50.465052] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 50.468825] nix-daemon[839]: reaped child process 866, status = succeeded client # [ 50.529696] nix[879]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker1 # [ 50.479395] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) lb # [ 51.942155] envoy[934]: conn peer=[2001:db8:1::1]:39038 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9549 tx=4100 ms=7379 lb # [ 51.947203] envoy[934]: conn peer=[2001:db8:1::1]:38862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=476 ms=73 lb # [ 51.952054] envoy[934]: conn peer=[2001:db8:1::1]:38876 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4215 tx=1825 ms=2270 worker1 # [ 52.114273] nix-grpc-daemon[775]: ts=2026-09-21T10:43:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37950 client # [ 52.179282] nix[895]: this derivation will be built: worker2 # [ 52.134188] nix-grpc-daemon[779]: ts=2026-09-21T10:43:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 52.148732] nix-grpc-daemon[779]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' from 'http://lb:5751'... client # [ 52.222584] nix[895]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 52.185994] nix-grpc-daemon[779]: ts=2026-09-21T10:43:00Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker1 # [ 52.192762] nix-grpc-daemon[775]: ts=2026-09-21T10:43:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37950 client # [ 52.250453] nix[895]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.07 seconds) worker1 # [ 55.109327] nix-daemon[839]: reaped child process 897, status = succeeded client: waiting for success: ! systemctl is-active dedup1 dedup2 worker1 # [ 55.267143] nix-daemon[839]: accepted connection from pid 927, user nix-grpc-daemon (trusted) worker1 # [ 55.284477] nix-daemon[839]: reaped child process 930, status = succeeded lb # [ 55.289260] niks3-server[1025]: 2026/09/21 10:43:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 55.308393] nix-grpc-daemon[868]: time=2026-09-21T10:43:03.894Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 55.310657] nix-grpc-daemon[868]: time=2026-09-21T10:43:03.894Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 55.336238] niks3-server[1025]: 2026/09/21 10:43:03 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 55.346869] niks3-server[1025]: 2026/09/21 10:43:03 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 55.357559] niks3-server[1025]: 2026/09/21 10:43:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 55.363418] niks3-server[1025]: 2026/09/21 10:43:03 INFO Signed narinfos id=10 count=1 worker1 # [ 55.372174] nix-grpc-daemon[868]: time=2026-09-21T10:43:03.957Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.366769] niks3-server[1025]: 2026/09/21 10:43:03 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 55.380307] niks3-server[1025]: 2026/09/21 10:43:03 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 55.389345] niks3-server[1025]: 2026/09/21 10:43:03 INFO Completed upload id=10 worker1 # [ 55.397464] nix-grpc-daemon[868]: time=2026-09-21T10:43:03.983Z level=INFO msg="Upload complete. (300ms)" lb # [ 55.392433] niks3-server[1025]: 2026/09/21 10:43:03 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker1 # [ 55.408988] nix-grpc-daemon[775]: ts=2026-09-21T10:43:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37950 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker1 # [ 55.422460] nix-grpc-daemon[775]: ts=2026-09-21T10:43:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37950 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker1 # [ 55.428482] nix-daemon[839]: reaped child process 895, status = succeeded client # [ 55.525723] systemd[1]: dedup2.service: Deactivated successfully. client # [ 55.529986] systemd[1]: dedup2.service: Consumed 242ms CPU time over 5.110s wall clock time, 33.2M memory peak, 6.3K incoming IP traffic, 5.8K outgoing IP traffic. client # [ 55.540854] systemd[1]: dedup1.service: Deactivated successfully. client # [ 55.542893] systemd[1]: dedup1.service: Consumed 176ms CPU time over 6.238s wall clock time, 41.3M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.06 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: two clients wanting the same drv build it once, in 7.49 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 56.941359] systemd[1]: Started Nix Daemon. client # [ 57.129052] nix-daemon[937]: accepted connection from pid 934, user root (trusted) worker1 # [ 57.294457] nix-grpc-daemon[775]: ts=2026-09-21T10:43:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 57.301659] nix-grpc-daemon[775]: ts=2026-09-21T10:43:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37950 worker2 # [ 57.318596] nix-grpc-daemon[779]: ts=2026-09-21T10:43:05Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 57.324078] nix-grpc-daemon[779]: ts=2026-09-21T10:43:05Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 57.362408] nix-grpc-daemon[779]: ts=2026-09-21T10:43:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 57.377729] nix-grpc-daemon[779]: ts=2026-09-21T10:43:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 57.393578] nix-grpc-daemon[779]: ts=2026-09-21T10:43:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 57.409136] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 57.618377] nix-daemon[863]: accepted connection from pid 1101, user nix-grpc-daemon (trusted) worker2 # [ 57.637085] nix-daemon[863]: reaped child process 1104, status = succeeded worker2 # [ 57.810549] nix-daemon[863]: accepted connection from pid 1106, user nix-grpc-daemon (trusted) worker2 # [ 57.826023] nix-daemon[863]: reaped child process 1109, status = succeeded lb # [ 57.829261] niks3-server[1025]: 2026/09/21 10:43:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 57.848670] nix-grpc-daemon[878]: time=2026-09-21T10:43:06.443Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 57.850101] nix-grpc-daemon[878]: time=2026-09-21T10:43:06.443Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 57.859362] niks3-server[1025]: 2026/09/21 10:43:06 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst lb # [ 57.874750] niks3-server[1025]: 2026/09/21 10:43:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker2 # [ 57.890438] nix-grpc-daemon[878]: time=2026-09-21T10:43:06.485Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.886110] niks3-server[1025]: 2026/09/21 10:43:06 INFO Signed narinfos id=11 count=1 lb # [ 57.891237] niks3-server[1025]: 2026/09/21 10:43:06 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 57.899683] niks3-server[1025]: 2026/09/21 10:43:06 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 57.906070] niks3-server[1025]: 2026/09/21 10:43:06 INFO Completed upload id=11 worker2 # [ 57.915502] nix-grpc-daemon[878]: time=2026-09-21T10:43:06.510Z level=INFO msg="Upload complete. (489ms)" lb # [ 57.908907] niks3-server[1025]: 2026/09/21 10:43:06 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker2 # [ 57.924247] nix-grpc-daemon[779]: ts=2026-09-21T10:43:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 57.932305] nix-grpc-daemon[779]: ts=2026-09-21T10:43:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 57.944167] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 57.947425] nix-daemon[863]: reaped child process 1099, status = succeeded worker2 # [ 57.958921] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 59.385299] nix-daemon[863]: reaped child process 1113, status = succeeded worker2 # [ 59.546765] nix-daemon[863]: accepted connection from pid 1129, user nix-grpc-daemon (trusted) worker2 # [ 59.563337] nix-daemon[863]: reaped child process 1132, status = succeeded lb # [ 59.569666] niks3-server[1025]: 2026/09/21 10:43:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 59.591651] nix-grpc-daemon[878]: time=2026-09-21T10:43:08.183Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 59.593324] nix-grpc-daemon[878]: time=2026-09-21T10:43:08.183Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 59.602792] niks3-server[1025]: 2026/09/21 10:43:08 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 59.620300] niks3-server[1025]: 2026/09/21 10:43:08 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker2 # [ 59.640867] nix-grpc-daemon[878]: time=2026-09-21T10:43:08.235Z level=INFO msg="Uploading 1 narinfos" lb # [ 59.631145] niks3-server[1025]: 2026/09/21 10:43:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 59.637912] niks3-server[1025]: 2026/09/21 10:43:08 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 59.646585] niks3-server[1025]: 2026/09/21 10:43:08 INFO Signed narinfos id=12 count=1 lb # [ 59.652960] niks3-server[1025]: 2026/09/21 10:43:08 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 59.659067] niks3-server[1025]: 2026/09/21 10:43:08 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo lb # [ 59.664482] niks3-server[1025]: 2026/09/21 10:43:08 INFO Completed upload id=12 worker2 # [ 59.674180] nix-grpc-daemon[878]: time=2026-09-21T10:43:08.269Z level=INFO msg="Upload complete. (302ms)" worker2 # [ 59.685102] nix-grpc-daemon[779]: ts=2026-09-21T10:43:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 worker2 # [ 59.703549] nix-grpc-daemon[779]: ts=2026-09-21T10:43:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 59.707895] nix-daemon[863]: reaped child process 1111, status = succeeded worker2 # [ 59.723128] nix-grpc-daemon[779]: ts=2026-09-21T10:43:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 59.729355] nix-grpc-daemon[779]: ts=2026-09-21T10:43:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 60.046479] nix-grpc-daemon[779]: ts=2026-09-21T10:43:08Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:56686 worker1 # [ 60.051330] nix-grpc-daemon[775]: ts=2026-09-21T10:43:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37950 worker2 # [ 60.080227] nix-grpc-daemon[779]: ts=2026-09-21T10:43:08Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker2 # [ 60.088984] nix-grpc-daemon[779]: ts=2026-09-21T10:43:08Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 60.095528] nix-grpc-daemon[779]: ts=2026-09-21T10:43:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 60.106222] nix-grpc-daemon[779]: ts=2026-09-21T10:43:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 60.119662] nix-grpc-daemon[878]: time=2026-09-21T10:43:08.714Z level=INFO msg="All 1 paths already cached" worker2 # [ 60.128976] nix-grpc-daemon[779]: ts=2026-09-21T10:43:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 60.144436] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 60.352878] nix-daemon[863]: accepted connection from pid 1138, user nix-grpc-daemon (trusted) worker2 # [ 60.371230] nix-daemon[863]: reaped child process 1141, status = succeeded worker2 # [ 60.543357] nix-daemon[863]: accepted connection from pid 1143, user nix-grpc-daemon (trusted) worker2 # [ 60.559620] nix-daemon[863]: reaped child process 1146, status = succeeded lb # [ 60.561672] niks3-server[1025]: 2026/09/21 10:43:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 60.580806] nix-grpc-daemon[878]: time=2026-09-21T10:43:09.175Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 60.582240] nix-grpc-daemon[878]: time=2026-09-21T10:43:09.175Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 60.591846] niks3-server[1025]: 2026/09/21 10:43:09 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst worker2 # [ 60.620900] nix-grpc-daemon[878]: time=2026-09-21T10:43:09.214Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.603309] niks3-server[1025]: 2026/09/21 10:43:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 60.615722] niks3-server[1025]: 2026/09/21 10:43:09 INFO Signed narinfos id=13 count=1 lb # [ 60.622297] niks3-server[1025]: 2026/09/21 10:43:09 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 60.630615] niks3-server[1025]: 2026/09/21 10:43:09 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 60.635693] niks3-server[1025]: 2026/09/21 10:43:09 INFO Completed upload id=13 worker2 # [ 60.644510] nix-grpc-daemon[878]: time=2026-09-21T10:43:09.239Z level=INFO msg="Upload complete. (482ms)" lb # [ 60.638672] niks3-server[1025]: 2026/09/21 10:43:09 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker2 # [ 60.652791] nix-grpc-daemon[779]: ts=2026-09-21T10:43:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 60.666483] nix-grpc-daemon[779]: ts=2026-09-21T10:43:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 60.674468] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 60.676705] nix-daemon[863]: reaped child process 1136, status = succeeded worker2 # [ 60.688947] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) lb # [ 61.943723] envoy[934]: conn peer=[2001:db8:1::1]:38892 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3005 tx=1426 ms=5911 lb # [ 61.949243] envoy[934]: conn peer=[2001:db8:1::1]:44232 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1579 tx=1487 ms=3319 lb # [ 61.958822] envoy[934]: conn peer=[2001:db8:1::1]:44234 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3414 tx=1741 ms=2496 lb # [ 61.964558] envoy[934]: conn peer=[2001:db8:1::1]:44244 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=73 worker2 # [ 62.319547] nix-daemon[863]: reaped child process 1150, status = succeeded worker2 # [ 62.487953] nix-daemon[863]: accepted connection from pid 1166, user nix-grpc-daemon (trusted) worker2 # [ 62.505796] nix-daemon[863]: reaped child process 1169, status = succeeded lb # [ 62.512599] niks3-server[1025]: 2026/09/21 10:43:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 62.532092] nix-grpc-daemon[878]: time=2026-09-21T10:43:11.125Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 62.533647] nix-grpc-daemon[878]: time=2026-09-21T10:43:11.125Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 62.552566] niks3-server[1025]: 2026/09/21 10:43:11 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst worker2 # [ 62.572864] nix-grpc-daemon[878]: time=2026-09-21T10:43:11.167Z level=INFO msg="Uploading 1 narinfos" lb # [ 62.569049] niks3-server[1025]: 2026/09/21 10:43:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 62.577335] niks3-server[1025]: 2026/09/21 10:43:11 INFO Signed narinfos id=14 count=1 lb # [ 62.583843] niks3-server[1025]: 2026/09/21 10:43:11 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv lb # [ 62.587404] niks3-server[1025]: 2026/09/21 10:43:11 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls worker2 # [ 62.600561] nix-grpc-daemon[878]: time=2026-09-21T10:43:11.195Z level=INFO msg="Upload complete. (301ms)" lb # [ 62.591464] niks3-server[1025]: 2026/09/21 10:43:11 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 62.596858] niks3-server[1025]: 2026/09/21 10:43:11 INFO Completed upload id=14 lb # [ 62.599284] niks3-server[1025]: 2026/09/21 10:43:11 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker2 # [ 62.609919] nix-grpc-daemon[779]: ts=2026-09-21T10:43:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 worker1 # [ 62.616801] nix-grpc-daemon[775]: ts=2026-09-21T10:43:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37950 worker2 # [ 62.624941] nix-daemon[863]: reaped child process 1148, status = succeeded worker1 # [ 62.632687] nix-grpc-daemon[775]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker1 # [ 62.651018] nix-grpc-daemon[775]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker1 # [ 62.691878] nix-grpc-daemon[775]: ts=2026-09-21T10:43:11Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 62.699771] nix-grpc-daemon[775]: ts=2026-09-21T10:43:11Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37950 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 63.021472] nix-grpc-daemon[775]: ts=2026-09-21T10:43:11Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 63.029084] nix-grpc-daemon[775]: ts=2026-09-21T10:43:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 63.036646] nix-grpc-daemon[868]: time=2026-09-21T10:43:11.621Z level=INFO msg="All 2 paths already cached" worker2 # [ 63.049294] nix-grpc-daemon[779]: ts=2026-09-21T10:43:11Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker2 # [ 63.056416] nix-grpc-daemon[779]: ts=2026-09-21T10:43:11Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 63.065639] nix-grpc-daemon[779]: ts=2026-09-21T10:43:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 63.076333] nix-grpc-daemon[779]: ts=2026-09-21T10:43:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 63.090373] nix-grpc-daemon[878]: time=2026-09-21T10:43:11.685Z level=INFO msg="All 2 paths already cached" worker2 # [ 63.099258] nix-grpc-daemon[779]: ts=2026-09-21T10:43:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 63.113519] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 63.316162] nix-daemon[863]: accepted connection from pid 1175, user nix-grpc-daemon (trusted) worker2 # [ 63.333731] nix-daemon[863]: reaped child process 1178, status = succeeded worker2 # [ 63.508075] nix-daemon[863]: accepted connection from pid 1180, user nix-grpc-daemon (trusted) worker2 # [ 63.523857] nix-daemon[863]: reaped child process 1183, status = succeeded lb # [ 63.531200] niks3-server[1025]: 2026/09/21 10:43:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 63.553330] nix-grpc-daemon[878]: time=2026-09-21T10:43:12.147Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 63.554811] nix-grpc-daemon[878]: time=2026-09-21T10:43:12.147Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 63.563165] niks3-server[1025]: 2026/09/21 10:43:12 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst worker2 # [ 63.594351] nix-grpc-daemon[878]: time=2026-09-21T10:43:12.189Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.585191] niks3-server[1025]: 2026/09/21 10:43:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 63.594972] niks3-server[1025]: 2026/09/21 10:43:12 INFO Signed narinfos id=15 count=1 lb # [ 63.600393] niks3-server[1025]: 2026/09/21 10:43:12 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 63.610725] niks3-server[1025]: 2026/09/21 10:43:12 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 63.617689] niks3-server[1025]: 2026/09/21 10:43:12 INFO Completed upload id=15 worker2 # [ 63.626130] nix-grpc-daemon[878]: time=2026-09-21T10:43:12.221Z level=INFO msg="Upload complete. (495ms)" lb # [ 63.624890] niks3-server[1025]: 2026/09/21 10:43:12 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker2 # [ 63.635761] nix-grpc-daemon[779]: ts=2026-09-21T10:43:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 63.649838] nix-grpc-daemon[779]: ts=2026-09-21T10:43:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 63.657724] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 63.661338] nix-daemon[863]: reaped child process 1173, status = succeeded worker2 # [ 63.673408] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 64.507743] nix-daemon[863]: reaped child process 1187, status = succeeded worker2 # [ 64.677307] nix-daemon[863]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 64.696707] nix-daemon[863]: reaped child process 1206, status = succeeded lb # [ 64.702340] niks3-server[1025]: 2026/09/21 10:43:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 64.736472] nix-grpc-daemon[878]: time=2026-09-21T10:43:13.330Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 64.737990] nix-grpc-daemon[878]: time=2026-09-21T10:43:13.330Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 64.760393] niks3-server[1025]: 2026/09/21 10:43:13 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 64.771947] niks3-server[1025]: 2026/09/21 10:43:13 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker2 # [ 64.797578] nix-grpc-daemon[878]: time=2026-09-21T10:43:13.392Z level=INFO msg="Uploading 1 narinfos" lb # [ 64.781787] niks3-server[1025]: 2026/09/21 10:43:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 64.792922] niks3-server[1025]: 2026/09/21 10:43:13 INFO Signed narinfos id=16 count=1 lb # [ 64.799561] niks3-server[1025]: 2026/09/21 10:43:13 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 64.808616] niks3-server[1025]: 2026/09/21 10:43:13 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 64.816119] niks3-server[1025]: 2026/09/21 10:43:13 INFO Completed upload id=16 worker2 # [ 64.825226] nix-grpc-daemon[878]: time=2026-09-21T10:43:13.420Z level=INFO msg="Upload complete. (342ms)" lb # [ 64.819356] niks3-server[1025]: 2026/09/21 10:43:13 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker2 # [ 64.837323] nix-grpc-daemon[779]: ts=2026-09-21T10:43:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker2 # [ 64.855665] nix-daemon[863]: reaped child process 1185, status = succeeded worker2 # [ 64.881666] nix-grpc-daemon[779]: ts=2026-09-21T10:43:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 64.906826] nix-grpc-daemon[779]: ts=2026-09-21T10:43:13Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 64.912164] nix-grpc-daemon[779]: ts=2026-09-21T10:43:13Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=0 paths=1 nar_bytes_out=232 client # [ 65.097777] nix-daemon[937]: reaped child process 939, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.40 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.54 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.45 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.25 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 66.404262] nix-daemon[937]: accepted connection from pid 1020, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 66.571633] nix-grpc-daemon[779]: ts=2026-09-21T10:43:15Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 66.579328] nix-grpc-daemon[779]: ts=2026-09-21T10:43:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56686 client # copying 1 paths... client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'... worker1 # [ 66.589778] nix-grpc-daemon[775]: ts=2026-09-21T10:43:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 66.605109] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 66.818550] nix-daemon[839]: accepted connection from pid 950, user nix-grpc-daemon (trusted) worker1 # [ 66.836562] nix-daemon[839]: reaped child process 953, status = succeeded lb # [ 66.841288] niks3-server[1025]: 2026/09/21 10:43:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 66.858909] nix-grpc-daemon[868]: time=2026-09-21T10:43:15.444Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 66.860459] nix-grpc-daemon[868]: time=2026-09-21T10:43:15.444Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 66.866546] niks3-server[1025]: 2026/09/21 10:43:15 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 66.881996] niks3-server[1025]: 2026/09/21 10:43:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker1 # [ 66.895666] nix-grpc-daemon[868]: time=2026-09-21T10:43:15.481Z level=INFO msg="Uploading 1 narinfos" lb # [ 66.894058] niks3-server[1025]: 2026/09/21 10:43:15 INFO Signed narinfos id=17 count=1 lb # [ 66.903244] niks3-server[1025]: 2026/09/21 10:43:15 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls worker1 # [ 66.917765] nix-grpc-daemon[868]: time=2026-09-21T10:43:15.504Z level=INFO msg="Upload complete. (298ms)" lb # [ 66.910250] niks3-server[1025]: 2026/09/21 10:43:15 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 66.914884] niks3-server[1025]: 2026/09/21 10:43:15 INFO Completed upload id=17 lb # [ 66.917009] niks3-server[1025]: 2026/09/21 10:43:15 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker1 # [ 66.924225] nix-grpc-daemon[775]: ts=2026-09-21T10:43:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37950 duration_s=0 paths=1 nar_bytes_in=120 worker1 # [ 66.936672] nix-daemon[839]: reaped child process 948, status = succeeded worker2 # [ 66.940924] nix-grpc-daemon[779]: ts=2026-09-21T10:43:15Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 66.947241] nix-grpc-daemon[779]: ts=2026-09-21T10:43:15Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 66.983803] nix-grpc-daemon[775]: ts=2026-09-21T10:43:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 66.999528] nix-grpc-daemon[775]: ts=2026-09-21T10:43:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37950 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... worker1 # [ 67.017328] nix-grpc-daemon[775]: ts=2026-09-21T10:43:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37950 client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker1 # [ 67.031954] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 67.235068] nix-daemon[839]: accepted connection from pid 957, user nix-grpc-daemon (trusted) worker1 # [ 67.252387] nix-daemon[839]: reaped child process 960, status = succeeded worker1 # [ 67.422912] nix-daemon[839]: accepted connection from pid 962, user nix-grpc-daemon (trusted) worker1 # [ 67.438997] nix-daemon[839]: reaped child process 965, status = succeeded lb # [ 67.442487] niks3-server[1025]: 2026/09/21 10:43:16 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 67.452584] niks3-server[1025]: 2026/09/21 10:43:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 67.469061] nix-grpc-daemon[868]: time=2026-09-21T10:43:16.055Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker1 # [ 67.470522] nix-grpc-daemon[868]: time=2026-09-21T10:43:16.055Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" worker1 # [ 67.472264] nix-grpc-daemon[868]: time=2026-09-21T10:43:16.055Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" lb # [ 67.486230] niks3-server[1025]: 2026/09/21 10:43:16 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 67.498685] niks3-server[1025]: 2026/09/21 10:43:16 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 67.511740] niks3-server[1025]: 2026/09/21 10:43:16 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 67.518333] niks3-server[1025]: 2026/09/21 10:43:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 67.523547] niks3-server[1025]: 2026/09/21 10:43:16 INFO Signed narinfos id=18 count=1 worker1 # [ 67.532154] nix-grpc-daemon[868]: time=2026-09-21T10:43:16.117Z level=INFO msg="Uploading 3 narinfos" lb # [ 67.527930] niks3-server[1025]: 2026/09/21 10:43:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 67.535033] niks3-server[1025]: 2026/09/21 10:43:16 INFO Signed narinfos id=19 count=2 lb # [ 67.539055] niks3-server[1025]: 2026/09/21 10:43:16 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 67.553810] niks3-server[1025]: 2026/09/21 10:43:16 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 67.564104] niks3-server[1025]: 2026/09/21 10:43:16 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 67.567091] niks3-server[1025]: 2026/09/21 10:43:16 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 67.570502] niks3-server[1025]: 2026/09/21 10:43:16 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 67.573725] niks3-server[1025]: 2026/09/21 10:43:16 INFO Completed upload id=18 lb # [ 67.576701] niks3-server[1025]: 2026/09/21 10:43:16 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 67.579837] niks3-server[1025]: 2026/09/21 10:43:16 INFO Completed upload id=19 worker1 # [ 67.587914] nix-grpc-daemon[868]: time=2026-09-21T10:43:16.174Z level=INFO msg="Upload complete. (538ms)" worker1 # [ 67.601063] nix-grpc-daemon[775]: ts=2026-09-21T10:43:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37950 duration_s=0 paths=2 nar_bytes_in=984 worker1 # [ 67.616636] nix-grpc-daemon[775]: ts=2026-09-21T10:43:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 67.629546] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 67.633851] nix-daemon[839]: reaped child process 955, status = succeeded client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... worker1 # [ 67.647710] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 68.268585] nix-daemon[839]: reaped child process 969, status = succeeded worker1 # [ 68.433859] nix-daemon[839]: accepted connection from pid 985, user nix-grpc-daemon (trusted) worker1 # [ 68.450083] nix-daemon[839]: reaped child process 988, status = succeeded lb # [ 68.454472] niks3-server[1025]: 2026/09/21 10:43:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 68.473989] nix-grpc-daemon[868]: time=2026-09-21T10:43:17.059Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" worker1 # [ 68.503087] nix-grpc-daemon[868]: time=2026-09-21T10:43:17.089Z level=INFO msg="Uploading 1 narinfos" lb # [ 68.485025] niks3-server[1025]: 2026/09/21 10:43:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 68.501489] niks3-server[1025]: 2026/09/21 10:43:17 INFO Signed narinfos id=20 count=1 lb # [ 68.507787] niks3-server[1025]: 2026/09/21 10:43:17 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 68.514895] niks3-server[1025]: 2026/09/21 10:43:17 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls worker1 # [ 68.531682] nix-grpc-daemon[868]: time=2026-09-21T10:43:17.118Z level=INFO msg="Upload complete. (274ms)" lb # [ 68.523794] niks3-server[1025]: 2026/09/21 10:43:17 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 68.528948] niks3-server[1025]: 2026/09/21 10:43:17 INFO Completed upload id=20 lb # [ 68.531838] niks3-server[1025]: 2026/09/21 10:43:17 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo worker1 # [ 68.540237] nix-grpc-daemon[775]: ts=2026-09-21T10:43:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37950 duration_s=0 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 worker1 # [ 68.551247] nix-daemon[839]: reaped child process 967, status = succeeded client # copying 1 paths... worker2 # [ 68.591886] nix-grpc-daemon[779]: ts=2026-09-21T10:43:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 68.606768] nix-grpc-daemon[779]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 68.650436] nix-grpc-daemon[775]: ts=2026-09-21T10:43:17Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 68.656941] nix-grpc-daemon[775]: ts=2026-09-21T10:43:17Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37950 duration_s=0 paths=1 nar_bytes_out=120 client # [ 68.794996] nix-daemon[937]: reaped child process 1023, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.63 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 69.011190] nix-daemon[937]: accepted connection from pid 1042, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 69.172117] nix-grpc-daemon[775]: ts=2026-09-21T10:43:17Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:37950 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 69.179636] nix-grpc-daemon[775]: ts=2026-09-21T10:43:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 69.186301] nix-grpc-daemon[868]: time=2026-09-21T10:43:17.771Z level=INFO msg="All 1 paths already cached" worker2 # [ 69.199952] nix-grpc-daemon[779]: ts=2026-09-21T10:43:17Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker2 # [ 69.210179] nix-grpc-daemon[779]: ts=2026-09-21T10:43:17Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 69.219091] nix-grpc-daemon[779]: ts=2026-09-21T10:43:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 69.227555] nix-grpc-daemon[779]: ts=2026-09-21T10:43:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56686 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker2 # [ 69.244914] nix-grpc-daemon[779]: ts=2026-09-21T10:43:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 69.259739] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 69.282557] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 89 ms (attempt 1/5) worker2 # [ 69.378256] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 2/5) worker2 # [ 69.447761] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 182 ms (attempt 3/5) worker2 # [ 69.638406] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 136 ms (attempt 4/5) worker2 # [ 69.782799] nix-grpc-daemon[779]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 69.788816] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 69.795846] nix-grpc-daemon[779]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker2 # [ 70.019336] nix-daemon[863]: accepted connection from pid 1223, user nix-grpc-daemon (trusted) worker2 # [ 70.037687] nix-daemon[863]: reaped child process 1226, status = succeeded worker2 # [ 70.214292] nix-daemon[863]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) worker2 # [ 70.230477] nix-daemon[863]: reaped child process 1231, status = succeeded lb # [ 70.233658] niks3-server[1025]: 2026/09/21 10:43:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 70.253010] nix-grpc-daemon[878]: time=2026-09-21T10:43:18.847Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 70.254451] nix-grpc-daemon[878]: time=2026-09-21T10:43:18.847Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 70.263219] niks3-server[1025]: 2026/09/21 10:43:18 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst worker2 # [ 70.284377] nix-grpc-daemon[878]: time=2026-09-21T10:43:18.879Z level=INFO msg="Uploading 1 narinfos" lb # [ 70.277101] niks3-server[1025]: 2026/09/21 10:43:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 70.287847] niks3-server[1025]: 2026/09/21 10:43:18 INFO Signed narinfos id=21 count=1 lb # [ 70.294042] niks3-server[1025]: 2026/09/21 10:43:18 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 70.305397] niks3-server[1025]: 2026/09/21 10:43:18 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete worker2 # [ 70.321784] nix-grpc-daemon[878]: time=2026-09-21T10:43:18.916Z level=INFO msg="Upload complete. (504ms)" lb # [ 70.312614] niks3-server[1025]: 2026/09/21 10:43:18 INFO Completed upload id=21 lb # [ 70.316116] niks3-server[1025]: 2026/09/21 10:43:18 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker2 # [ 70.331818] nix-grpc-daemon[779]: ts=2026-09-21T10:43:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=1 paths=1 nar_bytes_in=568 worker2 # [ 70.339938] nix-grpc-daemon[779]: ts=2026-09-21T10:43:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 70.352282] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 70.356919] nix-daemon[863]: reaped child process 1216, status = succeeded worker2 # [ 70.371778] nix-grpc-daemon[779]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... worker2 # [ 70.388437] nix-daemon[863]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 71.635818] nix-daemon[863]: reaped child process 1236, status = succeeded worker2 # [ 71.821856] nix-daemon[863]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) worker2 # [ 71.840605] nix-daemon[863]: reaped child process 1255, status = succeeded lb # [ 71.846626] niks3-server[1025]: 2026/09/21 10:43:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 71.867341] nix-grpc-daemon[878]: time=2026-09-21T10:43:20.462Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 71.879796] niks3-server[1025]: 2026/09/21 10:43:20 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 71.902454] nix-grpc-daemon[878]: time=2026-09-21T10:43:20.497Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.894816] niks3-server[1025]: 2026/09/21 10:43:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 71.905479] niks3-server[1025]: 2026/09/21 10:43:20 INFO Signed narinfos id=22 count=1 lb # [ 71.910173] niks3-server[1025]: 2026/09/21 10:43:20 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls lb # [ 71.918782] niks3-server[1025]: 2026/09/21 10:43:20 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 71.923533] niks3-server[1025]: 2026/09/21 10:43:20 INFO Completed upload id=22 worker2 # [ 71.933052] nix-grpc-daemon[878]: time=2026-09-21T10:43:20.528Z level=INFO msg="Upload complete. (330ms)" lb # [ 71.926497] niks3-server[1025]: 2026/09/21 10:43:20 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo worker2 # [ 71.945067] nix-grpc-daemon[779]: ts=2026-09-21T10:43:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 lb # [ 71.944608] envoy[934]: conn peer=[2001:db8:1::1]:44248 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3887 tx=2070 ms=2711 worker2 # [ 71.959964] nix-daemon[863]: reaped child process 1233, status = succeeded lb # [ 71.949602] envoy[934]: conn peer=[2001:db8:1::1]:54080 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=70 lb # [ 71.954732] envoy[934]: conn peer=[2001:db8:1::1]:54094 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2189 ms=1943 lb # [ 71.959487] envoy[934]: conn peer=[2001:db8:1::1]:54100 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=65 lb # [ 71.964707] envoy[934]: conn peer=[2001:db8:1::1]:54112 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4234 tx=1960 ms=2104 lb # [ 71.969008] envoy[934]: conn peer=[2001:db8:1::1]:54114 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=28 client # copying 1 paths... worker2 # [ 71.991380] nix-grpc-daemon[779]: ts=2026-09-21T10:43:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56686 client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 72.027611] nix-grpc-daemon[779]: ts=2026-09-21T10:43:20Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 72.033129] nix-grpc-daemon[779]: ts=2026-09-21T10:43:20Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56686 duration_s=0 paths=1 nar_bytes_out=120 client # [ 72.211023] nix-daemon[937]: reaped child process 1045, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.42 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 72.436950] nix-daemon[937]: accepted connection from pid 1064, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 72.610746] nix-grpc-daemon[775]: ts=2026-09-21T10:43:21Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:37950 worker2 # [ 72.614707] nix-grpc-daemon[779]: ts=2026-09-21T10:43:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 72.627926] nix-grpc-daemon[878]: time=2026-09-21T10:43:21.222Z level=INFO msg="All 1 paths already cached" worker2 # [ 72.644872] nix-grpc-daemon[779]: ts=2026-09-21T10:43:21Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker2 # [ 72.651129] nix-grpc-daemon[779]: ts=2026-09-21T10:43:21Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 72.652463] nix-grpc-daemon[775]: ts=2026-09-21T10:43:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 72.667090] nix-grpc-daemon[775]: ts=2026-09-21T10:43:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 72.687247] nix-grpc-daemon[868]: time=2026-09-21T10:43:21.272Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker1 # [ 72.697341] nix-grpc-daemon[775]: ts=2026-09-21T10:43:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 72.712216] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 72.917886] nix-daemon[839]: accepted connection from pid 992, user nix-grpc-daemon (trusted) worker1 # [ 72.934913] nix-daemon[839]: reaped child process 995, status = succeeded worker1 # [ 73.111914] nix-daemon[839]: accepted connection from pid 997, user nix-grpc-daemon (trusted) worker1 # [ 73.130405] nix-daemon[839]: reaped child process 1000, status = succeeded lb # [ 73.136709] niks3-server[1025]: 2026/09/21 10:43:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 73.155829] nix-grpc-daemon[868]: time=2026-09-21T10:43:21.742Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 73.157539] nix-grpc-daemon[868]: time=2026-09-21T10:43:21.742Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 73.166378] niks3-server[1025]: 2026/09/21 10:43:21 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst worker1 # [ 73.195131] nix-grpc-daemon[868]: time=2026-09-21T10:43:21.781Z level=INFO msg="Uploading 1 narinfos" lb # [ 73.179810] niks3-server[1025]: 2026/09/21 10:43:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 73.191888] niks3-server[1025]: 2026/09/21 10:43:21 INFO Signed narinfos id=23 count=1 lb # [ 73.198729] niks3-server[1025]: 2026/09/21 10:43:21 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls worker1 # [ 73.219688] nix-grpc-daemon[868]: time=2026-09-21T10:43:21.806Z level=INFO msg="Upload complete. (489ms)" lb # [ 73.211811] niks3-server[1025]: 2026/09/21 10:43:21 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 73.217860] niks3-server[1025]: 2026/09/21 10:43:21 INFO Completed upload id=23 worker1 # [ 73.228238] nix-grpc-daemon[775]: ts=2026-09-21T10:43:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37950 duration_s=0 paths=1 nar_bytes_in=568 lb # [ 73.221786] niks3-server[1025]: 2026/09/21 10:43:21 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker1 # [ 73.240193] nix-grpc-daemon[775]: ts=2026-09-21T10:43:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 73.247504] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 73.252823] nix-daemon[839]: reaped child process 990, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... worker1 # [ 73.266428] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 74.489333] nix-daemon[839]: reaped child process 1004, status = succeeded worker1 # [ 74.658174] nix-daemon[839]: accepted connection from pid 1020, user nix-grpc-daemon (trusted) worker1 # [ 74.676959] nix-daemon[839]: reaped child process 1023, status = succeeded lb # [ 74.681148] niks3-server[1025]: 2026/09/21 10:43:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 74.700412] nix-grpc-daemon[868]: time=2026-09-21T10:43:23.285Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 74.716100] niks3-server[1025]: 2026/09/21 10:43:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign worker1 # [ 74.737037] nix-grpc-daemon[868]: time=2026-09-21T10:43:23.323Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.734249] niks3-server[1025]: 2026/09/21 10:43:23 INFO Signed narinfos id=24 count=1 lb # [ 74.736941] niks3-server[1025]: 2026/09/21 10:43:23 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 74.746135] niks3-server[1025]: 2026/09/21 10:43:23 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 74.758455] niks3-server[1025]: 2026/09/21 10:43:23 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 74.768151] niks3-server[1025]: 2026/09/21 10:43:23 INFO Completed upload id=24 worker1 # [ 74.775619] nix-grpc-daemon[868]: time=2026-09-21T10:43:23.362Z level=INFO msg="Upload complete. (299ms)" lb # [ 74.770466] niks3-server[1025]: 2026/09/21 10:43:23 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker1 # [ 74.785054] nix-grpc-daemon[775]: ts=2026-09-21T10:43:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37950 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker1 # [ 74.801912] nix-daemon[839]: reaped child process 1002, status = succeeded client # copying 1 paths... worker2 # [ 74.838072] nix-grpc-daemon[779]: ts=2026-09-21T10:43:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56686 worker2 # [ 74.853047] nix-grpc-daemon[779]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 74.901437] nix-grpc-daemon[775]: ts=2026-09-21T10:43:23Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37950 worker1 # [ 74.908851] nix-grpc-daemon[775]: ts=2026-09-21T10:43:23Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37950 duration_s=0 paths=1 nar_bytes_out=120 client # [ 75.057360] nix-daemon[937]: reaped child process 1067, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.84 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 9.82 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.51 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.45 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.22 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.26 seconds) worker2 # [ 76.561016] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 77.419872] nix-grpc-daemon[779]: ts=2026-09-21T10:43:26Z level=info event=signal_exit worker2 # [ 77.663743] nix-grpc-daemon[779]: ts=2026-09-21T10:43:26Z level=info event=scheduler_yield worker1 # [ 77.667481] nix-grpc-daemon[775]: ts=2026-09-21T10:43:26Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 77.669226] nix-grpc-daemon[779]: ts=2026-09-21T10:43:26Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:47716 worker2 # [ 77.675561] nix-grpc-daemon[779]: ts=2026-09-21T10:43:26Z level=info event=worker_gone addr=192.168.1.3:50051 lb # [ 77.659984] niks3-server[1025]: 2026/09/21 10:43:26 INFO lead: released remote=192.168.1.4:60488 worker2 # [ 77.681805] nix-grpc-daemon[779]: ts=2026-09-21T10:43:26Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 77.685894] nix-grpc-daemon[779]: ts=2026-09-21T10:43:26Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:47716 worker2 # [ 77.690315] nix-grpc-daemon[779]: ts=2026-09-21T10:43:26Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 77.873526] nix-grpc-daemon[775]: ts=2026-09-21T10:43:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 77.877164] nix-grpc-daemon[779]: ts=2026-09-21T10:43:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 77.879140] nix-grpc-daemon[775]: ts=2026-09-21T10:43:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 77.882377] nix-grpc-daemon[779]: ts=2026-09-21T10:43:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.079889] nix-grpc-daemon[775]: ts=2026-09-21T10:43:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.083588] nix-grpc-daemon[779]: ts=2026-09-21T10:43:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 78.085250] nix-grpc-daemon[775]: ts=2026-09-21T10:43:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.088807] nix-grpc-daemon[779]: ts=2026-09-21T10:43:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.285980] nix-grpc-daemon[775]: ts=2026-09-21T10:43:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.289827] nix-grpc-daemon[779]: ts=2026-09-21T10:43:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 78.291250] nix-grpc-daemon[775]: ts=2026-09-21T10:43:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.294896] nix-grpc-daemon[779]: ts=2026-09-21T10:43:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.491854] nix-grpc-daemon[775]: ts=2026-09-21T10:43:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.497772] nix-grpc-daemon[779]: ts=2026-09-21T10:43:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 78.497036] nix-grpc-daemon[775]: ts=2026-09-21T10:43:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.501741] nix-grpc-daemon[779]: ts=2026-09-21T10:43:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.669540] nix-grpc-daemon[779]: ts=2026-09-21T10:43:27Z level=info event=scheduler_restarting worker1 # [ 78.699563] nix-grpc-daemon[775]: ts=2026-09-21T10:43:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 78.703752] nix-grpc-daemon[775]: ts=2026-09-21T10:43:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.724710] nix-grpc-daemon[779]: ts=2026-09-21T10:43:27Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 78.736767] nix-daemon[863]: reaped child process 865, status = succeeded worker1 # [ 78.900235] nix-grpc-daemon[775]: ts=2026-09-21T10:43:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 78.905371] nix-grpc-daemon[775]: ts=2026-09-21T10:43:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 79.106160] nix-grpc-daemon[775]: ts=2026-09-21T10:43:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 79.111255] nix-grpc-daemon[775]: ts=2026-09-21T10:43:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 79.312066] nix-grpc-daemon[775]: ts=2026-09-21T10:43:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 79.317084] nix-grpc-daemon[775]: ts=2026-09-21T10:43:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 79.517610] nix-grpc-daemon[775]: ts=2026-09-21T10:43:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 79.522785] nix-grpc-daemon[775]: ts=2026-09-21T10:43:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 79.531232] nix-grpc-daemon[779]: E0000 00:00:1789987408.124710 824 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 79.537890] nix-grpc-daemon[779]: E0000 00:00:1789987408.125161 824 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 79.652367] nix-grpc-daemon[775]: ts=2026-09-21T10:43:28Z level=info event=scheduler_take_over lb # [ 79.645188] niks3-server[1025]: 2026/09/21 10:43:28 INFO lead: acquired remote=192.168.1.3:34298 worker1 # [ 79.725283] nix-grpc-daemon[775]: ts=2026-09-21T10:43:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 79.729351] nix-grpc-daemon[775]: ts=2026-09-21T10:43:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 79.926130] nix-grpc-daemon[775]: ts=2026-09-21T10:43:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 79.931217] nix-grpc-daemon[775]: ts=2026-09-21T10:43:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 80.132097] nix-grpc-daemon[775]: ts=2026-09-21T10:43:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 80.137153] nix-grpc-daemon[775]: ts=2026-09-21T10:43:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 80.337948] nix-grpc-daemon[775]: ts=2026-09-21T10:43:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 80.343027] nix-grpc-daemon[775]: ts=2026-09-21T10:43:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 80.543701] nix-grpc-daemon[775]: ts=2026-09-21T10:43:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 80.567582] nix-grpc-daemon[775]: ts=2026-09-21T10:43:29Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:52470 worker1 # [ 80.572924] nix-grpc-daemon[775]: ts=2026-09-21T10:43:29Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 80.722231] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 80.729326] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 80.731890] systemd[1]: nix-grpc-daemon.service: Consumed 3.647s CPU time over 58.624s wall clock time, 65.5M memory peak, 89.9K incoming IP traffic, 217.2K outgoing IP traffic. worker2 # [ 80.748532] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 80.755884] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 80.758615] systemd[1]: nix-grpc-daemon.socket: Consumed 588us CPU time over 1min 9.821s wall clock time, 256K memory peak, 90.5K incoming IP traffic, 74.6K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 81.115513] nix-grpc-daemon[775]: ts=2026-09-21T10:43:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37950 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker1 # [ 81.123027] nix-grpc-daemon[775]: ts=2026-09-21T10:43:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37950 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.30 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds) worker2 # [ 81.266798] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 81.345198] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 81.712687] systemd[1]: Starting scheduler-token.service... worker2 # [ 81.816002] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 81.825120] systemd[1]: Finished scheduler-token.service. worker2 # [ 81.826769] systemd[1]: scheduler-token.service: Consumed 51ms CPU time over 105ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 81.834550] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 81.945394] envoy[934]: conn peer=[2001:db8:1::1]:54122 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3766 tx=1902 ms=2912 lb # [ 81.945714] envoy[934]: conn peer=[2001:db8:1::1]:39140 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=64 lb # [ 81.945839] envoy[934]: conn peer=[2001:db8:1::1]:39150 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3754 tx=1988 ms=2316 lb # [ 81.945952] envoy[934]: conn peer=[2001:db8:1::1]:39164 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=30 lb # [ 81.946084] envoy[934]: conn peer=[2001:db8:1::4]:51854 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=35401 tx=2299 ms=56230 lb # [ 81.946197] envoy[934]: conn peer=[2001:db8:1::1]:50062 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=22 worker2 # [ 82.020790] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:30Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 82.023501] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 82.027770] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 82.035413] nix-grpc-daemon[1282]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 82.047438] nix-grpc-daemon[1282]: E0000 00:00:1789987410.629822 1282 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 82.055278] nix-grpc-daemon[1282]: E0000 00:00:1789987410.633792 1282 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 82.058468] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 82.061287] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 82.064059] nix-grpc-daemon[1282]: E0000 00:00:1789987410.658831 1324 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 82.092063] nix-grpc-daemon[1282]: E0000 00:00:1789987410.676569 1324 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 82.099790] nix-grpc-daemon[1282]: E0000 00:00:1789987410.676723 1324 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 82.102834] nix-grpc-daemon[1282]: E0000 00:00:1789987410.694000 1324 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 82.112252] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.113422] nix-grpc-daemon[775]: ts=2026-09-21T10:43:30Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:52470 worker1 # [ 82.120943] nix-grpc-daemon[775]: ts=2026-09-21T10:43:30Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 82.323723] nix-grpc-daemon[775]: ts=2026-09-21T10:43:30Z level=info event=signal_exit worker1 # [ 82.581914] nix-grpc-daemon[775]: ts=2026-09-21T10:43:31Z level=info event=scheduler_yield lb # [ 82.577280] niks3-server[1025]: 2026/09/21 10:43:31 INFO lead: released remote=192.168.1.3:34298 worker2 # [ 82.592247] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:31Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 82.593510] nix-grpc-daemon[775]: ts=2026-09-21T10:43:31Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:52470 worker1 # [ 82.600686] nix-grpc-daemon[775]: ts=2026-09-21T10:43:31Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 82.604906] nix-grpc-daemon[775]: ts=2026-09-21T10:43:31Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 82.608859] nix-grpc-daemon[775]: ts=2026-09-21T10:43:31Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:52470 worker1 # [ 82.613200] nix-grpc-daemon[775]: ts=2026-09-21T10:43:31Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 82.793769] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.799141] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.800000] nix-grpc-daemon[775]: ts=2026-09-21T10:43:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.805093] nix-grpc-daemon[775]: ts=2026-09-21T10:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.000846] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.006135] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.005717] nix-grpc-daemon[775]: ts=2026-09-21T10:43:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.010958] nix-grpc-daemon[775]: ts=2026-09-21T10:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.208886] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.213020] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.213168] nix-grpc-daemon[775]: ts=2026-09-21T10:43:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.218149] nix-grpc-daemon[775]: ts=2026-09-21T10:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.409728] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.414944] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.419237] nix-grpc-daemon[775]: ts=2026-09-21T10:43:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.424637] nix-grpc-daemon[775]: ts=2026-09-21T10:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.587436] nix-grpc-daemon[775]: ts=2026-09-21T10:43:32Z level=info event=scheduler_restarting worker2 # [ 83.616086] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.621148] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.622298] nix-daemon[839]: reaped child process 841, status = succeeded worker1 # [ 83.647282] nix-grpc-daemon[775]: ts=2026-09-21T10:43:32Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 83.822296] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.827948] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.028963] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.034077] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.236862] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.241247] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.437684] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.436673] nix-grpc-daemon[775]: E0000 00:00:1789987413.021769 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 84.442746] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.468602] nix-grpc-daemon[775]: E0000 00:00:1789987413.054998 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 84.643770] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.645631] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 84.648975] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.656872] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 84.659441] systemd[1]: nix-grpc-daemon.service: Consumed 1.854s CPU time over 1min 2.695s wall clock time, 51.8M memory peak, 54.1K incoming IP traffic, 95.3K outgoing IP traffic. worker1 # [ 84.673753] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 84.676010] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 84.682666] systemd[1]: nix-grpc-daemon.socket: Consumed 628us CPU time over 1min 13.355s wall clock time, 256K memory peak, 69.5K incoming IP traffic, 60.8K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 84.849981] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.855063] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.038628] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54164 worker2 # [ 85.057455] nix-daemon[863]: accepted connection from pid 1282, user nix-grpc-daemon (trusted) worker2 # [ 85.068254] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.075534] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.094740] nix-grpc-daemon[1282]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 1/5) worker2 # [ 85.176868] nix-grpc-daemon[1282]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 199 ms (attempt 2/5) worker2 # [ 85.260095] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.264080] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.383422] nix-grpc-daemon[1282]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 14 ms (attempt 3/5) worker2 # [ 85.397651] nix-grpc-daemon[1282]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 296 ms (attempt 4/5) worker2 # [ 85.460891] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.465930] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.667098] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.672234] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.701455] nix-grpc-daemon[1282]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 85.707062] nix-grpc-daemon[1282]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 85.731251] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54164 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 85.747103] nix-daemon[863]: accepted connection from pid 1282, user nix-grpc-daemon (trusted) worker2 # [ 85.780722] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:34Z level=info event=niks3_push_started pid=1342 worker2 # [ 85.873152] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.875702] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.997956] nix-grpc-daemon[1342]: time=2026-09-21T10:43:34.592Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 86.075779] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.078450] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.181198] nix-daemon[863]: accepted connection from pid 1355, user nix-grpc-daemon (trusted) worker2 # [ 86.198612] nix-daemon[863]: reaped child process 1358, status = succeeded lb # [ 86.202728] niks3-server[1025]: 2026/09/21 10:43:34 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 86.212596] niks3-server[1025]: 2026/09/21 10:43:34 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 86.232093] nix-grpc-daemon[1342]: time=2026-09-21T10:43:34.826Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 86.233609] nix-grpc-daemon[1342]: time=2026-09-21T10:43:34.826Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 86.235316] nix-grpc-daemon[1342]: time=2026-09-21T10:43:34.826Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" lb # [ 86.262875] niks3-server[1025]: 2026/09/21 10:43:34 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst worker2 # [ 86.279797] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.283363] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 86.275852] niks3-server[1025]: 2026/09/21 10:43:34 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 86.287686] niks3-server[1025]: 2026/09/21 10:43:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 86.303415] niks3-server[1025]: 2026/09/21 10:43:34 INFO Signed narinfos id=26 count=2 lb # [ 86.308903] niks3-server[1025]: 2026/09/21 10:43:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 86.316626] niks3-server[1025]: 2026/09/21 10:43:34 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 86.321254] niks3-server[1025]: 2026/09/21 10:43:34 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls worker2 # [ 86.332113] nix-grpc-daemon[1342]: time=2026-09-21T10:43:34.926Z level=INFO msg="Uploading 3 narinfos" lb # [ 86.324415] niks3-server[1025]: 2026/09/21 10:43:34 INFO Signed narinfos id=25 count=1 lb # [ 86.352344] niks3-server[1025]: 2026/09/21 10:43:34 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 86.361312] niks3-server[1025]: 2026/09/21 10:43:34 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 86.368060] niks3-server[1025]: 2026/09/21 10:43:34 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 86.372410] niks3-server[1025]: 2026/09/21 10:43:34 INFO Completed upload id=25 lb # [ 86.376885] niks3-server[1025]: 2026/09/21 10:43:34 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete worker2 # [ 86.386273] nix-grpc-daemon[1342]: time=2026-09-21T10:43:34.981Z level=INFO msg="Upload complete. (384ms)" lb # [ 86.379519] niks3-server[1025]: 2026/09/21 10:43:34 INFO Completed upload id=26 lb # [ 86.385471] niks3-server[1025]: 2026/09/21 10:43:34 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo worker2 # [ 86.396458] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54164 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 86.414931] nix-daemon[863]: reaped child process 1340, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.66 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds) worker2 # [ 86.484752] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.489551] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 86.558710] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 86.568411] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 86.690689] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.696119] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 86.768137] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:35Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 86.771714] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 86.776301] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 86.784073] nix-grpc-daemon[1046]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 86.785550] nix-grpc-daemon[1046]: E0000 00:00:1789987415.369502 1046 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 86.799210] nix-grpc-daemon[1046]: E0000 00:00:1789987415.376062 1046 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 86.807878] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 86.811779] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 86.801921] niks3-server[1025]: 2026/09/21 10:43:35 INFO lead: acquired remote=192.168.1.3:60136 worker1 # [ 86.812906] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:35Z level=info event=scheduler_take_over worker1 # [ 86.816636] nix-grpc-daemon[1046]: E0000 00:00:1789987415.402925 1088 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 86.844059] nix-grpc-daemon[1046]: E0000 00:00:1789987415.420794 1088 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 86.846438] nix-grpc-daemon[1046]: E0000 00:00:1789987415.420959 1088 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 86.855072] nix-grpc-daemon[1046]: E0000 00:00:1789987415.440616 1088 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 86.871223] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.874990] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:35Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:57154 worker1 # [ 86.876824] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 86.897174] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.902473] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:35Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 86.903821] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:35Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:57154 worker1 # [ 86.905878] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:35Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.90 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 87.172218] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 87.793672] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:36Z level=info event=signal_exit worker1 # [ 88.010412] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:36Z level=info event=scheduler_yield lb # [ 88.005334] niks3-server[1025]: 2026/09/21 10:43:36 INFO lead: released remote=192.168.1.3:60136 worker2 # [ 88.018041] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:36Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 88.025100] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:36Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:57154 worker1 # [ 88.032429] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:36Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 88.036616] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:36Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 88.040583] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:36Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:57154 worker1 # [ 88.044959] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:36Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 88.218162] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.223397] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.231903] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.237187] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.424399] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.429461] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.437703] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.442887] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.630478] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.635574] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.643800] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.649525] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.836766] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.841712] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.851850] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.856388] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.015740] nix-grpc-daemon[1046]: ts=2026-09-21T10:43:37Z level=info event=scheduler_restarting worker2 # [ 89.044478] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.049405] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.245260] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.250300] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.451310] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.456454] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.657486] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.662221] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.808240] nix-grpc-daemon[1046]: E0000 00:00:1789987418.394481 1091 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 89.825261] nix-grpc-daemon[1046]: E0000 00:00:1789987418.411597 1091 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 89.863189] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.868253] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.070792] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.074883] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.271711] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.276942] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.477870] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.482894] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.683927] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.689055] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.822949] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 90.826228] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 90.831448] systemd[1]: nix-grpc-daemon.service: Consumed 207ms CPU time over 4.250s wall clock time, 13.3M memory peak, 9.5K incoming IP traffic, 7.9K outgoing IP traffic. worker1 # [ 90.847214] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 90.850445] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 90.853846] systemd[1]: nix-grpc-daemon.socket: Consumed 991us CPU time over 4.300s wall clock time, 256K memory peak, 13.6K incoming IP traffic, 10.7K outgoing IP traffic. worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2 # [ 90.891564] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2 # [ 91.294636] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.298833] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.495597] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.500798] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.701854] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.706927] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.907902] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.913025] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 91.948204] envoy[934]: conn peer=[2001:db8:1::3]:39792 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9002 tx=2455 ms=61256 lb # [ 91.948532] envoy[934]: conn peer=[2001:db8:1::1]:50070 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1005 tx=282 ms=1374 lb # [ 91.948663] envoy[934]: conn peer=[2001:db8:1::3]:35812 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1028 tx=349 ms=2194 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 92.059597] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:40Z level=info event=scheduler_take_over lb # [ 92.050938] niks3-server[1025]: 2026/09/21 10:43:40 INFO lead: acquired remote=192.168.1.4:38502 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2 # [ 92.113951] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.119071] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.322136] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.326431] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.523001] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.528400] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.729334] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.734513] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.935538] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.940743] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 93.141800] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.167065] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:41Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 93.172958] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:41Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:38234 worker2 # [ 93.176815] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:41Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.11 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker2 # [ 93.443778] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54164 worker2 # [ 93.452768] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54164 worker2 # [ 93.474179] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:42Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker2 # [ 93.480735] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:42Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 93.521321] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54164 worker2 # [ 93.536994] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54164 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker2 # [ 93.552879] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54164 worker2 # [ 93.568663] nix-daemon[863]: accepted connection from pid 1282, user nix-grpc-daemon (trusted) worker2 # [ 93.775663] nix-daemon[863]: accepted connection from pid 1382, user nix-grpc-daemon (trusted) worker2 # [ 93.796863] nix-daemon[863]: reaped child process 1385, status = succeeded worker2 # [ 93.972959] nix-daemon[863]: accepted connection from pid 1387, user nix-grpc-daemon (trusted) worker2 # [ 93.990471] nix-daemon[863]: reaped child process 1390, status = succeeded lb # [ 93.993310] niks3-server[1025]: 2026/09/21 10:43:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 94.012443] nix-grpc-daemon[1342]: time=2026-09-21T10:43:42.606Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 94.013926] nix-grpc-daemon[1342]: time=2026-09-21T10:43:42.606Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 94.025375] niks3-server[1025]: 2026/09/21 10:43:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign worker2 # [ 94.046233] nix-grpc-daemon[1342]: time=2026-09-21T10:43:42.641Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.040103] niks3-server[1025]: 2026/09/21 10:43:42 INFO Signed narinfos id=27 count=1 lb # [ 94.043248] niks3-server[1025]: 2026/09/21 10:43:42 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst lb # [ 94.056873] niks3-server[1025]: 2026/09/21 10:43:42 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls worker2 # [ 94.073728] nix-grpc-daemon[1342]: time=2026-09-21T10:43:42.668Z level=INFO msg="Upload complete. (488ms)" lb # [ 94.065646] niks3-server[1025]: 2026/09/21 10:43:42 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 94.071468] niks3-server[1025]: 2026/09/21 10:43:42 INFO Completed upload id=27 lb # [ 94.075399] niks3-server[1025]: 2026/09/21 10:43:42 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo worker2 # [ 94.080622] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54164 duration_s=0 paths=1 nar_bytes_in=520 worker2 # [ 94.095542] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54164 worker2 # [ 94.102476] nix-daemon[863]: accepted connection from pid 1282, user nix-grpc-daemon (trusted) worker2 # [ 94.107552] nix-daemon[863]: reaped child process 1380, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker2 # [ 94.121719] nix-daemon[863]: accepted connection from pid 1282, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker2 # [ 95.560866] nix-daemon[863]: reaped child process 1394, status = succeeded worker2 # [ 95.734571] nix-daemon[863]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker2 # [ 95.752120] nix-daemon[863]: reaped child process 1413, status = succeeded lb # [ 95.757639] niks3-server[1025]: 2026/09/21 10:43:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 95.777028] nix-grpc-daemon[1342]: time=2026-09-21T10:43:44.371Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 95.780901] nix-grpc-daemon[1342]: time=2026-09-21T10:43:44.373Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 95.791085] niks3-server[1025]: 2026/09/21 10:43:44 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 95.811340] niks3-server[1025]: 2026/09/21 10:43:44 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 95.820379] niks3-server[1025]: 2026/09/21 10:43:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 95.826608] niks3-server[1025]: 2026/09/21 10:43:44 INFO Signed narinfos id=28 count=1 worker2 # [ 95.837113] nix-grpc-daemon[1342]: time=2026-09-21T10:43:44.430Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.830159] niks3-server[1025]: 2026/09/21 10:43:44 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 95.843462] niks3-server[1025]: 2026/09/21 10:43:44 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 95.849869] niks3-server[1025]: 2026/09/21 10:43:44 INFO Completed upload id=28 worker2 # [ 95.859547] nix-grpc-daemon[1342]: time=2026-09-21T10:43:44.454Z level=INFO msg="Upload complete. (327ms)" lb # [ 95.853001] niks3-server[1025]: 2026/09/21 10:43:44 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker2 # [ 95.879017] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54164 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker2 # [ 95.895552] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:44Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker2 # [ 95.899716] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:44Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 95.904702] nix-daemon[863]: reaped child process 1392, status = succeeded worker2 # [ 95.921858] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54164 worker2 # [ 95.936800] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54164 worker2 # [ 95.949563] nix-grpc-daemon[1342]: time=2026-09-21T10:43:44.544Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker2 # [ 95.959182] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54164 worker2 # [ 95.975016] nix-daemon[863]: accepted connection from pid 1282, user nix-grpc-daemon (trusted) worker2 # [ 96.175657] nix-daemon[863]: accepted connection from pid 1419, user nix-grpc-daemon (trusted) worker2 # [ 96.194154] nix-daemon[863]: reaped child process 1422, status = succeeded worker2 # [ 96.366989] nix-daemon[863]: accepted connection from pid 1424, user nix-grpc-daemon (trusted) worker2 # [ 96.384142] nix-daemon[863]: reaped child process 1427, status = succeeded lb # [ 96.386946] niks3-server[1025]: 2026/09/21 10:43:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 96.405919] nix-grpc-daemon[1342]: time=2026-09-21T10:43:45.000Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 96.407440] nix-grpc-daemon[1342]: time=2026-09-21T10:43:45.000Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 96.413411] niks3-server[1025]: 2026/09/21 10:43:45 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst worker2 # [ 96.438333] nix-grpc-daemon[1342]: time=2026-09-21T10:43:45.033Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.431794] niks3-server[1025]: 2026/09/21 10:43:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 96.442905] niks3-server[1025]: 2026/09/21 10:43:45 INFO Signed narinfos id=29 count=1 lb # [ 96.447711] niks3-server[1025]: 2026/09/21 10:43:45 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 96.456267] niks3-server[1025]: 2026/09/21 10:43:45 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete worker2 # [ 96.470324] nix-grpc-daemon[1342]: time=2026-09-21T10:43:45.065Z level=INFO msg="Upload complete. (479ms)" lb # [ 96.461396] niks3-server[1025]: 2026/09/21 10:43:45 INFO Completed upload id=29 lb # [ 96.465274] niks3-server[1025]: 2026/09/21 10:43:45 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker2 # [ 96.480773] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54164 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 96.489574] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54164 worker2 # [ 96.495910] nix-daemon[863]: accepted connection from pid 1282, user nix-grpc-daemon (trusted) worker2 # [ 96.501262] nix-daemon[863]: reaped child process 1417, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... worker2 # [ 96.513686] nix-daemon[863]: accepted connection from pid 1282, user nix-grpc-daemon (trusted) client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker2 # [ 97.557512] nix-daemon[863]: reaped child process 1431, status = succeeded worker2 # [ 97.726743] nix-daemon[863]: accepted connection from pid 1447, user nix-grpc-daemon (trusted) worker2 # [ 97.745103] nix-daemon[863]: reaped child process 1450, status = succeeded lb # [ 97.747791] niks3-server[1025]: 2026/09/21 10:43:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 97.768719] nix-grpc-daemon[1342]: time=2026-09-21T10:43:46.363Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 97.770906] nix-grpc-daemon[1342]: time=2026-09-21T10:43:46.365Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 97.784181] niks3-server[1025]: 2026/09/21 10:43:46 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst worker2 # [ 97.810347] nix-grpc-daemon[1342]: time=2026-09-21T10:43:46.405Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.802385] niks3-server[1025]: 2026/09/21 10:43:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 97.813572] niks3-server[1025]: 2026/09/21 10:43:46 INFO Signed narinfos id=30 count=1 lb # [ 97.819255] niks3-server[1025]: 2026/09/21 10:43:46 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 97.824435] niks3-server[1025]: 2026/09/21 10:43:46 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 97.831509] niks3-server[1025]: 2026/09/21 10:43:46 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 97.835875] niks3-server[1025]: 2026/09/21 10:43:46 INFO Completed upload id=30 worker2 # [ 97.845586] nix-grpc-daemon[1342]: time=2026-09-21T10:43:46.440Z level=INFO msg="Upload complete. (322ms)" lb # [ 97.838357] niks3-server[1025]: 2026/09/21 10:43:46 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker2 # [ 97.864266] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54164 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker2 # [ 97.877823] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:46Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker2 # [ 97.881479] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:46Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 97.885319] nix-daemon[863]: reaped child process 1429, status = succeeded worker2 # [ 97.905805] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54164 worker2 # [ 97.920977] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54164 client # copying 1 paths to 'lb:50051'... worker2 # [ 97.934803] nix-grpc-daemon[1342]: time=2026-09-21T10:43:46.529Z level=INFO msg="All 2 paths already cached" client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker2 # [ 97.941544] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54164 worker2 # [ 97.956269] nix-daemon[863]: accepted connection from pid 1282, user nix-grpc-daemon (trusted) worker2 # [ 98.157233] nix-daemon[863]: accepted connection from pid 1456, user nix-grpc-daemon (trusted) worker2 # [ 98.174445] nix-daemon[863]: reaped child process 1459, status = succeeded worker2 # [ 98.346151] nix-daemon[863]: accepted connection from pid 1461, user nix-grpc-daemon (trusted) worker2 # [ 98.363539] nix-daemon[863]: reaped child process 1464, status = succeeded lb # [ 98.365282] niks3-server[1025]: 2026/09/21 10:43:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 98.384129] nix-grpc-daemon[1342]: time=2026-09-21T10:43:46.978Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 98.385588] nix-grpc-daemon[1342]: time=2026-09-21T10:43:46.978Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 98.394636] niks3-server[1025]: 2026/09/21 10:43:46 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst worker2 # [ 98.413247] nix-grpc-daemon[1342]: time=2026-09-21T10:43:47.008Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.406813] niks3-server[1025]: 2026/09/21 10:43:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 98.417885] niks3-server[1025]: 2026/09/21 10:43:46 INFO Signed narinfos id=31 count=1 lb # [ 98.426021] niks3-server[1025]: 2026/09/21 10:43:47 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls worker2 # [ 98.440739] nix-grpc-daemon[1342]: time=2026-09-21T10:43:47.035Z level=INFO msg="Upload complete. (468ms)" lb # [ 98.432182] niks3-server[1025]: 2026/09/21 10:43:47 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 98.438235] niks3-server[1025]: 2026/09/21 10:43:47 INFO Completed upload id=31 worker2 # [ 98.448125] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54164 duration_s=0 paths=1 nar_bytes_in=768 lb # [ 98.441293] niks3-server[1025]: 2026/09/21 10:43:47 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker2 # [ 98.456745] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54164 worker2 # [ 98.466322] nix-daemon[863]: accepted connection from pid 1282, user nix-grpc-daemon (trusted) worker2 # [ 98.468503] nix-daemon[863]: reaped child process 1454, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... worker2 # [ 98.480350] nix-daemon[863]: accepted connection from pid 1282, user nix-grpc-daemon (trusted) client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker2 # [ 99.113236] nix-daemon[863]: reaped child process 1468, status = succeeded worker2 # [ 99.274161] nix-daemon[863]: accepted connection from pid 1484, user nix-grpc-daemon (trusted) worker2 # [ 99.291143] nix-daemon[863]: reaped child process 1487, status = succeeded lb # [ 99.297008] niks3-server[1025]: 2026/09/21 10:43:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 99.318502] nix-grpc-daemon[1342]: time=2026-09-21T10:43:47.913Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 99.321767] nix-grpc-daemon[1342]: time=2026-09-21T10:43:47.915Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 99.338931] niks3-server[1025]: 2026/09/21 10:43:47 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 99.350931] niks3-server[1025]: 2026/09/21 10:43:47 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 99.359955] niks3-server[1025]: 2026/09/21 10:43:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker2 # [ 99.376336] nix-grpc-daemon[1342]: time=2026-09-21T10:43:47.970Z level=INFO msg="Uploading 1 narinfos" lb # [ 99.368910] niks3-server[1025]: 2026/09/21 10:43:47 INFO Signed narinfos id=32 count=1 lb # [ 99.371701] niks3-server[1025]: 2026/09/21 10:43:47 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 99.382960] niks3-server[1025]: 2026/09/21 10:43:47 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 99.390709] niks3-server[1025]: 2026/09/21 10:43:47 INFO Completed upload id=32 lb # [ 99.393782] niks3-server[1025]: 2026/09/21 10:43:47 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker2 # [ 99.400392] nix-grpc-daemon[1342]: time=2026-09-21T10:43:47.995Z level=INFO msg="Upload complete. (312ms)" worker2 # [ 99.413293] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54164 duration_s=0 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker2 # [ 99.431816] nix-daemon[863]: reaped child process 1466, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 6.28 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.23 seconds) worker1 # [ 99.780914] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 99.788650] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 99.986121] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 99.988777] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 99.992867] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 100.000067] nix-grpc-daemon[1113]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 100.016646] nix-grpc-daemon[1113]: E0000 00:00:1789987428.586082 1113 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 100.019462] nix-grpc-daemon[1113]: E0000 00:00:1789987428.589674 1113 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 100.024968] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 100.027162] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 100.032182] nix-grpc-daemon[1113]: E0000 00:00:1789987428.616513 1155 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 100.056154] nix-grpc-daemon[1113]: E0000 00:00:1789987428.634326 1155 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 100.058429] nix-grpc-daemon[1113]: E0000 00:00:1789987428.634475 1155 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 100.068568] nix-grpc-daemon[1113]: E0000 00:00:1789987428.653952 1155 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 100.087841] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 100.089718] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:48Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:38234 worker2 # [ 100.096076] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:48Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.51 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 100.548006] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 558da3cc9dd2458d94860d3336af72ce client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds) worker1 # [ 100.744787] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:51454 worker1 # [ 100.760504] nix-daemon[839]: accepted connection from pid 1113, user nix-grpc-daemon (trusted) client # [ 100.830198] nix[1168]: don't know how to build these paths: client # [ 100.831722] nix[1168]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker2 # [ 100.793339] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:49Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker2 # [ 100.800051] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:49Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 100.846133] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54164 worker2 # [ 100.861058] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54164 client # [ 100.924118] nix[1168]: copying 1 paths to 'lb:50051'... worker2 # [ 100.874547] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54164 client # [ 100.931218] nix[1168]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker2 # [ 100.889246] nix-daemon[863]: accepted connection from pid 1282, user nix-grpc-daemon (trusted) worker2 # [ 101.095380] nix-daemon[863]: accepted connection from pid 1500, user nix-grpc-daemon (trusted) worker2 # [ 101.114706] nix-daemon[863]: reaped child process 1503, status = succeeded worker2 # [ 101.288495] nix-daemon[863]: accepted connection from pid 1505, user nix-grpc-daemon (trusted) worker2 # [ 101.303673] nix-daemon[863]: reaped child process 1508, status = succeeded lb # [ 101.309267] niks3-server[1025]: 2026/09/21 10:43:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 101.328424] nix-grpc-daemon[1342]: time=2026-09-21T10:43:49.923Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 101.329912] nix-grpc-daemon[1342]: time=2026-09-21T10:43:49.923Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 101.346722] niks3-server[1025]: 2026/09/21 10:43:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign worker2 # [ 101.366149] nix-grpc-daemon[1342]: time=2026-09-21T10:43:49.961Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.361537] niks3-server[1025]: 2026/09/21 10:43:49 INFO Signed narinfos id=33 count=1 lb # [ 101.368949] niks3-server[1025]: 2026/09/21 10:43:49 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst lb # [ 101.375959] niks3-server[1025]: 2026/09/21 10:43:49 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls worker2 # [ 101.393506] nix-grpc-daemon[1342]: time=2026-09-21T10:43:49.988Z level=INFO msg="Upload complete. (487ms)" lb # [ 101.384527] niks3-server[1025]: 2026/09/21 10:43:49 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 101.389645] niks3-server[1025]: 2026/09/21 10:43:49 INFO Completed upload id=33 lb # [ 101.393421] niks3-server[1025]: 2026/09/21 10:43:49 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker2 # [ 101.400244] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54164 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 101.413315] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54164 worker2 # [ 101.423577] nix-daemon[863]: accepted connection from pid 1282, user nix-grpc-daemon (trusted) worker2 # [ 101.426170] nix-daemon[863]: reaped child process 1498, status = succeeded client # [ 101.486938] nix[1168]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker2 # [ 101.439595] nix-daemon[863]: accepted connection from pid 1282, user nix-grpc-daemon (trusted) lb # [ 101.946278] envoy[934]: conn peer=[2001:db8:1::1]:43808 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9636 tx=4071 ms=5984 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 103.442305] systemd-journald[274]: Received client request to rotate journal, rotating. worker1 # [ 103.469590] systemd-journald[274]: Vacuuming done, freed 0B of archived journals from /var/log/journal/9c51fb1631aa4c9f95abf019cc10d679. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 103.526459] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds) client: must succeed: sleep 5.0 worker2 # [ 104.055873] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:52Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 109.094416] nix-daemon[863]: reaped child process 1512, status = succeeded worker2 # [ 109.279513] nix-daemon[863]: accepted connection from pid 1553, user nix-grpc-daemon (trusted) worker2 # [ 109.295644] nix-daemon[863]: reaped child process 1556, status = succeeded lb # [ 109.301656] niks3-server[1025]: 2026/09/21 10:43:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 109.323585] nix-grpc-daemon[1342]: time=2026-09-21T10:43:57.916Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 109.325162] nix-grpc-daemon[1342]: time=2026-09-21T10:43:57.916Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 109.342192] niks3-server[1025]: 2026/09/21 10:43:57 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 109.354814] niks3-server[1025]: 2026/09/21 10:43:57 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker2 # [ 109.371944] nix-grpc-daemon[1342]: time=2026-09-21T10:43:57.966Z level=INFO msg="Uploading 1 narinfos" lb # [ 109.365003] niks3-server[1025]: 2026/09/21 10:43:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 109.373071] niks3-server[1025]: 2026/09/21 10:43:57 INFO Signed narinfos id=34 count=1 lb # [ 109.377353] niks3-server[1025]: 2026/09/21 10:43:57 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 109.383999] niks3-server[1025]: 2026/09/21 10:43:57 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 109.389842] niks3-server[1025]: 2026/09/21 10:43:57 INFO Completed upload id=34 worker2 # [ 109.399045] nix-grpc-daemon[1342]: time=2026-09-21T10:43:57.994Z level=INFO msg="Upload complete. (343ms)" lb # [ 109.393028] niks3-server[1025]: 2026/09/21 10:43:57 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker2 # [ 109.412990] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54164 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker2 # [ 109.427312] nix-daemon[863]: reaped child process 1510, status = succeeded client # [ 109.504942] systemd[1]: rs.service: Deactivated successfully. client # [ 109.508891] systemd[1]: rs.service: Consumed 175ms CPU time over 8.960s wall clock time, 39.2M memory peak, 7.1K incoming IP traffic, 8.4K outgoing IP traffic. worker2 # [ 110.058748] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:58Z level=info event=signal_exit worker2 # [ 110.282831] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:58Z level=info event=scheduler_yield lb # [ 110.278158] niks3-server[1025]: 2026/09/21 10:43:58 INFO lead: released remote=192.168.1.4:38502 worker2 # [ 110.288417] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:58Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 110.287288] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:58Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 110.294802] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38234 worker2 # [ 110.299506] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:58Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 110.303645] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38234 worker2 # [ 110.308178] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:58Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 110.487358] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.491778] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.493076] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 110.496102] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 110.692254] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.693876] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.697339] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.699153] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 110.898378] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.900259] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.903621] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.905606] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.104738] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.107319] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.109917] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.113992] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.23 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' worker2 # [ 111.288271] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:59Z level=info event=scheduler_restarting client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 111.310496] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.314923] nix-grpc-daemon[1113]: ts=2026-09-21T10:43:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.342976] nix-grpc-daemon[1282]: ts=2026-09-21T10:43:59Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 111.348554] nix-daemon[863]: reaped child process 1334, status = succeeded lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker1 # [ 111.511322] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.516715] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.717692] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.723164] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.924956] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.930804] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 111.946652] envoy[934]: conn peer=[2001:db8:1::1]:43816 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=1407 ms=8680 lb # [ 111.952076] envoy[934]: conn peer=[2001:db8:1::4]:41960 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=39170 tx=2258 ms=29212 worker2 # [ 112.104675] nix-grpc-daemon[1282]: E0000 00:00:1789987440.697620 1327 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker1 # [ 112.136807] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.136877] nix-grpc-daemon[1282]: E0000 00:00:1789987440.731646 1327 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 112.141238] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.283944] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 112.287074] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 112.304794] systemd[1]: nix-grpc-daemon.service: Consumed 2.022s CPU time over 30.445s wall clock time, 36.7M memory peak, 63.4K incoming IP traffic, 165K outgoing IP traffic. worker2 # [ 112.336916] systemd[1]: Starting scheduler-token.service... worker1 # [ 112.340331] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.345931] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 112.474966] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 112.484318] systemd[1]: Finished scheduler-token.service. worker2 # [ 112.487007] systemd[1]: scheduler-token.service: Consumed 59ms CPU time over 145ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 112.493835] systemd[1]: Starting Nix worker-protocol over gRPC... lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.15 seconds) worker1 # [ 112.550684] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.555284] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.729821] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:01Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 112.732562] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 112.736875] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 112.744591] nix-grpc-daemon[1566]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 112.746055] nix-grpc-daemon[1566]: E0000 00:00:1789987441.339127 1566 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 112.754605] nix-grpc-daemon[1566]: E0000 00:00:1789987441.345535 1566 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 112.751908] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.758588] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:01Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 112.761346] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 112.757276] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 112.755031] niks3-server[1025]: 2026/09/21 10:44:01 INFO lead: acquired remote=192.168.1.4:37214 worker2 # [ 112.767799] nix-grpc-daemon[1566]: E0000 00:00:1789987441.359922 1607 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 112.796177] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:01Z level=info event=scheduler_take_over worker2 # [ 112.797340] nix-grpc-daemon[1566]: E0000 00:00:1789987441.378006 1607 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 112.802738] nix-grpc-daemon[1566]: E0000 00:00:1789987441.378190 1607 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 112.805727] nix-grpc-daemon[1566]: E0000 00:00:1789987441.396804 1607 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 112.816287] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.817971] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.957969] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.963131] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.018292] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.023405] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 113.163927] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 113.169031] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.224738] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.229871] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 113.370979] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.377280] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:01Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:56366 worker2 # [ 113.382566] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:01Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 113.430809] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.444125] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:02Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 113.448788] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:02Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:56366 worker2 # [ 113.454242] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:02Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.27 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 113.825329] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 7d78e334d716407cacd6f5a472a8a0b6 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds) worker2 # [ 114.058765] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56368 worker2 # [ 114.073594] nix-daemon[863]: accepted connection from pid 1566, user nix-grpc-daemon (trusted) client # [ 114.142997] nix[1204]: don't know how to build these paths: client # [ 114.145708] nix[1204]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker2 # [ 114.104134] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:02Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 114.110504] nix-grpc-daemon[1566]: ts=2026-09-21T10:44:02Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 114.158973] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51454 worker1 # [ 114.183436] nix-grpc-daemon[1113]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 1/5) worker1 # [ 114.252976] nix-grpc-daemon[1113]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 127 ms (attempt 2/5) worker1 # [ 114.388241] nix-grpc-daemon[1113]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 118 ms (attempt 3/5) worker1 # [ 114.506557] nix-grpc-daemon[1113]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 468 ms (attempt 4/5) worker1 # [ 114.984666] nix-grpc-daemon[1113]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 114.991085] nix-grpc-daemon[1113]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 115.007484] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51454 client # [ 115.072545] nix[1204]: copying 1 paths to 'lb:50051'... worker1 # [ 115.020629] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51454 client # [ 115.075657] nix[1204]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker1 # [ 115.042355] nix-daemon[839]: accepted connection from pid 1113, user nix-grpc-daemon (trusted) worker1 # [ 115.072263] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:03Z level=info event=niks3_push_started pid=1231 worker1 # [ 115.282861] nix-grpc-daemon[1231]: time=2026-09-21T10:44:03.868Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 115.456906] nix-daemon[839]: accepted connection from pid 1244, user nix-grpc-daemon (trusted) worker1 # [ 115.476767] nix-daemon[839]: reaped child process 1247, status = succeeded worker1 # [ 115.645983] nix-daemon[839]: accepted connection from pid 1249, user nix-grpc-daemon (trusted) worker1 # [ 115.663373] nix-daemon[839]: reaped child process 1252, status = succeeded lb # [ 115.670394] niks3-server[1025]: 2026/09/21 10:44:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 115.689279] nix-grpc-daemon[1231]: time=2026-09-21T10:44:04.274Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 115.690755] nix-grpc-daemon[1231]: time=2026-09-21T10:44:04.274Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 115.706978] niks3-server[1025]: 2026/09/21 10:44:04 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst lb # [ 115.718661] niks3-server[1025]: 2026/09/21 10:44:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign worker1 # [ 115.732291] nix-grpc-daemon[1231]: time=2026-09-21T10:44:04.318Z level=INFO msg="Uploading 1 narinfos" lb # [ 115.729464] niks3-server[1025]: 2026/09/21 10:44:04 INFO Signed narinfos id=35 count=1 lb # [ 115.736186] niks3-server[1025]: 2026/09/21 10:44:04 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 115.748581] niks3-server[1025]: 2026/09/21 10:44:04 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 115.758810] niks3-server[1025]: 2026/09/21 10:44:04 INFO Completed upload id=35 worker1 # [ 115.762954] nix-grpc-daemon[1231]: time=2026-09-21T10:44:04.349Z level=INFO msg="Upload complete. (476ms)" worker1 # [ 115.774191] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51454 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 115.783559] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51454 lb # [ 115.779563] niks3-server[1025]: 2026/09/21 10:44:04 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo worker1 # [ 115.792956] nix-daemon[839]: accepted connection from pid 1113, user nix-grpc-daemon (trusted) worker1 # [ 115.795965] nix-daemon[839]: reaped child process 1229, status = succeeded client # [ 115.858920] nix[1204]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker1 # [ 115.808658] nix-daemon[839]: accepted connection from pid 1113, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 117.833233] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1566 (nix-grpc-daemon) on client request. lb # [ 117.842055] niks3-server[1025]: 2026/09/21 10:44:06 INFO lead: released remote=192.168.1.4:37214 worker2 # [ 117.850428] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. worker1 # [ 117.863058] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:06Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))" client # [ 117.916778] nix[1204]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 117.886373] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 117.896900] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 117.904952] nix-daemon[863]: reaped child process 1625, status = succeeded worker2 # [ 117.906547] systemd[1]: nix-grpc-daemon.service: Consumed 259ms CPU time over 5.388s wall clock time, 14.4M memory peak, 9.9K incoming IP traffic, 13.8K outgoing IP traffic. worker2 # [ 117.912402] systemd[1]: Starting scheduler-token.service... worker2 # [ 117.996524] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker2 # [ 118.003433] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 118.006316] systemd[1]: Finished scheduler-token.service. worker2 # [ 118.007654] systemd[1]: scheduler-token.service: Consumed 32ms CPU time over 88ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 118.011125] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 118.063076] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.185544] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:06Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 118.187284] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 118.191338] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:06Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 118.199586] nix-grpc-daemon[1656]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 118.211086] nix-grpc-daemon[1656]: E0000 00:00:1789987446.792544 1656 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 118.203119] niks3-server[1025]: 2026/09/21 10:44:06 INFO lead: acquired remote=192.168.1.4:37226 worker2 # [ 118.215075] nix-grpc-daemon[1656]: E0000 00:00:1789987446.794489 1656 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.45 seconds) worker2 # [ 118.224255] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket client: must succeed: sleep 5.0 worker2 # [ 118.225827] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:06Z level=info event=scheduler_take_over worker2 # [ 118.226880] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:06Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:56372 worker2 # [ 118.256304] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=1 worker2 # [ 118.258445] nix-grpc-daemon[1656]: E0000 00:00:1789987446.816048 1695 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 118.261108] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 118.261912] nix-grpc-daemon[1656]: E0000 00:00:1789987446.835751 1695 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 118.266833] nix-grpc-daemon[1656]: E0000 00:00:1789987446.835892 1695 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 118.271717] nix-grpc-daemon[1656]: E0000 00:00:1789987446.850604 1695 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 118.274451] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.278607] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:06Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 118.279882] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:06Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:56372 worker2 # [ 118.281823] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:06Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb # [ 121.943507] envoy[934]: conn peer=[2001:db8:1::4]:57588 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=3341 tx=334 ms=5057 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 123.635786] nix-daemon[839]: reaped child process 1256, status = succeeded worker1 # [ 123.801616] nix-daemon[839]: accepted connection from pid 1293, user nix-grpc-daemon (trusted) worker1 # [ 123.819233] nix-daemon[839]: reaped child process 1296, status = succeeded lb # [ 123.825334] niks3-server[1025]: 2026/09/21 10:44:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 123.844812] nix-grpc-daemon[1231]: time=2026-09-21T10:44:12.428Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 123.846523] nix-grpc-daemon[1231]: time=2026-09-21T10:44:12.428Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 123.863022] niks3-server[1025]: 2026/09/21 10:44:12 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 123.875769] niks3-server[1025]: 2026/09/21 10:44:12 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 123.884080] niks3-server[1025]: 2026/09/21 10:44:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 123.890993] niks3-server[1025]: 2026/09/21 10:44:12 INFO Signed narinfos id=36 count=1 worker1 # [ 123.899309] nix-grpc-daemon[1231]: time=2026-09-21T10:44:12.484Z level=INFO msg="Uploading 1 narinfos" lb # [ 123.908177] niks3-server[1025]: 2026/09/21 10:44:12 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete worker1 # [ 123.924144] nix-grpc-daemon[1231]: time=2026-09-21T10:44:12.510Z level=INFO msg="Upload complete. (300ms)" lb # [ 123.920202] niks3-server[1025]: 2026/09/21 10:44:12 INFO Completed upload id=36 worker1 # [ 123.937063] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51454 duration_s=8 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 lb # [ 123.943649] niks3-server[1025]: 2026/09/21 10:44:12 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls worker1 # [ 123.952390] nix-grpc-daemon[1231]: time=2026-09-21T10:44:12.538Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 123.958847] nix-daemon[839]: reaped child process 1254, status = succeeded client # [ 124.037908] systemd[1]: mid.service: Deactivated successfully. client # [ 124.042169] systemd[1]: mid.service: Consumed 205ms CPU time over 10.216s wall clock time, 43.2M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 11.08 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 124.871454] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: b0d65aee3c2d47008a28feeb969a1f91 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.05 seconds) worker2 # [ 125.068599] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 125.083704] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) client # [ 125.151483] nix[1240]: don't know how to build these paths: client # [ 125.153396] nix[1240]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker2 # [ 125.113963] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:13Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker2 # [ 125.121211] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:13Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 125.162021] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 125.181657] nix-grpc-daemon[1656]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 1/5) worker2 # [ 125.279146] nix-grpc-daemon[1656]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 126 ms (attempt 2/5) worker2 # [ 125.412944] nix-grpc-daemon[1656]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 305 ms (attempt 3/5) worker2 # [ 125.725679] nix-grpc-daemon[1656]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 535 ms (attempt 4/5) worker2 # [ 126.262383] nix-grpc-daemon[1656]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 126.269248] nix-grpc-daemon[1656]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 126.288687] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59426 client # [ 126.357224] nix[1240]: copying 1 paths to 'lb:50051'... worker2 # [ 126.307051] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59426 client # [ 126.357471] nix[1240]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker2 # [ 126.321681] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker2 # [ 126.349995] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:14Z level=info event=niks3_push_started pid=1734 worker2 # [ 126.569678] nix-grpc-daemon[1734]: time=2026-09-21T10:44:15.164Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 126.743980] nix-daemon[863]: accepted connection from pid 1747, user nix-grpc-daemon (trusted) worker2 # [ 126.760638] nix-daemon[863]: reaped child process 1750, status = succeeded worker2 # [ 126.934323] nix-daemon[863]: accepted connection from pid 1752, user nix-grpc-daemon (trusted) worker2 # [ 126.950396] nix-daemon[863]: reaped child process 1755, status = succeeded lb # [ 126.953311] niks3-server[1025]: 2026/09/21 10:44:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 126.977939] nix-grpc-daemon[1734]: time=2026-09-21T10:44:15.571Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 126.979493] nix-grpc-daemon[1734]: time=2026-09-21T10:44:15.571Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 126.999994] niks3-server[1025]: 2026/09/21 10:44:15 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst worker2 # [ 127.022622] nix-grpc-daemon[1734]: time=2026-09-21T10:44:15.616Z level=INFO msg="Uploading 1 narinfos" lb # [ 127.012805] niks3-server[1025]: 2026/09/21 10:44:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 127.025342] niks3-server[1025]: 2026/09/21 10:44:15 INFO Signed narinfos id=37 count=1 lb # [ 127.038386] niks3-server[1025]: 2026/09/21 10:44:15 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete worker2 # [ 127.059416] nix-grpc-daemon[1734]: time=2026-09-21T10:44:15.654Z level=INFO msg="Upload complete. (485ms)" lb # [ 127.051500] niks3-server[1025]: 2026/09/21 10:44:15 INFO Completed upload id=37 lb # [ 127.055592] niks3-server[1025]: 2026/09/21 10:44:15 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo worker2 # [ 127.068278] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59426 duration_s=0 paths=1 nar_bytes_in=424 lb # [ 127.064235] niks3-server[1025]: 2026/09/21 10:44:15 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls worker2 # [ 127.084342] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 127.090833] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker2 # [ 127.095766] nix-daemon[863]: reaped child process 1732, status = succeeded client # [ 127.156986] nix[1240]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker2 # [ 127.109277] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr worker2 # [ 128.533343] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:17Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv client # [ 128.583122] systemd[1]: intr.service: Sent signal SIGINT to main process 1240 (nix) on client request. client # [ 128.590887] nix[1240]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: systemctl kill -s INT intr, in 0.07 seconds) client # [ 128.598137] nix[1240]: [mutex.cc : 2506] RAW: thread should hold at least a read lock on Mutex 0xed34f33fc7b8 client # [ 128.616708] systemd-coredump[1254]: Process 1240 (nix) of user 0 terminated abnormally with signal 6/ABRT, processing... client # [ 128.639307] systemd[1]: Created slice Slice /system/systemd-coredump. client # [ 128.643450] systemd[1]: Started Process Core Dump (PID 1254/UID 0). worker2 # [ 128.733988] nix-daemon[863]: reaped child process 1757, status = succeeded worker2 # [ 128.737630] nix-daemon[1759]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 128.745258] nix-daemon[863]: reaped child process 1759, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 5.08 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 129.972977] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: fa34af4836cd4592b1212b085fb6a995 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.08 seconds) worker1 # [ 130.350541] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:51454 client # [ 130.411014] nix[1261]: don't know how to build these paths: client # [ 130.414132] nix[1261]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 130.373382] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:18Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker2 # [ 130.379677] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:18Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 130.427785] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51454 worker1 # [ 130.444080] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51454 client # [ 130.512284] nix[1261]: copying 1 paths to 'lb:50051'... worker1 # [ 130.458201] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51454 client # [ 130.516519] nix[1261]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker1 # [ 130.476926] nix-daemon[839]: accepted connection from pid 1113, user nix-grpc-daemon (trusted) worker1 # [ 130.682162] nix-daemon[839]: accepted connection from pid 1328, user nix-grpc-daemon (trusted) worker1 # [ 130.701114] nix-daemon[839]: reaped child process 1331, status = succeeded worker1 # [ 130.880586] nix-daemon[839]: accepted connection from pid 1333, user nix-grpc-daemon (trusted) worker1 # [ 130.899626] nix-daemon[839]: reaped child process 1336, status = succeeded lb # [ 130.905808] niks3-server[1025]: 2026/09/21 10:44:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 130.927326] nix-grpc-daemon[1231]: time=2026-09-21T10:44:19.513Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 130.929034] nix-grpc-daemon[1231]: time=2026-09-21T10:44:19.513Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 130.944175] niks3-server[1025]: 2026/09/21 10:44:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign worker1 # [ 130.958112] nix-grpc-daemon[1231]: time=2026-09-21T10:44:19.544Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.956279] niks3-server[1025]: 2026/09/21 10:44:19 INFO Signed narinfos id=38 count=1 client # [ 131.019688] systemd-coredump[1255]: Cannot store coredump of 1240 (nix): No space left on device lb # [ 130.965458] niks3-server[1025]: 2026/09/21 10:44:19 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst lb # [ 130.972598] niks3-server[1025]: 2026/09/21 10:44:19 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 130.984781] niks3-server[1025]: 2026/09/21 10:44:19 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 130.992125] niks3-server[1025]: 2026/09/21 10:44:19 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo lb # [ 130.997453] niks3-server[1025]: 2026/09/21 10:44:19 INFO Completed upload id=38 worker1 # [ 131.005461] nix-grpc-daemon[1231]: time=2026-09-21T10:44:19.591Z level=INFO msg="Upload complete. (511ms)" worker1 # [ 131.014400] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51454 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 131.031288] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51454 worker1 # [ 131.038528] nix-daemon[839]: accepted connection from pid 1113, user nix-grpc-daemon (trusted) worker1 # [ 131.043705] nix-daemon[839]: reaped child process 1326, status = succeeded client # [ 131.108462] nix[1261]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker1 # [ 131.059742] nix-daemon[839]: accepted connection from pid 1113, user nix-grpc-daemon (trusted) client # [ 131.150814] systemd-coredump[1255]: Process 1240 (nix) of user 0 terminated abnormally without generating a coredump. client # [ 131.170077] systemd[1]: systemd-coredump@0-1-1254_1255-0.service: Deactivated successfully. client # [ 131.171524] systemd[1]: systemd-coredump@0-1-1254_1255-0.service: Consumed 1.905s CPU time over 2.519s wall clock time, 968.7M memory peak, 926.2M written to disk. client # [ 131.185965] systemd[1]: intr.service: Main process exited, code=dumped, status=6/ABRT client # [ 131.188763] systemd[1]: intr.service: Failed with result 'core-dump'. client # [ 131.189971] systemd[1]: intr.service: Consumed 361ms CPU time over 6.316s wall clock time, 41.4M memory peak, 32K written to disk, 6.5K incoming IP traffic, 8.3K outgoing IP traffic. lb # [ 131.943620] envoy[934]: conn peer=[2001:db8:1::1]:41810 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3078 tx=1518 ms=9906 lb # [ 131.948799] envoy[934]: conn peer=[2001:db8:1::1]:48126 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3000 tx=853 ms=6056 worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 132.591116] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 132.641313] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.10 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 worker1 # [ 132.970705] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:51454 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 132.985033] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 133.012129] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:21Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker2 # [ 133.018753] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:21Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=1 worker1 # [ 133.025832] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:21Z level=info event=draining worker2 # [ 133.031178] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 133.046137] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59426 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker2 # [ 133.062103] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 133.077024] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker2 # [ 133.275450] nix-daemon[863]: accepted connection from pid 1814, user nix-grpc-daemon (trusted) worker2 # [ 133.294075] nix-daemon[863]: reaped child process 1817, status = succeeded worker2 # [ 133.465683] nix-daemon[863]: accepted connection from pid 1819, user nix-grpc-daemon (trusted) worker2 # [ 133.483042] nix-daemon[863]: reaped child process 1822, status = succeeded lb # [ 133.485907] niks3-server[1025]: 2026/09/21 10:44:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 133.506619] nix-grpc-daemon[1734]: time=2026-09-21T10:44:22.101Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 133.508171] nix-grpc-daemon[1734]: time=2026-09-21T10:44:22.101Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 133.514688] niks3-server[1025]: 2026/09/21 10:44:22 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst lb # [ 133.530098] niks3-server[1025]: 2026/09/21 10:44:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign worker2 # [ 133.544362] nix-grpc-daemon[1734]: time=2026-09-21T10:44:22.139Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.537057] niks3-server[1025]: 2026/09/21 10:44:22 INFO Signed narinfos id=39 count=1 lb # [ 133.542230] niks3-server[1025]: 2026/09/21 10:44:22 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 133.553435] niks3-server[1025]: 2026/09/21 10:44:22 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete worker2 # [ 133.562799] nix-grpc-daemon[1734]: time=2026-09-21T10:44:22.157Z level=INFO msg="Upload complete. (470ms)" lb # [ 133.557489] niks3-server[1025]: 2026/09/21 10:44:22 INFO Completed upload id=39 worker2 # [ 133.568411] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59426 duration_s=0 paths=1 nar_bytes_in=528 lb # [ 133.560345] niks3-server[1025]: 2026/09/21 10:44:22 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo worker2 # [ 133.579997] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 133.583183] nix-daemon[863]: reaped child process 1812, status = succeeded worker2 # [ 133.589945] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... worker2 # [ 133.600175] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 134.443155] nix-daemon[863]: reaped child process 1826, status = succeeded worker2 # [ 134.631618] nix-daemon[863]: accepted connection from pid 1842, user nix-grpc-daemon (trusted) worker2 # [ 134.650181] nix-daemon[863]: reaped child process 1845, status = succeeded lb # [ 134.652904] niks3-server[1025]: 2026/09/21 10:44:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 134.675728] nix-grpc-daemon[1734]: time=2026-09-21T10:44:23.267Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 134.678030] nix-grpc-daemon[1734]: time=2026-09-21T10:44:23.267Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 134.686198] niks3-server[1025]: 2026/09/21 10:44:23 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 134.702668] niks3-server[1025]: 2026/09/21 10:44:23 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 134.715023] niks3-server[1025]: 2026/09/21 10:44:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign worker2 # [ 134.734335] nix-grpc-daemon[1734]: time=2026-09-21T10:44:23.328Z level=INFO msg="Uploading 1 narinfos" lb # [ 134.732298] niks3-server[1025]: 2026/09/21 10:44:23 INFO Signed narinfos id=40 count=1 lb # [ 134.734558] niks3-server[1025]: 2026/09/21 10:44:23 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 134.746347] niks3-server[1025]: 2026/09/21 10:44:23 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 134.750298] niks3-server[1025]: 2026/09/21 10:44:23 INFO Completed upload id=40 worker2 # [ 134.759788] nix-grpc-daemon[1734]: time=2026-09-21T10:44:23.354Z level=INFO msg="Upload complete. (348ms)" lb # [ 134.752513] niks3-server[1025]: 2026/09/21 10:44:23 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker2 # [ 134.777133] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=3 outputs=1 worker2 # [ 134.792410] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:23Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker2 # [ 134.796003] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:23Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 134.801713] nix-daemon[863]: reaped child process 1824, status = succeeded worker2 # [ 134.821916] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 134.837200] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 134.851622] nix-grpc-daemon[1734]: time=2026-09-21T10:44:23.446Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker2 # [ 134.861420] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 134.875164] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker2 # [ 135.083589] nix-daemon[863]: accepted connection from pid 1851, user nix-grpc-daemon (trusted) worker2 # [ 135.099953] nix-daemon[863]: reaped child process 1854, status = succeeded worker2 # [ 135.272946] nix-daemon[863]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker2 # [ 135.288979] nix-daemon[863]: reaped child process 1859, status = succeeded lb # [ 135.292162] niks3-server[1025]: 2026/09/21 10:44:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 135.310873] nix-grpc-daemon[1734]: time=2026-09-21T10:44:23.905Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 135.312490] nix-grpc-daemon[1734]: time=2026-09-21T10:44:23.905Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 135.318650] niks3-server[1025]: 2026/09/21 10:44:23 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst lb # [ 135.333912] niks3-server[1025]: 2026/09/21 10:44:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign worker2 # [ 135.350020] nix-grpc-daemon[1734]: time=2026-09-21T10:44:23.944Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.346879] niks3-server[1025]: 2026/09/21 10:44:23 INFO Signed narinfos id=41 count=1 lb # [ 135.355563] niks3-server[1025]: 2026/09/21 10:44:23 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls worker2 # [ 135.370760] nix-grpc-daemon[1734]: time=2026-09-21T10:44:23.965Z level=INFO msg="Upload complete. (477ms)" lb # [ 135.362032] niks3-server[1025]: 2026/09/21 10:44:23 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 135.367152] niks3-server[1025]: 2026/09/21 10:44:23 INFO Completed upload id=41 worker2 # [ 135.380213] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59426 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 135.370655] niks3-server[1025]: 2026/09/21 10:44:23 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker2 # [ 135.384349] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 135.395498] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker2 # [ 135.397483] nix-daemon[863]: reaped child process 1849, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... worker2 # [ 135.409800] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 136.833481] nix-daemon[863]: reaped child process 1863, status = succeeded worker2 # [ 137.001858] nix-daemon[863]: accepted connection from pid 1879, user nix-grpc-daemon (trusted) worker2 # [ 137.018429] nix-daemon[863]: reaped child process 1882, status = succeeded lb # [ 137.021350] niks3-server[1025]: 2026/09/21 10:44:25 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 137.041209] nix-grpc-daemon[1734]: time=2026-09-21T10:44:25.635Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 137.042659] nix-grpc-daemon[1734]: time=2026-09-21T10:44:25.635Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 137.063767] niks3-server[1025]: 2026/09/21 10:44:25 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker2 # [ 137.085309] nix-grpc-daemon[1734]: time=2026-09-21T10:44:25.680Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.078071] niks3-server[1025]: 2026/09/21 10:44:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 137.087733] niks3-server[1025]: 2026/09/21 10:44:25 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 137.093643] niks3-server[1025]: 2026/09/21 10:44:25 INFO Signed narinfos id=42 count=1 lb # [ 137.101456] niks3-server[1025]: 2026/09/21 10:44:25 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls worker2 # [ 137.115174] nix-grpc-daemon[1734]: time=2026-09-21T10:44:25.710Z level=INFO msg="Upload complete. (296ms)" lb # [ 137.106153] niks3-server[1025]: 2026/09/21 10:44:25 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 137.111662] niks3-server[1025]: 2026/09/21 10:44:25 INFO Completed upload id=42 lb # [ 137.114798] niks3-server[1025]: 2026/09/21 10:44:25 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker2 # [ 137.129297] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=4 outputs=1 worker2 # [ 137.144613] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:25Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker2 # [ 137.149332] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:25Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 137.153458] nix-daemon[863]: reaped child process 1861, status = succeeded worker2 # [ 137.185841] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 137.204506] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 137.219760] nix-grpc-daemon[1734]: time=2026-09-21T10:44:25.814Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker2 # [ 137.229917] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 137.243188] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker2 # [ 137.439876] nix-daemon[863]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker2 # [ 137.458840] nix-daemon[863]: reaped child process 1891, status = succeeded worker2 # [ 137.627017] nix-daemon[863]: accepted connection from pid 1893, user nix-grpc-daemon (trusted) worker2 # [ 137.642850] nix-daemon[863]: reaped child process 1896, status = succeeded lb # [ 137.644886] niks3-server[1025]: 2026/09/21 10:44:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 137.665280] nix-grpc-daemon[1734]: time=2026-09-21T10:44:26.260Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 137.666741] nix-grpc-daemon[1734]: time=2026-09-21T10:44:26.260Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 137.675533] niks3-server[1025]: 2026/09/21 10:44:26 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst lb # [ 137.688494] niks3-server[1025]: 2026/09/21 10:44:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign worker2 # [ 137.705752] nix-grpc-daemon[1734]: time=2026-09-21T10:44:26.300Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.697876] niks3-server[1025]: 2026/09/21 10:44:26 INFO Signed narinfos id=43 count=1 lb # [ 137.704236] niks3-server[1025]: 2026/09/21 10:44:26 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 137.714114] niks3-server[1025]: 2026/09/21 10:44:26 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 137.722138] niks3-server[1025]: 2026/09/21 10:44:26 INFO Completed upload id=43 worker2 # [ 137.731730] nix-grpc-daemon[1734]: time=2026-09-21T10:44:26.326Z level=INFO msg="Upload complete. (472ms)" lb # [ 137.725001] niks3-server[1025]: 2026/09/21 10:44:26 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker2 # [ 137.740305] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59426 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 137.753047] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 137.760461] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker2 # [ 137.763660] nix-daemon[863]: reaped child process 1886, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... worker2 # [ 137.773226] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 139.012800] nix-daemon[863]: reaped child process 1900, status = succeeded worker2 # [ 139.187661] nix-daemon[863]: accepted connection from pid 1916, user nix-grpc-daemon (trusted) worker2 # [ 139.203102] nix-daemon[863]: reaped child process 1919, status = succeeded lb # [ 139.210013] niks3-server[1025]: 2026/09/21 10:44:27 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 139.231648] nix-grpc-daemon[1734]: time=2026-09-21T10:44:27.824Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 139.233755] nix-grpc-daemon[1734]: time=2026-09-21T10:44:27.824Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 139.247402] niks3-server[1025]: 2026/09/21 10:44:27 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 139.259613] niks3-server[1025]: 2026/09/21 10:44:27 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 139.267536] niks3-server[1025]: 2026/09/21 10:44:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker2 # [ 139.281702] nix-grpc-daemon[1734]: time=2026-09-21T10:44:27.876Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.276540] niks3-server[1025]: 2026/09/21 10:44:27 INFO Signed narinfos id=44 count=1 lb # [ 139.282156] niks3-server[1025]: 2026/09/21 10:44:27 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 139.288302] niks3-server[1025]: 2026/09/21 10:44:27 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 139.296959] niks3-server[1025]: 2026/09/21 10:44:27 INFO Completed upload id=44 worker2 # [ 139.306624] nix-grpc-daemon[1734]: time=2026-09-21T10:44:27.901Z level=INFO msg="Upload complete. (322ms)" lb # [ 139.300353] niks3-server[1025]: 2026/09/21 10:44:27 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker2 # [ 139.321170] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=5 outputs=1 worker2 # [ 139.337388] nix-daemon[863]: reaped child process 1898, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.67 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 139.687271] nix-daemon[839]: reaped child process 1340, status = succeeded worker1 # [ 139.844307] nix-daemon[839]: accepted connection from pid 1382, user nix-grpc-daemon (trusted) worker1 # [ 139.862981] nix-daemon[839]: reaped child process 1385, status = succeeded lb # [ 139.867071] niks3-server[1025]: 2026/09/21 10:44:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 139.885649] nix-grpc-daemon[1231]: time=2026-09-21T10:44:28.471Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 139.887135] nix-grpc-daemon[1231]: time=2026-09-21T10:44:28.471Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 139.897799] niks3-server[1025]: 2026/09/21 10:44:28 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv lb # [ 139.911249] niks3-server[1025]: 2026/09/21 10:44:28 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst worker1 # [ 139.930592] nix-grpc-daemon[1231]: time=2026-09-21T10:44:28.516Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.923553] niks3-server[1025]: 2026/09/21 10:44:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 139.932360] niks3-server[1025]: 2026/09/21 10:44:28 INFO Signed narinfos id=45 count=1 lb # [ 139.934396] niks3-server[1025]: 2026/09/21 10:44:28 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 139.944463] niks3-server[1025]: 2026/09/21 10:44:28 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 139.948210] niks3-server[1025]: 2026/09/21 10:44:28 INFO Completed upload id=45 worker1 # [ 139.956387] nix-grpc-daemon[1231]: time=2026-09-21T10:44:28.542Z level=INFO msg="Upload complete. (281ms)" lb # [ 139.950361] niks3-server[1025]: 2026/09/21 10:44:28 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker1 # [ 139.968794] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51454 duration_s=8 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=2 outputs=1 worker1 # [ 139.980499] nix-daemon[839]: reaped child process 1338, status = succeeded client # [ 140.059554] systemd[1]: sw.service: Deactivated successfully. client # [ 140.063814] systemd[1]: sw.service: Consumed 196ms CPU time over 10.089s wall clock time, 39.3M memory peak, 8K written to disk, 7K incoming IP traffic, 8.2K outgoing IP traffic. worker1 # [ 140.026965] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:28Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 141.262741] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:56372 worker1 # [ 141.265024] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:29Z level=info event=scheduler_restarting worker2 # [ 141.263128] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:29Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 141.288610] nix-grpc-daemon[1113]: ts=2026-09-21T10:44:29Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 141.313808] nix-daemon[839]: reaped child process 1172, status = succeeded lb # [ 141.944557] envoy[934]: conn peer=[2001:db8:1::1]:48596 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9651 tx=4089 ms=6362 worker1 # [ 142.101719] nix-grpc-daemon[1113]: E0000 00:00:1789987470.687991 1158 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 142.139058] nix-grpc-daemon[1113]: E0000 00:00:1789987470.725267 1158 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 142.511415] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 142.518982] systemd[1]: nix-grpc-daemon.service: Consumed 1.125s CPU time over 42.720s wall clock time, 34.1M memory peak, 27.7K incoming IP traffic, 40.7K outgoing IP traffic. worker1 # [ 142.538537] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 141.949822] envoy[934]: conn peer=[2001:db8:1::1]:48136 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1429 ms=9643 lb # [ 141.949981] envoy[934]: conn peer=[2001:db8:1::3]:46238 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3107 tx=929 ms=41191 worker1 # [ 142.738976] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:31Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 142.741740] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:31Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 142.746170] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:31Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 142.755327] nix-grpc-daemon[1399]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 142.764410] nix-grpc-daemon[1399]: E0000 00:00:1789987471.339400 1399 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 142.768591] nix-grpc-daemon[1399]: E0000 00:00:1789987471.341712 1399 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 142.771977] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:31Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 142.775377] systemd[1]: Started Nix worker-protocol over gRPC. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.95 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 142.780124] nix-grpc-daemon[1399]: E0000 00:00:1789987471.364605 1441 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 142.808047] nix-grpc-daemon[1399]: E0000 00:00:1789987471.382622 1441 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 142.810396] nix-grpc-daemon[1399]: E0000 00:00:1789987471.382847 1441 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 142.816776] nix-grpc-daemon[1399]: E0000 00:00:1789987471.402258 1441 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 142.831902] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 142.836251] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:31Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:56372 worker2 # [ 142.836636] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:31Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.23 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 144.353925] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 144.361657] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 144.403536] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:32Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker2 # [ 144.409566] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:32Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 144.415503] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:32Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker2 # [ 144.420727] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:32Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 144.454983] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 144.470022] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 144.495064] nix-grpc-daemon[1399]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 74 ms (attempt 1/5) worker1 # [ 144.576558] nix-grpc-daemon[1399]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 164 ms (attempt 2/5) worker1 # [ 144.740892] nix-grpc-daemon[1399]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 3/5) worker1 # [ 144.751248] nix-grpc-daemon[1399]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 4/5) worker1 # [ 144.943843] nix-grpc-daemon[1399]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 144.949322] nix-grpc-daemon[1399]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 144.967331] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 144.981861] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 144.996104] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 145.024501] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:33Z level=info event=niks3_push_started pid=1459 worker1 # [ 145.240629] nix-grpc-daemon[1459]: time=2026-09-21T10:44:33.826Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 145.412166] nix-daemon[839]: accepted connection from pid 1472, user nix-grpc-daemon (trusted) worker1 # [ 145.430077] nix-daemon[839]: reaped child process 1475, status = succeeded worker1 # [ 145.602460] nix-daemon[839]: accepted connection from pid 1477, user nix-grpc-daemon (trusted) worker1 # [ 145.620210] nix-daemon[839]: reaped child process 1480, status = succeeded lb # [ 145.627305] niks3-server[1025]: 2026/09/21 10:44:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 145.647291] nix-grpc-daemon[1459]: time=2026-09-21T10:44:34.232Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 145.649422] nix-grpc-daemon[1459]: time=2026-09-21T10:44:34.232Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 145.666944] niks3-server[1025]: 2026/09/21 10:44:34 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst lb # [ 145.679351] niks3-server[1025]: 2026/09/21 10:44:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign worker1 # [ 145.694567] nix-grpc-daemon[1459]: time=2026-09-21T10:44:34.280Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.693035] niks3-server[1025]: 2026/09/21 10:44:34 INFO Signed narinfos id=46 count=1 lb # [ 145.702940] niks3-server[1025]: 2026/09/21 10:44:34 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 145.712896] niks3-server[1025]: 2026/09/21 10:44:34 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 145.721747] niks3-server[1025]: 2026/09/21 10:44:34 INFO Completed upload id=46 worker1 # [ 145.729912] nix-grpc-daemon[1459]: time=2026-09-21T10:44:34.316Z level=INFO msg="Upload complete. (485ms)" lb # [ 145.724921] niks3-server[1025]: 2026/09/21 10:44:34 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 145.741110] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 145.756591] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 145.766975] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 145.769578] nix-daemon[839]: reaped child process 1457, status = succeeded worker1 # [ 145.784751] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 147.217031] nix-daemon[839]: reaped child process 1484, status = succeeded worker1 # [ 147.385141] nix-daemon[839]: accepted connection from pid 1500, user nix-grpc-daemon (trusted) worker1 # [ 147.404839] nix-daemon[839]: reaped child process 1503, status = succeeded lb # [ 147.409296] niks3-server[1025]: 2026/09/21 10:44:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 147.432386] nix-grpc-daemon[1459]: time=2026-09-21T10:44:36.015Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 147.433923] nix-grpc-daemon[1459]: time=2026-09-21T10:44:36.015Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 147.455030] niks3-server[1025]: 2026/09/21 10:44:36 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 147.466093] niks3-server[1025]: 2026/09/21 10:44:36 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 147.476087] niks3-server[1025]: 2026/09/21 10:44:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 147.481347] niks3-server[1025]: 2026/09/21 10:44:36 INFO Signed narinfos id=47 count=1 worker1 # [ 147.489997] nix-grpc-daemon[1459]: time=2026-09-21T10:44:36.075Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.485229] niks3-server[1025]: 2026/09/21 10:44:36 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 147.496770] niks3-server[1025]: 2026/09/21 10:44:36 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 147.502163] niks3-server[1025]: 2026/09/21 10:44:36 INFO Completed upload id=47 worker1 # [ 147.510310] nix-grpc-daemon[1459]: time=2026-09-21T10:44:36.096Z level=INFO msg="Upload complete. (313ms)" lb # [ 147.504848] niks3-server[1025]: 2026/09/21 10:44:36 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker2 # [ 147.520960] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:36Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 147.520929] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=6 outputs=1 worker2 # [ 147.536162] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:36Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 147.538414] nix-daemon[839]: reaped child process 1482, status = succeeded worker1 # [ 147.575280] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 147.595569] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 147.613014] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 147.632757] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 147.842962] nix-daemon[839]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 147.863771] nix-daemon[839]: reaped child process 1510, status = succeeded worker1 # [ 148.041694] nix-daemon[839]: accepted connection from pid 1512, user nix-grpc-daemon (trusted) worker1 # [ 148.058687] nix-daemon[839]: reaped child process 1515, status = succeeded lb # [ 148.061400] niks3-server[1025]: 2026/09/21 10:44:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.079208] nix-grpc-daemon[1459]: time=2026-09-21T10:44:36.665Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 148.080895] nix-grpc-daemon[1459]: time=2026-09-21T10:44:36.665Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 148.087126] niks3-server[1025]: 2026/09/21 10:44:36 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst worker1 # [ 148.108898] nix-grpc-daemon[1459]: time=2026-09-21T10:44:36.695Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.102192] niks3-server[1025]: 2026/09/21 10:44:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 148.113108] niks3-server[1025]: 2026/09/21 10:44:36 INFO Signed narinfos id=48 count=1 lb # [ 148.120328] niks3-server[1025]: 2026/09/21 10:44:36 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 148.128953] niks3-server[1025]: 2026/09/21 10:44:36 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete worker1 # [ 148.141172] nix-grpc-daemon[1459]: time=2026-09-21T10:44:36.727Z level=INFO msg="Upload complete. (490ms)" lb # [ 148.133841] niks3-server[1025]: 2026/09/21 10:44:36 INFO Completed upload id=48 lb # [ 148.137627] niks3-server[1025]: 2026/09/21 10:44:36 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 148.148111] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 148.158500] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 148.166868] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 148.169207] nix-daemon[839]: reaped child process 1505, status = succeeded worker1 # [ 148.183396] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 149.629061] nix-daemon[839]: reaped child process 1519, status = succeeded worker1 # [ 149.811777] nix-daemon[839]: accepted connection from pid 1535, user nix-grpc-daemon (trusted) worker1 # [ 149.829970] nix-daemon[839]: reaped child process 1538, status = succeeded lb # [ 149.834946] niks3-server[1025]: 2026/09/21 10:44:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 149.853056] nix-grpc-daemon[1459]: time=2026-09-21T10:44:38.438Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 149.854508] nix-grpc-daemon[1459]: time=2026-09-21T10:44:38.438Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 149.869529] niks3-server[1025]: 2026/09/21 10:44:38 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 149.881389] niks3-server[1025]: 2026/09/21 10:44:38 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst worker1 # [ 149.901735] nix-grpc-daemon[1459]: time=2026-09-21T10:44:38.487Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.895411] niks3-server[1025]: 2026/09/21 10:44:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 149.903072] niks3-server[1025]: 2026/09/21 10:44:38 INFO Signed narinfos id=49 count=1 lb # [ 149.906911] niks3-server[1025]: 2026/09/21 10:44:38 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 149.913058] niks3-server[1025]: 2026/09/21 10:44:38 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 149.916961] niks3-server[1025]: 2026/09/21 10:44:38 INFO Completed upload id=49 worker1 # [ 149.925100] nix-grpc-daemon[1459]: time=2026-09-21T10:44:38.511Z level=INFO msg="Upload complete. (330ms)" lb # [ 149.919304] niks3-server[1025]: 2026/09/21 10:44:38 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker2 # [ 149.934864] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:38Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 149.937165] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=7 outputs=1 worker2 # [ 149.947529] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:38Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 149.956381] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 149.966562] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 149.971914] nix-daemon[839]: reaped child process 1517, status = succeeded worker1 # [ 149.979034] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 149.990678] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 150.187161] nix-daemon[839]: accepted connection from pid 1542, user nix-grpc-daemon (trusted) worker1 # [ 150.203241] nix-daemon[839]: reaped child process 1545, status = succeeded worker1 # [ 150.376827] nix-daemon[839]: accepted connection from pid 1547, user nix-grpc-daemon (trusted) worker1 # [ 150.392761] nix-daemon[839]: reaped child process 1550, status = succeeded lb # [ 150.398044] niks3-server[1025]: 2026/09/21 10:44:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.415205] nix-grpc-daemon[1459]: time=2026-09-21T10:44:39.001Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 150.416912] nix-grpc-daemon[1459]: time=2026-09-21T10:44:39.001Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 150.428216] niks3-server[1025]: 2026/09/21 10:44:39 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst lb # [ 150.438559] niks3-server[1025]: 2026/09/21 10:44:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign worker1 # [ 150.452772] nix-grpc-daemon[1459]: time=2026-09-21T10:44:39.039Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.449065] niks3-server[1025]: 2026/09/21 10:44:39 INFO Signed narinfos id=50 count=1 lb # [ 150.451850] niks3-server[1025]: 2026/09/21 10:44:39 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 150.461636] niks3-server[1025]: 2026/09/21 10:44:39 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 150.468328] niks3-server[1025]: 2026/09/21 10:44:39 INFO Completed upload id=50 worker1 # [ 150.476355] nix-grpc-daemon[1459]: time=2026-09-21T10:44:39.062Z level=INFO msg="Upload complete. (472ms)" lb # [ 150.471172] niks3-server[1025]: 2026/09/21 10:44:39 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 150.484141] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 150.495521] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 150.501992] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 150.506524] nix-daemon[839]: reaped child process 1540, status = succeeded worker1 # [ 150.517122] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 151.344389] nix-daemon[839]: reaped child process 1554, status = succeeded worker1 # [ 151.501859] nix-daemon[839]: accepted connection from pid 1570, user nix-grpc-daemon (trusted) worker1 # [ 151.519462] nix-daemon[839]: reaped child process 1573, status = succeeded lb # [ 151.524959] niks3-server[1025]: 2026/09/21 10:44:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.543587] nix-grpc-daemon[1459]: time=2026-09-21T10:44:40.128Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 151.545286] nix-grpc-daemon[1459]: time=2026-09-21T10:44:40.128Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 151.557936] niks3-server[1025]: 2026/09/21 10:44:40 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 151.568294] niks3-server[1025]: 2026/09/21 10:44:40 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst worker1 # [ 151.587324] nix-grpc-daemon[1459]: time=2026-09-21T10:44:40.173Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.583521] niks3-server[1025]: 2026/09/21 10:44:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 151.594495] niks3-server[1025]: 2026/09/21 10:44:40 INFO Signed narinfos id=51 count=1 worker1 # [ 151.606768] nix-grpc-daemon[1459]: time=2026-09-21T10:44:40.193Z level=INFO msg="Upload complete. (277ms)" lb # [ 151.599284] niks3-server[1025]: 2026/09/21 10:44:40 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 151.604110] niks3-server[1025]: 2026/09/21 10:44:40 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 151.608281] niks3-server[1025]: 2026/09/21 10:44:40 INFO Completed upload id=51 worker2 # [ 151.615790] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:40Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 lb # [ 151.610379] niks3-server[1025]: 2026/09/21 10:44:40 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker1 # [ 151.616803] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=8 outputs=1 worker2 # [ 151.627858] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:40Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 151.629848] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 151.634980] nix-daemon[839]: reaped child process 1552, status = succeeded worker1 # [ 151.641371] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 151.651622] nix-grpc-daemon[1459]: time=2026-09-21T10:44:40.238Z level=INFO msg="All 1 paths already cached" worker1 # [ 151.658358] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 151.668106] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 151.852857] nix-daemon[839]: accepted connection from pid 1577, user nix-grpc-daemon (trusted) worker1 # [ 151.869862] nix-daemon[839]: reaped child process 1580, status = succeeded worker1 # [ 152.041091] nix-daemon[839]: accepted connection from pid 1582, user nix-grpc-daemon (trusted) worker1 # [ 152.057885] nix-daemon[839]: reaped child process 1585, status = succeeded lb # [ 152.061975] niks3-server[1025]: 2026/09/21 10:44:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.078508] nix-grpc-daemon[1459]: time=2026-09-21T10:44:40.664Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 152.079963] nix-grpc-daemon[1459]: time=2026-09-21T10:44:40.664Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 152.087565] niks3-server[1025]: 2026/09/21 10:44:40 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst worker1 # [ 152.107610] nix-grpc-daemon[1459]: time=2026-09-21T10:44:40.693Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.101691] niks3-server[1025]: 2026/09/21 10:44:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 152.111965] niks3-server[1025]: 2026/09/21 10:44:40 INFO Signed narinfos id=52 count=1 lb # [ 152.119146] niks3-server[1025]: 2026/09/21 10:44:40 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete worker1 # [ 152.136698] nix-grpc-daemon[1459]: time=2026-09-21T10:44:40.723Z level=INFO msg="Upload complete. (457ms)" lb # [ 152.129316] niks3-server[1025]: 2026/09/21 10:44:40 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 152.134739] niks3-server[1025]: 2026/09/21 10:44:40 INFO Completed upload id=52 worker1 # [ 152.142550] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 152.138303] niks3-server[1025]: 2026/09/21 10:44:40 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 152.155065] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 152.160423] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 152.164544] nix-daemon[839]: reaped child process 1575, status = succeeded worker1 # [ 152.175135] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 153.819538] nix-daemon[839]: reaped child process 1589, status = succeeded worker1 # [ 153.999058] nix-daemon[839]: accepted connection from pid 1605, user nix-grpc-daemon (trusted) worker1 # [ 154.016256] nix-daemon[839]: reaped child process 1608, status = succeeded lb # [ 154.021988] niks3-server[1025]: 2026/09/21 10:44:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.040422] nix-grpc-daemon[1459]: time=2026-09-21T10:44:42.624Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 154.042072] nix-grpc-daemon[1459]: time=2026-09-21T10:44:42.624Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 154.049592] niks3-server[1025]: 2026/09/21 10:44:42 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 154.069050] niks3-server[1025]: 2026/09/21 10:44:42 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst lb # [ 154.079269] niks3-server[1025]: 2026/09/21 10:44:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign worker1 # [ 154.091974] nix-grpc-daemon[1459]: time=2026-09-21T10:44:42.678Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.089000] niks3-server[1025]: 2026/09/21 10:44:42 INFO Signed narinfos id=53 count=1 lb # [ 154.091550] niks3-server[1025]: 2026/09/21 10:44:42 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 154.100824] niks3-server[1025]: 2026/09/21 10:44:42 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 154.107745] niks3-server[1025]: 2026/09/21 10:44:42 INFO Completed upload id=53 worker1 # [ 154.115833] nix-grpc-daemon[1459]: time=2026-09-21T10:44:42.702Z level=INFO msg="Upload complete. (331ms)" lb # [ 154.110830] niks3-server[1025]: 2026/09/21 10:44:42 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker2 # [ 154.127525] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:42Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 154.129163] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=9 outputs=1 worker2 # [ 154.140788] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:42Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 154.146264] nix-daemon[839]: reaped child process 1587, status = succeeded worker1 # [ 154.181010] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 154.196146] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 154.209874] nix-grpc-daemon[1459]: time=2026-09-21T10:44:42.796Z level=INFO msg="All 1 paths already cached" worker1 # [ 154.218482] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 154.232809] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 154.441344] nix-daemon[839]: accepted connection from pid 1612, user nix-grpc-daemon (trusted) worker1 # [ 154.461115] nix-daemon[839]: reaped child process 1615, status = succeeded worker1 # [ 154.637333] nix-daemon[839]: accepted connection from pid 1617, user nix-grpc-daemon (trusted) worker1 # [ 154.653380] nix-daemon[839]: reaped child process 1620, status = succeeded lb # [ 154.656315] niks3-server[1025]: 2026/09/21 10:44:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.673839] nix-grpc-daemon[1459]: time=2026-09-21T10:44:43.260Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 154.675302] nix-grpc-daemon[1459]: time=2026-09-21T10:44:43.260Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 154.684653] niks3-server[1025]: 2026/09/21 10:44:43 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst lb # [ 154.699861] niks3-server[1025]: 2026/09/21 10:44:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign worker1 # [ 154.718074] nix-grpc-daemon[1459]: time=2026-09-21T10:44:43.304Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.710098] niks3-server[1025]: 2026/09/21 10:44:43 INFO Signed narinfos id=54 count=1 lb # [ 154.717497] niks3-server[1025]: 2026/09/21 10:44:43 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 154.730180] niks3-server[1025]: 2026/09/21 10:44:43 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 154.738340] niks3-server[1025]: 2026/09/21 10:44:43 INFO Completed upload id=54 worker1 # [ 154.746409] nix-grpc-daemon[1459]: time=2026-09-21T10:44:43.332Z level=INFO msg="Upload complete. (497ms)" lb # [ 154.741665] niks3-server[1025]: 2026/09/21 10:44:43 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 154.756291] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 154.768754] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 154.776584] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 154.781852] nix-daemon[839]: reaped child process 1610, status = succeeded worker1 # [ 154.796564] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 156.042280] nix-daemon[839]: reaped child process 1624, status = succeeded worker1 # [ 156.222740] nix-daemon[839]: accepted connection from pid 1640, user nix-grpc-daemon (trusted) worker1 # [ 156.239222] nix-daemon[839]: reaped child process 1643, status = succeeded lb # [ 156.243935] niks3-server[1025]: 2026/09/21 10:44:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.263241] nix-grpc-daemon[1459]: time=2026-09-21T10:44:44.847Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 156.264995] nix-grpc-daemon[1459]: time=2026-09-21T10:44:44.848Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 156.277388] niks3-server[1025]: 2026/09/21 10:44:44 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 156.296388] niks3-server[1025]: 2026/09/21 10:44:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker1 # [ 156.311061] nix-grpc-daemon[1459]: time=2026-09-21T10:44:44.897Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.306676] niks3-server[1025]: 2026/09/21 10:44:44 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 156.314844] niks3-server[1025]: 2026/09/21 10:44:44 INFO Signed narinfos id=55 count=1 lb # [ 156.321182] niks3-server[1025]: 2026/09/21 10:44:44 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls worker1 # [ 156.328843] nix-grpc-daemon[1459]: time=2026-09-21T10:44:44.915Z level=INFO msg="Upload complete. (321ms)" lb # [ 156.324526] niks3-server[1025]: 2026/09/21 10:44:44 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 156.328256] niks3-server[1025]: 2026/09/21 10:44:44 INFO Completed upload id=55 lb # [ 156.330161] niks3-server[1025]: 2026/09/21 10:44:44 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker1 # [ 156.341006] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=10 outputs=1 worker2 # [ 156.345626] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:44Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 156.357833] nix-daemon[839]: reaped child process 1622, status = succeeded worker2 # [ 156.358804] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:44Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 156.396174] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 156.411658] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 156.425497] nix-grpc-daemon[1459]: time=2026-09-21T10:44:45.011Z level=INFO msg="All 1 paths already cached" worker1 # [ 156.434121] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 156.447976] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 156.659394] nix-daemon[839]: accepted connection from pid 1647, user nix-grpc-daemon (trusted) worker1 # [ 156.678031] nix-daemon[839]: reaped child process 1650, status = succeeded worker1 # [ 156.850498] nix-daemon[839]: accepted connection from pid 1652, user nix-grpc-daemon (trusted) worker1 # [ 156.866735] nix-daemon[839]: reaped child process 1655, status = succeeded lb # [ 156.869964] niks3-server[1025]: 2026/09/21 10:44:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.887167] nix-grpc-daemon[1459]: time=2026-09-21T10:44:45.473Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 156.888728] nix-grpc-daemon[1459]: time=2026-09-21T10:44:45.473Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 156.894469] niks3-server[1025]: 2026/09/21 10:44:45 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst lb # [ 156.908697] niks3-server[1025]: 2026/09/21 10:44:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign worker1 # [ 156.922662] nix-grpc-daemon[1459]: time=2026-09-21T10:44:45.508Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.921196] niks3-server[1025]: 2026/09/21 10:44:45 INFO Signed narinfos id=56 count=1 lb # [ 156.927886] niks3-server[1025]: 2026/09/21 10:44:45 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 156.936253] niks3-server[1025]: 2026/09/21 10:44:45 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 156.941584] niks3-server[1025]: 2026/09/21 10:44:45 INFO Completed upload id=56 worker1 # [ 156.949568] nix-grpc-daemon[1459]: time=2026-09-21T10:44:45.536Z level=INFO msg="Upload complete. (484ms)" lb # [ 156.944743] niks3-server[1025]: 2026/09/21 10:44:45 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 156.956151] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 156.964709] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 156.978112] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 156.980942] nix-daemon[839]: reaped child process 1645, status = succeeded worker1 # [ 156.992209] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 158.437105] nix-daemon[839]: reaped child process 1659, status = succeeded worker1 # [ 158.624133] nix-daemon[839]: accepted connection from pid 1675, user nix-grpc-daemon (trusted) worker1 # [ 158.643047] nix-daemon[839]: reaped child process 1678, status = succeeded lb # [ 158.647441] niks3-server[1025]: 2026/09/21 10:44:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.668452] nix-grpc-daemon[1459]: time=2026-09-21T10:44:47.253Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 158.669932] nix-grpc-daemon[1459]: time=2026-09-21T10:44:47.253Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 158.678515] niks3-server[1025]: 2026/09/21 10:44:47 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 158.699783] niks3-server[1025]: 2026/09/21 10:44:47 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst worker1 # [ 158.720133] nix-grpc-daemon[1459]: time=2026-09-21T10:44:47.306Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.714750] niks3-server[1025]: 2026/09/21 10:44:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 158.725707] niks3-server[1025]: 2026/09/21 10:44:47 INFO Signed narinfos id=57 count=1 lb # [ 158.730281] niks3-server[1025]: 2026/09/21 10:44:47 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 158.739993] niks3-server[1025]: 2026/09/21 10:44:47 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 158.745452] niks3-server[1025]: 2026/09/21 10:44:47 INFO Completed upload id=57 worker1 # [ 158.753654] nix-grpc-daemon[1459]: time=2026-09-21T10:44:47.340Z level=INFO msg="Upload complete. (347ms)" lb # [ 158.748430] niks3-server[1025]: 2026/09/21 10:44:47 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker2 # [ 158.764795] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:47Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 158.765264] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=11 outputs=1 worker2 # [ 158.778106] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:47Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 158.787109] nix-daemon[839]: reaped child process 1657, status = succeeded worker1 # [ 158.816772] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 158.832458] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 158.847100] nix-grpc-daemon[1459]: time=2026-09-21T10:44:47.433Z level=INFO msg="All 2 paths already cached" worker1 # [ 158.856146] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 158.870201] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 159.071806] nix-daemon[839]: accepted connection from pid 1682, user nix-grpc-daemon (trusted) worker1 # [ 159.090913] nix-daemon[839]: reaped child process 1685, status = succeeded worker1 # [ 159.260380] nix-daemon[839]: accepted connection from pid 1687, user nix-grpc-daemon (trusted) worker1 # [ 159.275185] nix-daemon[839]: reaped child process 1690, status = succeeded lb # [ 159.281996] niks3-server[1025]: 2026/09/21 10:44:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.299511] nix-grpc-daemon[1459]: time=2026-09-21T10:44:47.885Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 159.301084] nix-grpc-daemon[1459]: time=2026-09-21T10:44:47.885Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 159.307010] niks3-server[1025]: 2026/09/21 10:44:47 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst lb # [ 159.321655] niks3-server[1025]: 2026/09/21 10:44:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign worker1 # [ 159.335303] nix-grpc-daemon[1459]: time=2026-09-21T10:44:47.921Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.333917] niks3-server[1025]: 2026/09/21 10:44:47 INFO Signed narinfos id=58 count=1 lb # [ 159.339448] niks3-server[1025]: 2026/09/21 10:44:47 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 159.348519] niks3-server[1025]: 2026/09/21 10:44:47 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete worker1 # [ 159.354507] nix-grpc-daemon[1459]: time=2026-09-21T10:44:47.941Z level=INFO msg="Upload complete. (467ms)" lb # [ 159.352999] niks3-server[1025]: 2026/09/21 10:44:47 INFO Completed upload id=58 worker1 # [ 159.360329] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 159.355862] niks3-server[1025]: 2026/09/21 10:44:47 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 159.370785] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 159.378183] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 159.380314] nix-daemon[839]: reaped child process 1680, status = succeeded worker1 # [ 159.390442] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 160.833406] nix-daemon[839]: reaped child process 1694, status = succeeded worker1 # [ 161.018319] nix-daemon[839]: accepted connection from pid 1710, user nix-grpc-daemon (trusted) worker1 # [ 161.034725] nix-daemon[839]: reaped child process 1713, status = succeeded lb # [ 161.040866] niks3-server[1025]: 2026/09/21 10:44:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.060411] nix-grpc-daemon[1459]: time=2026-09-21T10:44:49.645Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 161.061944] nix-grpc-daemon[1459]: time=2026-09-21T10:44:49.645Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 161.082375] niks3-server[1025]: 2026/09/21 10:44:49 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 161.093745] niks3-server[1025]: 2026/09/21 10:44:49 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst worker1 # [ 161.113800] nix-grpc-daemon[1459]: time=2026-09-21T10:44:49.700Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.107579] niks3-server[1025]: 2026/09/21 10:44:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 161.117339] niks3-server[1025]: 2026/09/21 10:44:49 INFO Signed narinfos id=59 count=1 lb # [ 161.121748] niks3-server[1025]: 2026/09/21 10:44:49 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 161.130343] niks3-server[1025]: 2026/09/21 10:44:49 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 161.137097] niks3-server[1025]: 2026/09/21 10:44:49 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo lb # [ 161.142303] niks3-server[1025]: 2026/09/21 10:44:49 INFO Completed upload id=59 worker1 # [ 161.150124] nix-grpc-daemon[1459]: time=2026-09-21T10:44:49.736Z level=INFO msg="Upload complete. (346ms)" worker2 # [ 161.159558] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:49Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 161.161197] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=12 outputs=1 worker1 # [ 161.181059] nix-daemon[839]: reaped child process 1692, status = succeeded worker1 # [ 161.215053] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 161.229681] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 161.244093] nix-grpc-daemon[1459]: time=2026-09-21T10:44:49.830Z level=INFO msg="All 2 paths already cached" worker1 # [ 161.253210] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 161.267231] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 161.470584] nix-daemon[839]: accepted connection from pid 1717, user nix-grpc-daemon (trusted) worker1 # [ 161.490138] nix-daemon[839]: reaped child process 1720, status = succeeded worker1 # [ 161.660676] nix-daemon[839]: accepted connection from pid 1722, user nix-grpc-daemon (trusted) worker1 # [ 161.678200] nix-daemon[839]: reaped child process 1725, status = succeeded lb # [ 161.681605] niks3-server[1025]: 2026/09/21 10:44:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.698992] nix-grpc-daemon[1459]: time=2026-09-21T10:44:50.285Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 161.700520] nix-grpc-daemon[1459]: time=2026-09-21T10:44:50.285Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 161.707611] niks3-server[1025]: 2026/09/21 10:44:50 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst worker1 # [ 161.729502] nix-grpc-daemon[1459]: time=2026-09-21T10:44:50.315Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.722308] niks3-server[1025]: 2026/09/21 10:44:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 161.733747] niks3-server[1025]: 2026/09/21 10:44:50 INFO Signed narinfos id=60 count=1 lb # [ 161.739924] niks3-server[1025]: 2026/09/21 10:44:50 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 161.746546] niks3-server[1025]: 2026/09/21 10:44:50 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete worker1 # [ 161.760512] nix-grpc-daemon[1459]: time=2026-09-21T10:44:50.347Z level=INFO msg="Upload complete. (476ms)" lb # [ 161.753429] niks3-server[1025]: 2026/09/21 10:44:50 INFO Completed upload id=60 lb # [ 161.756638] niks3-server[1025]: 2026/09/21 10:44:50 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 161.768230] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 161.779938] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 161.785661] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 161.790301] nix-daemon[839]: reaped child process 1715, status = succeeded worker1 # [ 161.803133] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 163.026617] nix-daemon[839]: reaped child process 1729, status = succeeded worker1 # [ 163.182232] nix-daemon[839]: accepted connection from pid 1745, user nix-grpc-daemon (trusted) worker1 # [ 163.198822] nix-daemon[839]: reaped child process 1748, status = succeeded lb # [ 163.207573] niks3-server[1025]: 2026/09/21 10:44:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.227977] nix-grpc-daemon[1459]: time=2026-09-21T10:44:51.813Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.229587] nix-grpc-daemon[1459]: time=2026-09-21T10:44:51.813Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 163.248598] niks3-server[1025]: 2026/09/21 10:44:51 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst worker1 # [ 163.266201] nix-grpc-daemon[1459]: time=2026-09-21T10:44:51.852Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.263585] niks3-server[1025]: 2026/09/21 10:44:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 163.272304] niks3-server[1025]: 2026/09/21 10:44:51 INFO Signed narinfos id=61 count=1 lb # [ 163.275933] niks3-server[1025]: 2026/09/21 10:44:51 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker1 # [ 163.291520] nix-grpc-daemon[1459]: time=2026-09-21T10:44:51.877Z level=INFO msg="Upload complete. (279ms)" lb # [ 163.283973] niks3-server[1025]: 2026/09/21 10:44:51 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 163.287649] niks3-server[1025]: 2026/09/21 10:44:51 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 163.291392] niks3-server[1025]: 2026/09/21 10:44:51 INFO Completed upload id=61 lb # [ 163.294196] niks3-server[1025]: 2026/09/21 10:44:51 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker1 # [ 163.300921] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=13 outputs=1 worker2 # [ 163.305991] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:51Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 163.316970] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 163.322263] nix-daemon[839]: reaped child process 1727, status = succeeded worker1 # [ 163.329055] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 163.340257] nix-grpc-daemon[1459]: time=2026-09-21T10:44:51.926Z level=INFO msg="All 2 paths already cached" worker1 # [ 163.347667] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 163.358287] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 163.547475] nix-daemon[839]: accepted connection from pid 1752, user nix-grpc-daemon (trusted) worker1 # [ 163.563758] nix-daemon[839]: reaped child process 1755, status = succeeded worker1 # [ 163.738728] nix-daemon[839]: accepted connection from pid 1757, user nix-grpc-daemon (trusted) worker1 # [ 163.754708] nix-daemon[839]: reaped child process 1760, status = succeeded lb # [ 163.757855] niks3-server[1025]: 2026/09/21 10:44:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.774312] nix-grpc-daemon[1459]: time=2026-09-21T10:44:52.360Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.775789] nix-grpc-daemon[1459]: time=2026-09-21T10:44:52.360Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 163.782490] niks3-server[1025]: 2026/09/21 10:44:52 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 163.803381] nix-grpc-daemon[1459]: time=2026-09-21T10:44:52.389Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.797727] niks3-server[1025]: 2026/09/21 10:44:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 163.810160] niks3-server[1025]: 2026/09/21 10:44:52 INFO Signed narinfos id=62 count=1 lb # [ 163.821192] niks3-server[1025]: 2026/09/21 10:44:52 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 163.825876] niks3-server[1025]: 2026/09/21 10:44:52 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete worker1 # [ 163.838438] nix-grpc-daemon[1459]: time=2026-09-21T10:44:52.424Z level=INFO msg="Upload complete. (468ms)" lb # [ 163.830938] niks3-server[1025]: 2026/09/21 10:44:52 INFO Completed upload id=62 lb # [ 163.834074] niks3-server[1025]: 2026/09/21 10:44:52 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 163.848277] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 163.856243] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 163.864799] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 163.867455] nix-daemon[839]: reaped child process 1750, status = succeeded worker1 # [ 163.878154] nix-daemon[839]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 165.104178] nix-daemon[839]: reaped child process 1764, status = succeeded worker1 # [ 165.269710] nix-daemon[839]: accepted connection from pid 1780, user nix-grpc-daemon (trusted) worker1 # [ 165.287077] nix-daemon[839]: reaped child process 1783, status = succeeded lb # [ 165.298032] niks3-server[1025]: 2026/09/21 10:44:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.316397] nix-grpc-daemon[1459]: time=2026-09-21T10:44:53.900Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 165.317878] nix-grpc-daemon[1459]: time=2026-09-21T10:44:53.900Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 165.338329] niks3-server[1025]: 2026/09/21 10:44:53 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst worker1 # [ 165.360168] nix-grpc-daemon[1459]: time=2026-09-21T10:44:53.946Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.355210] niks3-server[1025]: 2026/09/21 10:44:53 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 165.364256] niks3-server[1025]: 2026/09/21 10:44:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 165.367713] niks3-server[1025]: 2026/09/21 10:44:53 INFO Signed narinfos id=63 count=1 lb # [ 165.370814] niks3-server[1025]: 2026/09/21 10:44:53 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls worker1 # [ 165.387334] nix-grpc-daemon[1459]: time=2026-09-21T10:44:53.973Z level=INFO msg="Upload complete. (297ms)" lb # [ 165.380298] niks3-server[1025]: 2026/09/21 10:44:53 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 165.384570] niks3-server[1025]: 2026/09/21 10:44:53 INFO Completed upload id=63 lb # [ 165.387244] niks3-server[1025]: 2026/09/21 10:44:53 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 165.396871] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44962 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=14 outputs=1 worker1 # [ 165.409901] nix-daemon[839]: reaped child process 1762, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 21.39 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 165.681473] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 98d69fb3e13f4d4dbe03878468e57bf7 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client # [ 165.934085] nix[1345]: don't know how to build these paths: client # [ 165.935047] nix[1345]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv worker1 # [ 165.879916] nix-grpc-daemon[1399]: ts=2026-09-21T10:44:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44962 worker2 # [ 165.889711] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59426 client # [ 165.966030] nix[1345]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker worker2 # [ 165.914147] nix-grpc-daemon[1656]: ts=2026-09-21T10:44:54Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 171.947486] envoy[934]: conn peer=[2001:db8:1::1]:34986 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27217 tx=11571 ms=21068 client # [ 195.971708] nix[1345]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu} client # [ 195.982506] nix[1345]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed client # [ 196.031128] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 196.038368] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 196.042224] systemd[1]: gpu.service: Consumed 183ms CPU time over 30.355s wall clock time, 37.5M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.25 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 52.50 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.14 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 197.797096] nix-grpc-daemon[1399]: ts=2026-09-21T10:45:26Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker1 # [ 199.090844] nix-grpc-daemon[1399]: ts=2026-09-21T10:45:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44962 worker1 # [ 199.098439] nix-grpc-daemon[1399]: ts=2026-09-21T10:45:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44962 worker2 # [ 199.128561] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:27Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker2 # [ 199.129265] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:27Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 199.174473] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 199.189065] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59426 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 199.204665] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 199.220314] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker2 # [ 199.424122] nix-daemon[863]: accepted connection from pid 1953, user nix-grpc-daemon (trusted) worker2 # [ 199.443757] nix-daemon[863]: reaped child process 1956, status = succeeded worker2 # [ 199.616384] nix-daemon[863]: accepted connection from pid 1958, user nix-grpc-daemon (trusted) worker2 # [ 199.634312] nix-daemon[863]: reaped child process 1961, status = succeeded lb # [ 199.637070] niks3-server[1025]: 2026/09/21 10:45:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 199.659731] nix-grpc-daemon[1734]: time=2026-09-21T10:45:28.254Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 199.661425] nix-grpc-daemon[1734]: time=2026-09-21T10:45:28.254Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 199.671273] niks3-server[1025]: 2026/09/21 10:45:28 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst lb # [ 199.685578] niks3-server[1025]: 2026/09/21 10:45:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker2 # [ 199.700689] nix-grpc-daemon[1734]: time=2026-09-21T10:45:28.295Z level=INFO msg="Uploading 1 narinfos" lb # [ 199.693680] niks3-server[1025]: 2026/09/21 10:45:28 INFO Signed narinfos id=64 count=1 lb # [ 199.700597] niks3-server[1025]: 2026/09/21 10:45:28 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 199.709259] niks3-server[1025]: 2026/09/21 10:45:28 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 199.715273] niks3-server[1025]: 2026/09/21 10:45:28 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo lb # [ 199.719060] niks3-server[1025]: 2026/09/21 10:45:28 INFO Completed upload id=64 worker2 # [ 199.728714] nix-grpc-daemon[1734]: time=2026-09-21T10:45:28.323Z level=INFO msg="Upload complete. (490ms)" worker2 # [ 199.736519] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59426 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 199.751173] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 199.761302] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker2 # [ 199.765423] nix-daemon[863]: reaped child process 1951, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... worker2 # [ 199.776426] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 200.816992] nix-daemon[863]: reaped child process 1965, status = succeeded worker2 # [ 200.984622] nix-daemon[863]: accepted connection from pid 1981, user nix-grpc-daemon (trusted) worker2 # [ 201.002355] nix-daemon[863]: reaped child process 1984, status = succeeded lb # [ 201.005549] niks3-server[1025]: 2026/09/21 10:45:29 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 201.032223] nix-grpc-daemon[1734]: time=2026-09-21T10:45:29.626Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 201.036548] nix-grpc-daemon[1734]: time=2026-09-21T10:45:29.628Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 201.060466] niks3-server[1025]: 2026/09/21 10:45:29 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 201.072439] niks3-server[1025]: 2026/09/21 10:45:29 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 201.083559] niks3-server[1025]: 2026/09/21 10:45:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker2 # [ 201.093626] nix-grpc-daemon[1734]: time=2026-09-21T10:45:29.688Z level=INFO msg="Uploading 1 narinfos" lb # [ 201.090869] niks3-server[1025]: 2026/09/21 10:45:29 INFO Signed narinfos id=65 count=1 lb # [ 201.095706] niks3-server[1025]: 2026/09/21 10:45:29 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 201.104816] niks3-server[1025]: 2026/09/21 10:45:29 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete worker2 # [ 201.114265] nix-grpc-daemon[1734]: time=2026-09-21T10:45:29.709Z level=INFO msg="Upload complete. (324ms)" lb # [ 201.107627] niks3-server[1025]: 2026/09/21 10:45:29 INFO Completed upload id=65 lb # [ 201.116179] niks3-server[1025]: 2026/09/21 10:45:29 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 201.130054] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=15 outputs=1 worker2 # [ 201.148506] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:29Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker2 # [ 201.154859] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:29Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 201.159659] nix-daemon[863]: reaped child process 1963, status = succeeded worker2 # [ 201.188184] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 201.202844] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 201.216595] nix-grpc-daemon[1734]: time=2026-09-21T10:45:29.811Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 201.226422] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 201.244458] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker2 # [ 201.448231] nix-daemon[863]: accepted connection from pid 1990, user nix-grpc-daemon (trusted) worker2 # [ 201.464844] nix-daemon[863]: reaped child process 1993, status = succeeded worker2 # [ 201.642331] nix-daemon[863]: accepted connection from pid 1995, user nix-grpc-daemon (trusted) worker2 # [ 201.658381] nix-daemon[863]: reaped child process 1998, status = succeeded lb # [ 201.661055] niks3-server[1025]: 2026/09/21 10:45:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 201.680061] nix-grpc-daemon[1734]: time=2026-09-21T10:45:30.274Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 201.681527] nix-grpc-daemon[1734]: time=2026-09-21T10:45:30.274Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 201.686537] niks3-server[1025]: 2026/09/21 10:45:30 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 201.709957] nix-grpc-daemon[1734]: time=2026-09-21T10:45:30.304Z level=INFO msg="Uploading 1 narinfos" lb # [ 201.701268] niks3-server[1025]: 2026/09/21 10:45:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 201.710441] niks3-server[1025]: 2026/09/21 10:45:30 INFO Signed narinfos id=66 count=1 lb # [ 201.718356] niks3-server[1025]: 2026/09/21 10:45:30 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 201.725526] niks3-server[1025]: 2026/09/21 10:45:30 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 201.731149] niks3-server[1025]: 2026/09/21 10:45:30 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo lb # [ 201.735848] niks3-server[1025]: 2026/09/21 10:45:30 INFO Completed upload id=66 worker2 # [ 201.745507] nix-grpc-daemon[1734]: time=2026-09-21T10:45:30.340Z level=INFO msg="Upload complete. (484ms)" worker2 # [ 201.752358] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59426 duration_s=0 paths=1 nar_bytes_in=632 worker2 # [ 201.762880] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 201.771253] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker2 # [ 201.776845] nix-daemon[863]: reaped child process 1988, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker2 # [ 201.788317] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) lb # [ 201.944447] envoy[934]: conn peer=[2001:db8:1::1]:58212 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=30065 client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 202.617844] nix-daemon[863]: reaped child process 2002, status = succeeded worker2 # [ 202.780330] nix-daemon[863]: accepted connection from pid 2018, user nix-grpc-daemon (trusted) worker2 # [ 202.798731] nix-daemon[863]: reaped child process 2021, status = succeeded lb # [ 202.802909] niks3-server[1025]: 2026/09/21 10:45:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 202.824408] nix-grpc-daemon[1734]: time=2026-09-21T10:45:31.416Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 202.825873] nix-grpc-daemon[1734]: time=2026-09-21T10:45:31.416Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 202.847280] niks3-server[1025]: 2026/09/21 10:45:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker2 # [ 202.865545] nix-grpc-daemon[1734]: time=2026-09-21T10:45:31.460Z level=INFO msg="Uploading 1 narinfos" lb # [ 202.862169] niks3-server[1025]: 2026/09/21 10:45:31 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 202.874199] niks3-server[1025]: 2026/09/21 10:45:31 INFO Signed narinfos id=67 count=1 lb # [ 202.878995] niks3-server[1025]: 2026/09/21 10:45:31 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst worker2 # [ 202.897995] nix-grpc-daemon[1734]: time=2026-09-21T10:45:31.493Z level=INFO msg="Upload complete. (300ms)" lb # [ 202.889217] niks3-server[1025]: 2026/09/21 10:45:31 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker2 # [ 202.904704] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=16 outputs=1 lb # [ 202.894925] niks3-server[1025]: 2026/09/21 10:45:31 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 202.899521] niks3-server[1025]: 2026/09/21 10:45:31 INFO Completed upload id=67 lb # [ 202.901953] niks3-server[1025]: 2026/09/21 10:45:31 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 202.916371] nix-daemon[863]: reaped child process 2000, status = succeeded worker2 # [ 202.920598] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:31Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker2 # [ 202.923727] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:31Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 202.969054] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 202.983767] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 202.997591] nix-grpc-daemon[1734]: time=2026-09-21T10:45:31.592Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 203.007655] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 203.022480] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker2 # [ 203.218505] nix-daemon[863]: accepted connection from pid 2027, user nix-grpc-daemon (trusted) worker2 # [ 203.235483] nix-daemon[863]: reaped child process 2030, status = succeeded worker2 # [ 203.410791] nix-daemon[863]: accepted connection from pid 2032, user nix-grpc-daemon (trusted) worker2 # [ 203.426540] nix-daemon[863]: reaped child process 2035, status = succeeded lb # [ 203.430320] niks3-server[1025]: 2026/09/21 10:45:32 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 203.453411] nix-grpc-daemon[1734]: time=2026-09-21T10:45:32.048Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 203.454920] nix-grpc-daemon[1734]: time=2026-09-21T10:45:32.048Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 203.464091] niks3-server[1025]: 2026/09/21 10:45:32 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst worker2 # [ 203.486364] nix-grpc-daemon[1734]: time=2026-09-21T10:45:32.081Z level=INFO msg="Uploading 1 narinfos" lb # [ 203.479715] niks3-server[1025]: 2026/09/21 10:45:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 203.489681] niks3-server[1025]: 2026/09/21 10:45:32 INFO Signed narinfos id=68 count=1 lb # [ 203.493468] niks3-server[1025]: 2026/09/21 10:45:32 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls lb # [ 203.501595] niks3-server[1025]: 2026/09/21 10:45:32 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 203.507201] niks3-server[1025]: 2026/09/21 10:45:32 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo lb # [ 203.511784] niks3-server[1025]: 2026/09/21 10:45:32 INFO Completed upload id=68 worker2 # [ 203.521401] nix-grpc-daemon[1734]: time=2026-09-21T10:45:32.116Z level=INFO msg="Upload complete. (484ms)" worker2 # [ 203.528332] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59426 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 203.543039] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 worker2 # [ 203.550152] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker2 # [ 203.555085] nix-daemon[863]: reaped child process 2025, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 203.566930] nix-daemon[863]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 205.014644] nix-daemon[863]: reaped child process 2039, status = succeeded worker2 # [ 205.196889] nix-daemon[863]: accepted connection from pid 2055, user nix-grpc-daemon (trusted) worker2 # [ 205.213027] nix-daemon[863]: reaped child process 2058, status = succeeded lb # [ 205.218039] niks3-server[1025]: 2026/09/21 10:45:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 205.237873] nix-grpc-daemon[1734]: time=2026-09-21T10:45:33.831Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 205.239357] nix-grpc-daemon[1734]: time=2026-09-21T10:45:33.831Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 205.250070] niks3-server[1025]: 2026/09/21 10:45:33 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 205.262414] niks3-server[1025]: 2026/09/21 10:45:33 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst worker2 # [ 205.288202] nix-grpc-daemon[1734]: time=2026-09-21T10:45:33.882Z level=INFO msg="Uploading 1 narinfos" lb # [ 205.272876] niks3-server[1025]: 2026/09/21 10:45:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 205.282898] niks3-server[1025]: 2026/09/21 10:45:33 INFO Signed narinfos id=69 count=1 lb # [ 205.288702] niks3-server[1025]: 2026/09/21 10:45:33 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls lb # [ 205.297521] niks3-server[1025]: 2026/09/21 10:45:33 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 205.302698] niks3-server[1025]: 2026/09/21 10:45:33 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo lb # [ 205.307328] niks3-server[1025]: 2026/09/21 10:45:33 INFO Completed upload id=69 worker2 # [ 205.317073] nix-grpc-daemon[1734]: time=2026-09-21T10:45:33.912Z level=INFO msg="Upload complete. (337ms)" worker2 # [ 205.329171] nix-grpc-daemon[1656]: ts=2026-09-21T10:45:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59426 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=17 outputs=1 worker2 # [ 205.348666] nix-daemon[863]: reaped child process 2037, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.55 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 206.806659] nix-grpc-daemon[1399]: ts=2026-09-21T10:45:35Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 10.40 seconds) (finished: run the VM test script, in 207.90 seconds) test script finished in 208.19s cleanup kill QemuMachine (pid 50) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 49) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.36 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh