tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker2 # Disk image does not exist, creating the virtualisation disk image... worker2: QEMU running (pid 51) worker2 # Formatting '/build/vm-state-worker2/tmp.vWqRXaPU5X', fmt=raw size=1073741824 worker1 # Disk image does not exist, creating the virtualisation disk image... worker1: QEMU running (pid 52) worker2 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Discarding device blocks: 0/262144 done lb # Disk image does not exist, creating the virtualisation disk image... worker1 # Formatting '/build/vm-state-worker1/tmp.npQkGO8y29', fmt=raw size=1073741824 client # Disk image does not exist, creating the virtualisation disk image... client # Formatting '/build/vm-state-client/tmp.gKDETDgNQG', fmt=raw size=1073741824 lb: QEMU running (pid 50) lb # Formatting '/build/vm-state-lb/tmp.KE5iKe0l5J', fmt=raw size=1073741824 client: QEMU running (pid 49) worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Filesystem UUID: 0af5c4d8-35e9-4ab0-9a59-554be5b07457 worker1 # Discarding device blocks: 0/262144 done lb # mke2fs 1.47.4 (6-Mar-2025) client # mke2fs 1.47.4 (6-Mar-2025) worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Filesystem UUID: ba156868-730c-4d97-a9e9-8eaf4c1f531d worker2 # Superblock backups stored on blocks: worker1 # Superblock backups stored on blocks: lb # Discarding device blocks: 0/262144 done client # Discarding device blocks: 0/262144 done worker2 # 32768, 98304, 163840, 229376 worker1 # 32768, 98304, 163840, 229376 lb # Creating filesystem with 262144 4k blocks and 65536 inodes client # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # worker1 # lb # Filesystem UUID: 21a7c695-b047-4094-9690-b968796664c3 client # Filesystem UUID: 328b0766-fb02-4fb9-bf6e-0f8db200de6a worker2 # Allocating group tables: 0/8 done worker1 # Allocating group tables: 0/8 done lb # Superblock backups stored on blocks: client # Superblock backups stored on blocks: worker1 # Writing inode tables: 0/8 done lb # 32768, 98304, 163840, 229376 client # 32768, 98304, 163840, 229376 worker1 # Creating journal (8192 blocks): done lb # client # worker1 # Writing superblocks and filesystem accounting information: 0/8 done lb # Allocating group tables: 0/8 done client # Allocating group tables: 0/8 done worker1 # lb # Writing inode tables: 0/8 done client # Writing inode tables: 0/8 done worker1 # Virtualisation disk image created. lb # Creating journal (8192 blocks): done client # Creating journal (8192 blocks): done (finished: start all VMs, in 0.51 seconds) lb # Writing superblocks and filesystem accounting information: 0/8 done client # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Writing inode tables: 0/8 done client # client # Virtualisation disk image created. lb # client: waiting for unit network-addresses-eth1.service lb # Virtualisation disk image created. client: waiting for the VM to finish booting worker2 # Creating journal (8192 blocks): done worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # worker2 # Virtualisation disk image created. worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] KASLR enabled worker1 # [ 0.000000] random: crng init done worker1 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] Zone ranges: worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] DMA32 empty worker1 # [ 0.000000] Normal empty worker1 # [ 0.000000] Device empty worker1 # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] Early memory node ranges worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] KASLR enabled worker1 # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] random: crng init done worker1 # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] Zone ranges: lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] DMA32 empty lb # [ 0.000000] Normal empty lb # [ 0.000000] Device empty lb # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/wz2244whakjfkgc25yjaqssxl682ahpy-nixos-system-worker1-test/init regInfo=/nix/store/r34grl4ygxaa9d0qraas4g323a0aln56-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] Early memory node ranges lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/r34grl4ygxaa9d0qraas4g323a0aln56-closure-info/registration", will be passed to user space. lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] Policy zone: DMA lb # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups lb # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] KASLR enabled worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] random: crng init done worker2 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] Zone ranges: worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] DMA32 empty worker2 # [ 0.000000] Normal empty worker2 # [ 0.000000] Device empty lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] Early memory node ranges lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000000] KASLR enabled client # [ 0.000000] random: crng init done lb # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] Zone ranges: worker2 # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] DMA32 empty lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] Normal empty worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000000] Device empty worker1 # [ 0.000039] arm-pv: using stolen time PV client # [ 0.000000] Movable zone start for each node lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] Early memory node ranges worker1 # [ 0.000738] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000927] Console: colour dummy device 80x25 worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zwss4dc02qc6i44w7sb05pfw9f3zvc9l-nixos-system-worker2-test/init regInfo=/nix/store/s00vx294wsy0n81gy130ifpsm3nnkxh2-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000936] printk: legacy console [tty0] enabled lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.001148] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/s00vx294wsy0n81gy130ifpsm3nnkxh2-closure-info/registration", will be passed to user space. client # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.001155] pid_max: default: 32768 minimum: 301 worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.001246] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.001483] landlock: Up and running. lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.001486] Yama: becoming mindful. worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.002248] LSM support for eBPF active lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.002419] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 client # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.002452] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.003673] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.004481] rcu: Hierarchical SRCU implementation. lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.004488] rcu: Max phase no-delay instances is 1000. lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.005779] fsl-mc MSI: its@8080000 domain created client # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] Policy zone: DMA lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker1 # [ 0.005874] EFI services will not be available. client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.005944] smp: Bringing up secondary CPUs ... lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.005953] smp: Brought up 1 node, 1 CPU client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.005956] SMP: Total of 1 processors activated. worker2 # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.005962] CPU: All CPU(s) started at EL1 worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.005975] CPU features: detected: Branch Target Identification worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.005980] CPU features: detected: ARMv8.4 Translation Table Level worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.005983] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.000042] arm-pv: using stolen time PV client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/7pfca4pninpmfbhvzygaqz91qmaivwdc-nixos-system-client-test/init regInfo=/nix/store/3wpd297id2n5yv0662g5rwh936fvnrw6-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.005987] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.005991] CPU features: detected: Common not Private translations lb # [ 0.001063] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.005994] CPU features: detected: CRC32 instructions client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/3wpd297id2n5yv0662g5rwh936fvnrw6-closure-info/registration", will be passed to user space. lb # [ 0.001226] Console: colour dummy device 80x25 worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. lb # [ 0.001235] printk: legacy console [tty0] enabled client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.005997] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.001432] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.006000] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.001439] pid_max: default: 32768 minimum: 301 worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.006004] CPU features: detected: Data independent timing control (DIT) client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.006007] CPU features: detected: E0PD lb # [ 0.001526] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.001750] landlock: Up and running. worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.006009] CPU features: detected: Enhanced Counter Virtualization client # [ 0.000000] software IO TLB: area num 1. lb # [ 0.001753] Yama: becoming mindful. lb # [ 0.002655] LSM support for eBPF active worker1 # [ 0.006012] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.002876] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.006016] CPU features: detected: Enhanced Virtualization Traps client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.006019] CPU features: detected: Fine Grained Traps client # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.002908] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.006022] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.004119] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.000000] Policy zone: DMA worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.004915] rcu: Hierarchical SRCU implementation. worker1 # [ 0.006026] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.004920] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.006029] CPU features: detected: LSE atomic instructions lb # [ 0.006226] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.006032] CPU features: detected: Privileged Access Never client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.006035] CPU features: detected: PMUv3 lb # [ 0.006333] EFI services will not be available. client # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.006433] smp: Bringing up secondary CPUs ... client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.006037] CPU features: detected: RAS Extension Support lb # [ 0.006444] smp: Brought up 1 node, 1 CPU worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.006040] CPU features: detected: RASv1p1 Extension Support lb # [ 0.006448] SMP: Total of 1 processors activated. client # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.006043] CPU features: detected: Random Number Generator lb # [ 0.006496] CPU: All CPU(s) started at EL1 worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.006045] CPU features: detected: Speculation barrier (SB) lb # [ 0.006509] CPU features: detected: Branch Target Identification worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.006048] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.006514] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker1 # [ 0.006051] CPU features: detected: TLB range maintenance instructions client # [ 0.000000] Rude variant of Tasks RCU enabled. lb # [ 0.006517] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.006056] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.006521] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.006107] alternatives: applying system-wide alternatives client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.006524] CPU features: detected: Common not Private translations worker1 # [ 0.009833] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.006528] CPU features: detected: CRC32 instructions client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.006531] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.010072] Memory: 1406524K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker1 # [ 0.010576] devtmpfs: initialized lb # [ 0.006535] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.012606] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.000035] arm-pv: using stolen time PV lb # [ 0.006538] CPU features: detected: Data independent timing control (DIT) client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.006542] CPU features: detected: E0PD client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000572] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.006544] CPU features: detected: Enhanced Counter Virtualization client # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.000751] Console: colour dummy device 80x25 worker1 # [ 0.012630] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.006547] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.000760] printk: legacy console [tty0] enabled client # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.012829] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.006551] CPU features: detected: Enhanced Virtualization Traps client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.012834] 0 pages in range for non-PLT usage lb # [ 0.006554] CPU features: detected: Fine Grained Traps worker2 # [ 0.000954] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.012834] 508288 pages in range for PLT usage worker2 # [ 0.000961] pid_max: default: 32768 minimum: 301 worker1 # [ 0.012966] pinctrl core: initialized pinctrl subsystem lb # [ 0.006558] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.001040] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.013784] DMI not present or invalid. client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.006564] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.001185] landlock: Up and running. worker1 # [ 0.018142] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.001187] Yama: becoming mindful. lb # [ 0.006567] CPU features: detected: LSE atomic instructions worker2 # [ 0.001811] LSM support for eBPF active client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.020533] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.006570] CPU features: detected: Privileged Access Never lb # [ 0.006573] CPU features: detected: PMUv3 worker2 # [ 0.001972] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.020734] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.006575] CPU features: detected: RAS Extension Support worker2 # [ 0.002007] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 worker1 # [ 0.020962] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.006578] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.003274] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.020998] audit: initializing netlink subsys (disabled) lb # [ 0.006581] CPU features: detected: Random Number Generator client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000 worker2 # [ 0.004271] rcu: Hierarchical SRCU implementation. lb # [ 0.006584] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.021680] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.004279] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.021683] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.006587] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.005579] fsl-mc MSI: its@8080000 domain created client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.005678] EFI services will not be available. worker1 # [ 0.021688] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.006590] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.005752] smp: Bringing up secondary CPUs ... worker1 # [ 0.021693] thermal_sys: Registered thermal governor 'user_space' client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.006595] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.005763] smp: Brought up 1 node, 1 CPU worker1 # [ 0.021696] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.006650] alternatives: applying system-wide alternatives worker2 # [ 0.005766] SMP: Total of 1 processors activated. client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.005772] CPU: All CPU(s) started at EL1 worker1 # [ 0.021724] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.010046] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.021736] cpuidle: using governor ladder worker2 # [ 0.005786] CPU features: detected: Branch Target Identification client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.021741] cpuidle: using governor menu client # [ 0.000032] arm-pv: using stolen time PV worker2 # [ 0.005791] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.010253] Memory: 1406604K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) worker1 # [ 0.021994] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.010727] devtmpfs: initialized worker2 # [ 0.005795] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.000480] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.022019] ASID allocator initialised with 65536 entries client # [ 0.000693] Console: colour dummy device 80x25 lb # [ 0.012675] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.023341] Serial: AMBA PL011 UART driver client # [ 0.000701] printk: legacy console [tty0] enabled worker2 # [ 0.005798] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.028868] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.012701] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.005802] CPU features: detected: Common not Private translations worker1 # [ 0.029028] printk: console [ttyAMA0] enabled client # [ 0.000952] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.005805] CPU features: detected: CRC32 instructions lb # [ 0.012898] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.000960] pid_max: default: 32768 minimum: 301 lb # [ 0.012903] 0 pages in range for non-PLT usage worker2 # [ 0.005808] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.012904] 508288 pages in range for PLT usage client # [ 0.001032] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.001189] landlock: Up and running. worker2 # [ 0.005812] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.013038] pinctrl core: initialized pinctrl subsystem client # [ 0.001192] Yama: becoming mindful. lb # [ 0.013850] DMI not present or invalid. client # [ 0.001688] LSM support for eBPF active worker2 # [ 0.005815] CPU features: detected: Data independent timing control (DIT) lb # [ 0.017524] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.005819] CPU features: detected: E0PD client # [ 0.001863] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.020026] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.005821] CPU features: detected: Enhanced Counter Virtualization client # [ 0.001895] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.005824] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.020243] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.003115] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.005828] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.020466] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.003881] rcu: Hierarchical SRCU implementation. worker2 # [ 0.005831] CPU features: detected: Fine Grained Traps lb # [ 0.020497] audit: initializing netlink subsys (disabled) client # [ 0.003886] rcu: Max phase no-delay instances is 1000. client # [ 0.005210] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.005835] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.005307] EFI services will not be available. worker2 # [ 0.005842] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.005394] smp: Bringing up secondary CPUs ... lb # [ 0.021144] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.005845] CPU features: detected: LSE atomic instructions client # [ 0.005403] smp: Brought up 1 node, 1 CPU lb # [ 0.021146] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.005848] CPU features: detected: Privileged Access Never client # [ 0.005407] SMP: Total of 1 processors activated. worker1 # [ 0.153069] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.005850] CPU features: detected: PMUv3 client # [ 0.005415] CPU: All CPU(s) started at EL1 lb # [ 0.021151] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.005853] CPU features: detected: RAS Extension Support worker1 # [ 0.153097] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.005428] CPU features: detected: Branch Target Identification lb # [ 0.021157] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.005856] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.153103] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.005433] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.021160] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.005859] CPU features: detected: Random Number Generator worker1 # [ 0.153107] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.021194] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.005436] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.005861] CPU features: detected: Speculation barrier (SB) lb # [ 0.021204] cpuidle: using governor ladder worker1 # [ 0.153112] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.021209] cpuidle: using governor menu worker2 # [ 0.005864] CPU features: detected: Stage-2 Force Write-Back client # [ 0.005440] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.153116] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.005867] CPU features: detected: TLB range maintenance instructions lb # [ 0.021426] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.005444] CPU features: detected: Common not Private translations worker1 # [ 0.153121] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.021444] ASID allocator initialised with 65536 entries client # [ 0.005447] CPU features: detected: CRC32 instructions worker2 # [ 0.005873] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.153125] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.022806] Serial: AMBA PL011 UART driver worker2 # [ 0.005915] alternatives: applying system-wide alternatives client # [ 0.005450] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.009322] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.028505] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.005454] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.028692] printk: console [ttyAMA0] enabled client # [ 0.005458] CPU features: detected: Data independent timing control (DIT) worker1 # [ 0.160845] fbcon: Taking over console client # [ 0.005460] CPU features: detected: E0PD worker2 # [ 0.009607] Memory: 1406548K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker1 # [ 0.160867] ACPI: Interpreter disabled. worker2 # [ 0.010067] devtmpfs: initialized client # [ 0.005463] CPU features: detected: Enhanced Counter Virtualization client # [ 0.005466] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.005469] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.012019] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.005473] CPU features: detected: Fine Grained Traps worker2 # [ 0.012043] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.005477] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.012259] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.005481] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.012264] 0 pages in range for non-PLT usage client # [ 0.005485] CPU features: detected: LSE atomic instructions worker2 # [ 0.012265] 508288 pages in range for PLT usage client # [ 0.005488] CPU features: detected: Privileged Access Never worker2 # [ 0.012395] pinctrl core: initialized pinctrl subsystem client # [ 0.005491] CPU features: detected: PMUv3 worker2 # [ 0.013161] DMI not present or invalid. client # [ 0.005494] CPU features: detected: RAS Extension Support worker2 # [ 0.016371] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.005496] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.018978] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.152677] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.169406] iommu: Default domain type: Translated client # [ 0.005499] CPU features: detected: Random Number Generator lb # [ 0.152704] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.019198] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.169420] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.005502] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.169844] SCSI subsystem initialized lb # [ 0.152709] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.005505] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.019421] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.152714] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.019455] audit: initializing netlink subsys (disabled) client # [ 0.005508] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.171891] usbcore: registered new interface driver usbfs lb # [ 0.152718] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.020112] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.005513] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.171927] usbcore: registered new interface driver hub worker2 # [ 0.020115] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.152722] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.005555] alternatives: applying system-wide alternatives worker1 # [ 0.171945] usbcore: registered new device driver usb worker2 # [ 0.020119] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.152727] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.008997] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.172246] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.020124] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.152731] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.172253] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.020127] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.172271] PTP clock support registered client # [ 0.009189] Memory: 1406536K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) worker1 # [ 0.172330] EDAC MC: Ver: 3.0.0 client # [ 0.009690] devtmpfs: initialized worker2 # [ 0.020155] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.020164] cpuidle: using governor ladder worker1 # [ 0.176974] scmi_core: SCMI protocol bus registered lb # [ 0.160255] fbcon: Taking over console worker2 # [ 0.020169] cpuidle: using governor menu lb # [ 0.160277] ACPI: Interpreter disabled. client # [ 0.011585] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.178027] FPGA manager framework worker2 # [ 0.020367] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.179097] vgaarb: loaded worker2 # [ 0.020385] ASID allocator initialised with 65536 entries client # [ 0.011609] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.021616] Serial: AMBA PL011 UART driver worker1 # [ 0.179791] clocksource: Switched to clocksource arch_sys_counter client # [ 0.011811] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.011816] 0 pages in range for non-PLT usage worker2 # [ 0.027022] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.011817] 508288 pages in range for PLT usage worker2 # [ 0.027185] printk: console [ttyAMA0] enabled client # [ 0.011922] pinctrl core: initialized pinctrl subsystem client # [ 0.012841] DMI not present or invalid. client # [ 0.016298] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.018705] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.184524] VFS: Disk quotas dquot_6.6.0 client # [ 0.018918] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.184595] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.019146] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.168947] iommu: Default domain type: Translated client # [ 0.019176] audit: initializing netlink subsys (disabled) worker1 # [ 0.186383] netfs: FS-Cache loaded lb # [ 0.168961] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.186542] pnp: PnP ACPI: disabled client # [ 0.019866] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.169391] SCSI subsystem initialized client # [ 0.019868] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.019872] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.148888] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.171515] usbcore: registered new interface driver usbfs lb # [ 0.171549] usbcore: registered new interface driver hub client # [ 0.019878] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.148914] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.171567] usbcore: registered new device driver usb client # [ 0.019881] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.148920] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.171882] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.148924] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.019909] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.019918] cpuidle: using governor ladder lb # [ 0.171888] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.190703] NET: Registered PF_INET protocol family worker2 # [ 0.148928] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.019924] cpuidle: using governor menu lb # [ 0.171899] PTP clock support registered lb # [ 0.171954] EDAC MC: Ver: 3.0.0 worker2 # [ 0.148933] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.191040] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.020136] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.148937] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.176722] scmi_core: SCMI protocol bus registered client # [ 0.020156] ASID allocator initialised with 65536 entries client # [ 0.021541] Serial: AMBA PL011 UART driver worker2 # [ 0.148941] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.177737] FPGA manager framework client # [ 0.026947] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.178892] vgaarb: loaded client # [ 0.027134] printk: console [ttyAMA0] enabled lb # [ 0.179577] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.156769] fbcon: Taking over console worker2 # [ 0.156794] ACPI: Interpreter disabled. lb # [ 0.182441] VFS: Disk quotas dquot_6.6.0 lb # [ 0.182524] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.148338] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.186550] netfs: FS-Cache loaded lb # [ 0.186716] pnp: PnP ACPI: disabled client # [ 0.148364] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.148370] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.148374] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.165855] iommu: Default domain type: Translated client # [ 0.148379] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.165870] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.166320] SCSI subsystem initialized client # [ 0.148383] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.148388] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.190820] NET: Registered PF_INET protocol family worker2 # [ 0.168404] usbcore: registered new interface driver usbfs client # [ 0.148392] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.168438] usbcore: registered new interface driver hub lb # [ 0.191121] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.168456] usbcore: registered new device driver usb worker2 # [ 0.168737] pps_core: LinuxPPS API ver. 1 registered client # [ 0.156124] fbcon: Taking over console worker2 # [ 0.168744] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.156146] ACPI: Interpreter disabled. worker2 # [ 0.168754] PTP clock support registered worker2 # [ 0.168808] EDAC MC: Ver: 3.0.0 worker2 # [ 0.173549] scmi_core: SCMI protocol bus registered worker2 # [ 0.174592] FPGA manager framework worker2 # [ 0.175616] vgaarb: loaded worker2 # [ 0.176316] clocksource: Switched to clocksource arch_sys_counter client # [ 0.165274] iommu: Default domain type: Translated client # [ 0.165289] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.165771] SCSI subsystem initialized worker2 # [ 0.182454] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.182516] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.167841] usbcore: registered new interface driver usbfs worker2 # [ 0.184246] netfs: FS-Cache loaded client # [ 0.167875] usbcore: registered new interface driver hub client # [ 0.167894] usbcore: registered new device driver usb worker2 # [ 0.184859] pnp: PnP ACPI: disabled client # [ 0.168172] pps_core: LinuxPPS API ver. 1 registered client # [ 0.168178] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.168188] PTP clock support registered client # [ 0.168248] EDAC MC: Ver: 3.0.0 client # [ 0.172981] scmi_core: SCMI protocol bus registered client # [ 0.174021] FPGA manager framework client # [ 0.174997] vgaarb: loaded client # [ 0.175653] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.188632] NET: Registered PF_INET protocol family worker1 # [ 0.224061] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.188909] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.224123] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.179516] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.224159] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.179555] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.224259] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.224401] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.224499] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.224541] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.183369] netfs: FS-Cache loaded client # [ 0.183523] pnp: PnP ACPI: disabled worker1 # [ 0.224582] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.224678] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.224741] NET: Registered PF_XDP protocol family worker1 # [ 0.224776] PCI: CLS 0 bytes, default 64 worker1 # [ 0.225041] Trying to unpack rootfs image as initramfs... client # [ 0.187605] NET: Registered PF_INET protocol family worker1 # [ 0.241575] kvm [1]: HYP mode not available client # [ 0.188523] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.224042] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.224108] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.224142] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.224234] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.224378] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.224483] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.224523] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.224563] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.224682] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.224712] NET: Registered PF_XDP protocol family lb # [ 0.224733] PCI: CLS 0 bytes, default 64 lb # [ 0.225009] Trying to unpack rootfs image as initramfs... lb # [ 0.241494] kvm [1]: HYP mode not available worker2 # [ 0.221480] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.221550] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.221588] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.221685] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.221828] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.221934] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.221976] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.222027] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.222131] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.222162] NET: Registered PF_XDP protocol family worker2 # [ 0.222181] PCI: CLS 0 bytes, default 64 worker2 # [ 0.222437] Trying to unpack rootfs image as initramfs... client # [ 0.221224] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.221291] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.221327] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.238196] kvm [1]: HYP mode not available client # [ 0.221425] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.221568] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.221689] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.221733] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.221781] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.221875] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.221900] NET: Registered PF_XDP protocol family client # [ 0.221921] PCI: CLS 0 bytes, default 64 client # [ 0.222226] Trying to unpack rootfs image as initramfs... client # [ 0.237546] kvm [1]: HYP mode not available worker1 # [ 0.449951] Initialise system trusted keyrings worker1 # [ 0.450775] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.452220] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.453020] 9p: Installing v9fs 9p2000 file system support lb # [ 0.448262] Initialise system trusted keyrings lb # [ 0.449010] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.450288] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.451102] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.431543] Initialise system trusted keyrings worker2 # [ 0.432544] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.433849] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.481115] Key type asymmetric registered worker1 # [ 0.481155] Asymmetric key parser 'x509' registered worker1 # [ 0.481242] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.483450] io scheduler mq-deadline registered worker1 # [ 0.483464] io scheduler kyber registered worker2 # [ 0.440425] 9p: Installing v9fs 9p2000 file system support lb # [ 0.479867] Key type asymmetric registered lb # [ 0.479906] Asymmetric key parser 'x509' registered lb # [ 0.479988] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.482154] io scheduler mq-deadline registered lb # [ 0.482168] io scheduler kyber registered worker2 # [ 0.460489] Key type asymmetric registered client # [ 0.446120] Initialise system trusted keyrings worker2 # [ 0.460526] Asymmetric key parser 'x509' registered worker2 # [ 0.460630] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.446954] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.462931] io scheduler mq-deadline registered client # [ 0.448331] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.462943] io scheduler kyber registered worker1 # [ 0.497091] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.497700] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.498123] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.498142] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.498156] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.498164] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.491766] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.498185] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.449131] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.498208] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker1 # [ 0.498286] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.493271] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.498296] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.472507] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.493700] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.498303] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.498308] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.493719] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.498313] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.493732] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.493741] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.498388] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.498841] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.493764] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.499056] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.499074] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.493791] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker1 # [ 0.499103] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.493877] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.499120] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.499608] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.499840] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.493887] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.499856] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.493894] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.499885] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.493899] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.493904] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.493999] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.469112] Key type asymmetric registered worker1 # [ 0.500349] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.469144] Asymmetric key parser 'x509' registered lb # [ 0.494516] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.469239] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.494713] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.500538] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.500554] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.494731] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.500583] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.494760] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.501054] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.494777] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.501243] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.480383] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.495248] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.501259] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.481026] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.495435] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.501292] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.495452] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.481051] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.475736] io scheduler mq-deadline registered worker1 # [ 0.501762] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.495481] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.475762] io scheduler kyber registered worker2 # [ 0.481064] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.501945] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.501961] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.481072] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.501991] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.481099] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.502439] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.481130] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker1 # [ 0.502621] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.502636] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.481224] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.481234] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.502665] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.481241] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.503134] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.481246] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.503319] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.503335] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.481251] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.503364] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.481349] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.503380] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.520174] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.481821] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.520404] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.482015] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.520421] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.482032] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.520451] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.482062] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.487887] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.482079] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.520930] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.521119] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.482544] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.521135] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.482728] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.482744] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.521169] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.489545] ledtrig-cpu: registered to indicate activity on CPUs worker2 # [ 0.482774] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.489988] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.521642] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.521828] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.483234] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.490009] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.543957] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.521844] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.483418] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.544183] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.490022] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.521874] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.483434] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.544214] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.483463] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.522334] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.490032] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.544760] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.522550] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.483965] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.490058] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.544951] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.522567] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.484149] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.490088] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.484168] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.544981] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.522596] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.490179] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.484202] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.545379] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.523068] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.490191] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.523259] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.545564] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.484722] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.490198] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] lb # [ 0.523276] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.484910] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.545821] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.490204] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.484925] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.523305] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.546144] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.490210] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.523321] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.484955] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.546167] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.490274] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.546196] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.485434] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.485628] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.490733] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.546671] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.485645] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.490923] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.546860] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.490940] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.485676] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.541250] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.546877] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.490971] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.541450] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.546907] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.486183] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.490987] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.486374] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.541483] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.547526] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.486390] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.491460] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.547538] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.541950] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.491645] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.486420] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.542142] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.547543] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.486436] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.542173] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.547589] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.486900] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.542584] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.547640] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.487089] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.542768] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.487119] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.547689] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.543015] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.543314] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.487581] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.547737] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.543333] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.487789] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.543364] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.487819] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.488207] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.515705] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.515799] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.536467] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.516351] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.575879] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.516548] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.536851] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.516565] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.576003] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker2 # [ 0.537111] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.560029] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.537128] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.516595] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.576057] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.560254] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.537158] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.517104] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.576106] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.560272] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.517284] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.537688] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.560307] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.576157] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.537877] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.517300] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.560939] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.576300] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.537893] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.517333] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.560952] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.576352] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.537923] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.517789] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.576375] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.560959] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.517968] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.538526] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.517984] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.576399] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.538538] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.561010] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.518013] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.576422] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.538543] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.561059] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.576451] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned client # [ 0.518535] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.538591] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned lb # [ 0.561108] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.576474] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.518724] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.561157] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.538644] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.518740] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.576496] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned client # [ 0.518770] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.538692] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.576518] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.561205] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.576540] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.519224] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.538744] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.561254] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.519404] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.576563] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.538794] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.561304] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.519419] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.576587] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.538844] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.561353] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.519448] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.576610] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.519464] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.538894] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.561404] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.576632] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.576654] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.519937] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.538943] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.561508] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.576676] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.520122] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.561627] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.538995] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.576697] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.520151] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.561651] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.539107] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.576719] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.520601] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.561673] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.539156] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.576741] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.520826] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.561695] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.576763] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker2 # [ 0.539178] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.520855] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.561726] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.576784] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker2 # [ 0.539200] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.561750] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.576810] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.521309] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.539226] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.576846] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.521497] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.561773] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.539254] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.576856] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.561795] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.521750] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.539276] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.576861] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.522038] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.561819] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.539299] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.578089] pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.522056] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.561841] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.539321] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.522086] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.561865] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.539346] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.561888] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.522562] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.539369] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned client # [ 0.522747] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.561909] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.539393] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.522764] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.561931] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.539418] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.561955] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.522794] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.539442] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.561978] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.523390] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.539465] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.562000] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.523401] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.539490] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.562022] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker2 # [ 0.539513] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.523407] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.562043] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker2 # [ 0.539538] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.562067] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.523453] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.539562] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.562089] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.523500] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.539584] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.562117] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.539606] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.523546] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.562127] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.539629] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.562132] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.523592] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.539656] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.563365] pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.523643] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker2 # [ 0.539666] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.539670] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.584988] pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.571845] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.571937] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.630903] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) client # [ 0.571994] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.572052] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.572233] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.572293] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.572316] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.634268] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.572339] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.572363] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned client # [ 0.572392] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned client # [ 0.572416] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.572443] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned client # [ 0.572466] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.572488] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.572510] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned client # [ 0.572534] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.626675] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) client # [ 0.572557] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.640503] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.572578] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.572600] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.572621] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.572643] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.606134] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) client # [ 0.572664] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.629974] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.572685] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.572731] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.572754] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.572777] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.572809] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.572819] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.572824] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.574043] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.652665] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.654902] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.616747] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.640360] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.619221] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.642572] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.646365] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker1 # [ 0.666217] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.630584] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.669613] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.654570] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.634610] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.622878] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.676055] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) lb # [ 0.661118] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 0.640996] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.643210] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) client # [ 0.629274] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.631458] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.654004] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.693021] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.695180] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.675839] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) lb # [ 0.678387] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.680608] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.645373] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.647512] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker1 # [ 0.700092] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.660570] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.662631] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.691754] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.657687] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.713713] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.673241] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.716536] msm_serial: driver initialized worker1 # [ 0.716680] SuperH (H)SCI(F) driver initialized worker1 # [ 0.716735] STM32 USART driver initialized lb # [ 0.704449] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.661162] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.707509] msm_serial: driver initialized client # [ 0.663484] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.666134] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.708302] SuperH (H)SCI(F) driver initialized lb # [ 0.708365] STM32 USART driver initialized worker2 # [ 0.689403] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.692549] msm_serial: driver initialized worker2 # [ 0.692695] SuperH (H)SCI(F) driver initialized worker2 # [ 0.692750] STM32 USART driver initialized client # [ 0.684419] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.687249] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.752998] loop: module loaded worker1 # [ 0.753227] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.754153] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.704117] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.707036] msm_serial: driver initialized client # [ 0.707203] SuperH (H)SCI(F) driver initialized client # [ 0.707259] STM32 USART driver initialized lb # [ 0.747949] loop: module loaded lb # [ 0.748213] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.749127] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 0.731376] loop: module loaded worker2 # [ 0.731628] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.768676] megasas: 07.734.00.00-rc1 worker1 # [ 0.769502] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.771819] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.771854] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.773765] Using buffer write method worker1 # [ 0.773876] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.740967] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.781206] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.760476] megasas: 07.734.00.00-rc1 worker1 # [ 0.781243] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.782898] Using buffer write method lb # [ 0.761295] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.782936] Concatenating MTD devices: worker1 # [ 0.782941] (0): "0.flash" worker1 # [ 0.782945] (1): "0.flash" lb # [ 0.763769] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.782948] into device "0.flash" lb # [ 0.763810] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.765686] Using buffer write method lb # [ 0.765805] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.744599] megasas: 07.734.00.00-rc1 worker2 # [ 0.745375] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.738925] loop: module loaded lb # [ 0.775620] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.739176] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.775666] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.778060] Using buffer write method client # [ 0.740056] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.778115] Concatenating MTD devices: lb # [ 0.778119] (0): "0.flash" lb # [ 0.778124] (1): "0.flash" lb # [ 0.778127] into device "0.flash" worker2 # [ 0.761568] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.761624] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.764102] Using buffer write method worker2 # [ 0.764235] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.752557] megasas: 07.734.00.00-rc1 client # [ 0.753438] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.755714] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.755749] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.757580] Using buffer write method worker2 # [ 0.777682] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.757694] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.777750] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.779619] Using buffer write method client # [ 0.759556] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.779669] Concatenating MTD devices: client # [ 0.759600] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.779673] (0): "0.flash" worker2 # [ 0.779677] (1): "0.flash" worker2 # [ 0.779680] into device "0.flash" client # [ 0.780908] Using buffer write method client # [ 0.780958] Concatenating MTD devices: client # [ 0.780963] (0): "0.flash" client # [ 0.780967] (1): "0.flash" client # [ 0.780971] into device "0.flash" worker1 # [ 1.075980] Freeing initrd memory: 26148K worker1 # [ 1.082565] tun: Universal TUN/TAP device driver, 1.6 lb # [ 1.069118] Freeing initrd memory: 26140K worker1 # [ 1.086932] thunder_xcv, ver 1.0 worker1 # [ 1.087009] thunder_bgx, ver 1.0 worker1 # [ 1.087031] nicpf, ver 1.0 worker1 # [ 1.087603] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 1.087611] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 1.087635] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 1.087646] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 1.087676] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 1.087682] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 1.075981] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 1.087708] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 1.087714] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 1.094684] sky2: driver version 1.30 worker1 # [ 1.096998] usbcore: registered new interface driver usb-storage worker1 # [ 1.097148] usbcore: registered new interface driver usbserial_generic worker1 # [ 1.097172] usbserial: USB Serial support registered for generic worker1 # [ 1.097811] hv_vmbus: registering driver hyperv_keyboard lb # [ 1.080430] thunder_xcv, ver 1.0 lb # [ 1.080490] thunder_bgx, ver 1.0 lb # [ 1.080513] nicpf, ver 1.0 lb # [ 1.081115] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 1.102367] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 1.081122] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 1.102405] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 lb # [ 1.081147] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 1.102688] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 1.081155] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 1.081185] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 1.081191] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 1.081216] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 1.105588] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 1.081221] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 1.081361] sky2: driver version 1.30 worker1 # [ 1.105628] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:05:36 UTC (1789891536) worker1 # [ 1.106068] i2c_dev: i2c /dev entries driver lb # [ 1.083059] usbcore: registered new interface driver usb-storage lb # [ 1.083163] usbcore: registered new interface driver usbserial_generic lb # [ 1.083178] usbserial: USB Serial support registered for generic worker2 # [ 1.071781] Freeing initrd memory: 26148K lb # [ 1.084573] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 1.084610] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 1.111403] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 1.111419] sdhci: Copyright(c) Pierre Ossman lb # [ 1.084824] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 1.111690] Synopsys Designware Multimedia Card Interface Driver lb # [ 1.096217] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 1.111834] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 1.096640] hub 1-0:1.0: USB hub found worker1 # [ 1.112209] hub 1-0:1.0: USB hub found lb # [ 1.096658] hub 1-0:1.0: 6 ports detected worker1 # [ 1.112231] hub 1-0:1.0: 6 ports detected lb # [ 1.099894] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 1.078233] tun: Universal TUN/TAP device driver, 1.6 lb # [ 1.101645] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 1.116774] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 1.101683] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:05:36 UTC (1789891536) worker1 # [ 1.118703] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 1.118993] usbcore: registered new interface driver usbhid client # [ 1.067315] Freeing initrd memory: 26160K lb # [ 1.102038] i2c_dev: i2c /dev entries driver worker1 # [ 1.119000] usbhid: USB HID core driver worker2 # [ 1.082294] thunder_xcv, ver 1.0 worker2 # [ 1.082351] thunder_bgx, ver 1.0 worker2 # [ 1.082373] nicpf, ver 1.0 worker1 # [ 1.122734] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 1.082925] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 1.082933] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 1.125455] drop_monitor: Initializing network drop monitor service worker2 # [ 1.082956] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 1.125644] NET: Registered PF_INET6 protocol family worker2 # [ 1.082968] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 1.082998] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 1.127728] Segment Routing with IPv6 worker1 # [ 1.127751] In-situ OAM (IOAM) with IPv6 worker2 # [ 1.083004] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 1.073928] tun: Universal TUN/TAP device driver, 1.6 lb # [ 1.108093] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 1.127784] NET: Registered PF_PACKET protocol family lb # [ 1.108119] sdhci: Copyright(c) Pierre Ossman worker2 # [ 1.083027] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 1.108407] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 1.083033] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 1.083167] sky2: driver version 1.30 lb # [ 1.108802] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 1.110883] hid: raw HID events driver (C) Jiri Kosina lb # [ 1.111166] usbcore: registered new interface driver usbhid worker1 # [ 1.129456] 9pnet: Installing 9P2000 support lb # [ 1.111174] usbhid: USB HID core driver worker2 # [ 1.093301] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 1.078103] thunder_xcv, ver 1.0 worker2 # [ 1.093358] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 1.078163] thunder_bgx, ver 1.0 client # [ 1.078188] nicpf, ver 1.0 worker2 # [ 1.093668] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 client # [ 1.078777] e1000: Intel(R) PRO/1000 Network Driver client # [ 1.078786] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 1.132502] Key type dns_resolver registered lb # [ 1.117093] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 1.078811] e1000e: Intel(R) PRO/1000 Network Driver client # [ 1.078820] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 1.118855] drop_monitor: Initializing network drop monitor service worker2 # [ 1.096429] usbcore: registered new interface driver usb-storage lb # [ 1.119083] NET: Registered PF_INET6 protocol family client # [ 1.078851] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 1.096580] usbcore: registered new interface driver usbserial_generic client # [ 1.078857] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 1.096595] usbserial: USB Serial support registered for generic lb # [ 1.122661] Segment Routing with IPv6 client # [ 1.078882] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 1.097208] hv_vmbus: registering driver hyperv_keyboard lb # [ 1.122692] In-situ OAM (IOAM) with IPv6 lb # [ 1.122730] NET: Registered PF_PACKET protocol family worker1 # [ 1.139713] registered taskstats version 1 client # [ 1.078888] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 1.079024] sky2: driver version 1.30 worker2 # [ 1.101208] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 1.101243] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:05:36 UTC (1789891536) client # [ 1.088536] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 1.101616] i2c_dev: i2c /dev entries driver lb # [ 1.124422] 9pnet: Installing 9P2000 support client # [ 1.088650] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 1.140466] Loading compiled-in X.509 certificates lb # [ 1.127241] Key type dns_resolver registered client # [ 1.088885] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker2 # [ 1.104756] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 1.105208] hub 1-0:1.0: USB hub found worker2 # [ 1.105231] hub 1-0:1.0: 6 ports detected client # [ 1.091800] usbcore: registered new interface driver usb-storage client # [ 1.091943] usbcore: registered new interface driver usbserial_generic client # [ 1.091960] usbserial: USB Serial support registered for generic worker1 # [ 1.149237] Demotion targets for Node 0: null client # [ 1.092578] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 1.149383] Key type .fscrypt registered worker1 # [ 1.149390] Key type fscrypt-provisioning registered worker1 # [ 1.149503] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 1.109346] sdhci: Secure Digital Host Controller Interface driver lb # [ 1.134429] registered taskstats version 1 client # [ 1.096674] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 1.149524] ima: Allocated hash algorithm: sha1 worker2 # [ 1.109360] sdhci: Copyright(c) Pierre Ossman lb # [ 1.134740] Loading compiled-in X.509 certificates worker1 # [ 1.149550] ima: No architecture policies found worker1 # [ 1.153985] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 1.109633] Synopsys Designware Multimedia Card Interface Driver client # [ 1.096740] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:05:36 UTC (1789891536) client # [ 1.097098] i2c_dev: i2c /dev entries driver worker2 # [ 1.110005] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 1.111861] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 1.112117] usbcore: registered new interface driver usbhid client # [ 1.100171] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 1.112125] usbhid: USB HID core driver client # [ 1.101249] hub 1-0:1.0: USB hub found client # [ 1.101711] hub 1-0:1.0: 6 ports detected worker2 # [ 1.117782] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 1.119380] drop_monitor: Initializing network drop monitor service worker2 # [ 1.119543] NET: Registered PF_INET6 protocol family lb # [ 1.143912] Demotion targets for Node 0: null lb # [ 1.144072] Key type .fscrypt registered lb # [ 1.144080] Key type fscrypt-provisioning registered worker2 # [ 1.122772] Segment Routing with IPv6 client # [ 1.104618] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 1.122796] In-situ OAM (IOAM) with IPv6 lb # [ 1.144201] ima: No TPM chip found, activating TPM-bypass! client # [ 1.104630] sdhci: Copyright(c) Pierre Ossman worker2 # [ 1.122831] NET: Registered PF_PACKET protocol family lb # [ 1.144222] ima: Allocated hash algorithm: sha1 client # [ 1.104922] Synopsys Designware Multimedia Card Interface Driver lb # [ 1.144248] ima: No architecture policies found client # [ 1.105302] sdhci-pltfm: SDHCI platform and OF driver helper client # [ 1.107110] hid: raw HID events driver (C) Jiri Kosina client # [ 1.107394] usbcore: registered new interface driver usbhid lb # [ 1.148924] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 1.107401] usbhid: USB HID core driver worker2 # [ 1.124613] 9pnet: Installing 9P2000 support client # [ 1.113395] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 1.114997] drop_monitor: Initializing network drop monitor service client # [ 1.115330] NET: Registered PF_INET6 protocol family client # [ 1.118658] Segment Routing with IPv6 worker2 # [ 1.127130] Key type dns_resolver registered client # [ 1.118681] In-situ OAM (IOAM) with IPv6 client # [ 1.118716] NET: Registered PF_PACKET protocol family worker2 # [ 1.134762] registered taskstats version 1 worker2 # [ 1.134949] Loading compiled-in X.509 certificates client # [ 1.120421] 9pnet: Installing 9P2000 support client # [ 1.122950] Key type dns_resolver registered worker1 # [ 1.179160] clk: Disabling unused clocks worker1 # [ 1.179199] PM: genpd: Disabling unused power domains worker2 # [ 1.143889] Demotion targets for Node 0: null worker2 # [ 1.144043] Key type .fscrypt registered worker1 # [ 1.183823] Freeing unused kernel memory: 4736K worker2 # [ 1.144050] Key type fscrypt-provisioning registered worker1 # [ 1.184137] Run /init as init process worker2 # [ 1.144168] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 1.144190] ima: Allocated hash algorithm: sha1 client # [ 1.130581] registered taskstats version 1 worker2 # [ 1.144218] ima: No architecture policies found client # [ 1.130744] Loading compiled-in X.509 certificates worker2 # [ 1.148764] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 1.175785] clk: Disabling unused clocks lb # [ 1.175828] PM: genpd: Disabling unused power domains client # [ 1.139888] Demotion targets for Node 0: null client # [ 1.140037] Key type .fscrypt registered client # [ 1.140043] Key type fscrypt-provisioning registered client # [ 1.140155] ima: No TPM chip found, activating TPM-bypass! client # [ 1.140177] ima: Allocated hash algorithm: sha1 lb # [ 1.180446] Freeing unused kernel memory: 4736K client # [ 1.140205] ima: No architecture policies found lb # [ 1.180716] Run /init as init process client # [ 1.144584] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 1.202460] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.198398] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.173140] clk: Disabling unused clocks worker2 # [ 1.173186] PM: genpd: Disabling unused power domains worker2 # [ 1.177938] Freeing unused kernel memory: 4736K worker2 # [ 1.178149] Run /init as init process client # [ 1.169295] clk: Disabling unused clocks client # [ 1.169345] PM: genpd: Disabling unused power domains client # [ 1.174155] Freeing unused kernel memory: 4736K client # [ 1.174442] Run /init as init process worker2 # [ 1.195183] systemd[1]: Successfully made /usr/ read-only. client # [ 1.190346] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.359851] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.343694] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.352418] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.347755] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.516638] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.502878] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.538041] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.550862] systemd[1]: Detected virtualization qemu. worker2 # [ 1.509126] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.553212] systemd[1]: Detected architecture arm64. worker1 # [ 1.557322] systemd[1]: Running in initrd. client # [ 1.500453] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.533787] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.561284] systemd[1]: Initializing machine ID from random generator. lb # [ 1.546467] systemd[1]: Detected virtualization qemu. worker1 # [ 1.564189] systemd[1]: Hostname set to . lb # [ 1.549665] systemd[1]: Detected architecture arm64. lb # [ 1.551683] systemd[1]: Running in initrd. lb # [ 1.555510] systemd[1]: Initializing machine ID from random generator. lb # [ 1.558993] systemd[1]: Hostname set to . worker2 # [ 1.530466] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.544377] systemd[1]: Detected virtualization qemu. worker2 # [ 1.546633] systemd[1]: Detected architecture arm64. worker2 # [ 1.548709] systemd[1]: Running in initrd. client # [ 1.525127] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.537801] systemd[1]: Detected virtualization qemu. worker2 # [ 1.551517] systemd[1]: Initializing machine ID from random generator. client # [ 1.539848] systemd[1]: Detected architecture arm64. client # [ 1.541835] systemd[1]: Running in initrd. worker2 # [ 1.556763] systemd[1]: Hostname set to . client # [ 1.544621] systemd[1]: Initializing machine ID from random generator. client # [ 1.547637] systemd[1]: Hostname set to . lb # [ 1.584264] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.616171] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.608642] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.600032] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.707696] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.739867] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.732417] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.723753] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.867092] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.873074] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker1 # [ 1.900271] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.905664] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker1 # [ 1.906042] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.892061] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.897207] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 lb # [ 1.926633] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.885259] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.891109] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.909516] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.909831] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 2.007946] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 2.019066] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 2.020334] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 2.021700] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 2.022686] systemd[1]: Reached target Path Units. worker1 # [ 2.023578] systemd[1]: Reached target Slice Units. worker1 # [ 2.024421] systemd[1]: Reached target Swaps. worker1 # [ 2.025098] systemd[1]: Reached target Timer Units. worker1 # [ 2.026085] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 2.027292] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 2.028342] systemd[1]: Listening on Journal Sockets. worker1 # [ 2.029268] systemd[1]: Listening on udev Control Socket. worker1 # [ 2.030219] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 2.031075] systemd[1]: Reached target Socket Units. worker1 # [ 2.033746] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.997304] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 2.020288] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 2.044114] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 2.007652] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 2.044282] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 2.031087] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 2.009110] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 2.032613] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 2.010480] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 2.033926] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 2.011700] systemd[1]: Reached target Path Units. lb # [ 2.035015] systemd[1]: Reached target Path Units. worker2 # [ 2.012575] systemd[1]: Reached target Slice Units. lb # [ 2.035928] systemd[1]: Reached target Slice Units. worker1 # [ 2.052136] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 2.013433] systemd[1]: Reached target Swaps. lb # [ 2.036800] systemd[1]: Reached target Swaps. worker2 # [ 2.014201] systemd[1]: Reached target Timer Units. client # [ 1.999480] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 2.037593] systemd[1]: Reached target Timer Units. worker2 # [ 2.015293] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 2.038722] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 2.016642] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 2.017827] systemd[1]: Listening on Journal Sockets. worker2 # [ 2.018857] systemd[1]: Listening on udev Control Socket. lb # [ 2.040108] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 2.019955] systemd[1]: Listening on udev Kernel Socket. lb # [ 2.040270] systemd[1]: Listening on Journal Sockets. lb # [ 2.040419] systemd[1]: Listening on udev Control Socket. lb # [ 2.040550] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 2.020988] systemd[1]: Reached target Socket Units. lb # [ 2.040576] systemd[1]: Reached target Socket Units. worker2 # [ 2.023892] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 2.046956] systemd[1]: Starting Create List of Static Device Nodes... client # [ 2.010247] systemd[1]: Created slice Slice /system/modprobe. client # [ 2.011445] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 2.012786] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 2.013766] systemd[1]: Reached target Path Units. client # [ 2.014515] systemd[1]: Reached target Slice Units. client # [ 2.015261] systemd[1]: Reached target Swaps. client # [ 2.015995] systemd[1]: Reached target Timer Units. client # [ 2.016984] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 2.018163] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 2.055877] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 2.019247] systemd[1]: Listening on Journal Sockets. worker2 # [ 2.032685] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 2.057021] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 2.032840] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 2.020382] systemd[1]: Listening on udev Control Socket. client # [ 2.020507] systemd[1]: Listening on udev Kernel Socket. client # [ 2.020531] systemd[1]: Reached target Socket Units. worker1 # [ 2.076597] systemd[1]: Starting Journal Service... client # [ 2.024786] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 2.044678] systemd[1]: Mounting Kernel Configuration File System... client # [ 2.036005] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 2.052610] systemd[1]: Starting Journal Service... client # [ 2.037140] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 2.040772] systemd[1]: Mounting Kernel Configuration File System... lb # [ 2.076275] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 2.096202] systemd[1]: Starting Load Kernel Modules... worker1 # [ 2.097206] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 2.104256] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 2.113905] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 2.116152] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 2.100252] systemd[1]: Starting Journal Service... worker2 # [ 2.080594] systemd[1]: Starting Load Kernel Modules... client # [ 2.064434] systemd[1]: Starting Journal Service... worker2 # [ 2.081548] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 2.124365] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 2.107950] systemd[1]: Starting Load Kernel Modules... lb # [ 2.108904] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 2.125851] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 2.092898] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 2.140499] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 2.127927] systemd[1]: Starting Coldplug All udev Devices... client # [ 2.095895] systemd[1]: Starting Load Kernel Modules... client # [ 2.096851] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 2.136705] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 2.138797] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 2.103975] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 2.120672] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 2.125693] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 2.146919] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 2.128964] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 2.134452] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 2.139479] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 2.124580] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 2.128500] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 2.164252] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 2.165080] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 2.182993] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 2.173103] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 2.135823] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 2.148682] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 2.139475] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 2.152954] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 2.158223] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker2 # [ 2.158471] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 2.158481] [drm] features: -context_init worker2 # [ 2.159250] [drm] number of scanouts: 1 worker2 # [ 2.159269] [drm] number of cap sets: 0 worker1 # [ 2.200027] systemd-journald[73]: Collecting audit messages is disabled. worker1 # [ 2.204830] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 2.148355] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 2.148611] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 2.148620] [drm] features: -context_init client # [ 2.149454] [drm] number of scanouts: 1 worker2 # [ 2.173036] systemd[1]: Mounted Kernel Configuration File System. client # [ 2.149473] [drm] number of cap sets: 0 client # [ 2.150169] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 2.150585] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 2.216102] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 2.216372] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 2.216383] [drm] features: -context_init worker1 # [ 2.217163] [drm] number of scanouts: 1 client # [ 2.164526] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 2.217183] [drm] number of cap sets: 0 client # [ 2.170911] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 2.184772] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker2 # [ 2.184802] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 2.228627] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 2.213709] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 2.236355] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 2.179106] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 2.179144] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 2.240524] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 2.231693] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 2.240556] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 2.220820] Console: switching to colour frame buffer device 160x50 worker2 # [ 2.221481] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 2.208121] Console: switching to colour frame buffer device 160x50 client # [ 2.215325] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 2.256127] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 2.256393] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 2.256407] [drm] features: -context_init lb # [ 2.257220] [drm] number of scanouts: 1 lb # [ 2.257243] [drm] number of cap sets: 0 lb # [ 2.261491] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 2.241171] systemd[1]: Finished Load Kernel Modules. worker2 # [ 2.242586] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 2.264043] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 2.264070] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 2.276915] Console: switching to colour frame buffer device 160x50 worker2 # [ 2.251403] systemd[1]: Starting Apply Kernel Variables... client # [ 2.236509] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 2.275833] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 2.241206] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 2.304083] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 2.317595] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 2.317881] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 2.317924] systemd[1]: Reached target Local File Systems. worker2 # [ 2.280549] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 2.322540] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 2.300005] Console: switching to colour frame buffer device 160x50 lb # [ 2.306650] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 2.276029] systemd[1]: Finished Load Kernel Modules. client # [ 2.280647] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 2.348137] systemd[1]: Finished Load Kernel Modules. lb # [ 2.336788] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 2.337119] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 2.337171] systemd[1]: Reached target Local File Systems. lb # [ 2.342714] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 2.356346] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.329112] systemd[1]: Finished Apply Kernel Variables. client # [ 2.313145] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 2.313412] systemd[1]: Reached target Preparation for Local File Systems. client # [ 2.313454] systemd[1]: Reached target Local File Systems. worker2 # [ 2.334389] systemd[1]: Started Journal Service. client # [ 2.320270] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 2.321148] systemd-modules-load[74]: Inserted module 'dm_mod' worker2 # [ 2.322485] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.359884] systemd[1]: Finished Load Kernel Modules. lb # [ 2.368104] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.330297] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 2.331483] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker2 # [ 2.336687] systemd-modules-load[74]: Module 'virtio_rng' is built in worker2 # [ 2.337770] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 2.338776] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 2.339881] systemd[1]: Reached target Local File Systems. client # [ 2.352557] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.352519] systemd[1]: Starting Create System Files and Directories... lb # [ 2.372465] systemd-modules-load[74]: Inserted module 'dm_mod' worker2 # [ 2.354704] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 2.408053] systemd[1]: Started Journal Service. lb # [ 2.376353] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.397294] systemd[1]: Started Journal Service. worker1 # [ 2.404514] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.388505] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.392512] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.359385] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 2.360966] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.407752] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 2.377753] systemd[1]: Started Journal Service. worker1 # [ 2.416471] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.400791] systemd-modules-load[74]: Module 'virtio_rng' is built in client # [ 2.368555] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 2.420539] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.425229] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.409337] systemd[1]: Starting Create System Files and Directories... client # [ 2.378440] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.429445] systemd[1]: Starting Create System Files and Directories... client # [ 2.384449] systemd-modules-load[74]: Module 'virtio_rng' is built in worker1 # [ 2.436609] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.401894] systemd[1]: Finished Create System Files and Directories. client # [ 2.392499] systemd[1]: Starting Create System Files and Directories... lb # [ 2.434428] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.464996] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 2.434420] systemd-udevd[82]: Using default interface naming scheme 'v261'. client # [ 2.423280] systemd-udevd[81]: Using default interface naming scheme 'v261'. lb # [ 2.458203] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker1 # [ 2.481688] systemd[1]: Finished Create System Files and Directories. client # [ 2.446070] systemd[1]: Finished Create System Files and Directories. lb # [ 2.482225] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.465077] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.507640] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.501712] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.469887] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.535019] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.581311] systemd[1]: Starting Virtual Console Setup... lb # [ 2.572988] systemd[1]: Starting Virtual Console Setup... client # [ 2.540127] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.592610] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.595599] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.636565] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.644682] systemd[1]: Finished Virtual Console Setup. lb # [ 2.628588] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.636221] systemd[1]: Finished Virtual Console Setup. client # [ 2.601988] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.606206] systemd[1]: Finished Virtual Console Setup. worker2 # [ 3.202344] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 3.203374] systemd[1]: Reached target System Initialization. worker2 # [ 3.208236] systemd[1]: Reached target Basic System. lb # [ 3.242593] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 3.259638] systemd[1]: Finished Coldplug All udev Devices. lb # [ 3.244562] systemd[1]: Reached target System Initialization. worker1 # [ 3.264283] systemd[1]: Reached target System Initialization. lb # [ 3.248248] systemd[1]: Reached target Basic System. worker1 # [ 3.265159] systemd[1]: Reached target Basic System. client # [ 3.228442] systemd[1]: Finished Coldplug All udev Devices. client # [ 3.229536] systemd[1]: Reached target System Initialization. client # [ 3.232199] systemd[1]: Reached target Basic System. worker2 # [ 3.340880] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.406651] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.431033] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.396799] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.400146] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.395628] (udev-worker)[107]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.451228] (udev-worker)[106]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.456857] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.413395] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.453488] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 3.458583] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.438501] (udev-worker)[107]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.532125] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.513422] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.536221] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.518498] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.554451] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.541831] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 3.508376] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.524249] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.561075] systemd[1]: Reached target Initrd Root Device. client # [ 3.511629] systemd[1]: Reached target Initrd Root Device. client # [ 3.514587] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.565965] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.576375] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.586558] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.588659] systemd[1]: Mounting /sysroot... lb # [ 3.608300] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.626739] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.577845] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.584345] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.618516] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.635007] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.638508] systemd[1]: Mounting /sysroot... lb # [ 3.622691] systemd[1]: Mounting /sysroot... client # [ 3.592486] systemd[1]: Mounting /sysroot... worker2 # [ 3.650225] EXT4-fs (vda): mounted filesystem 0af5c4d8-35e9-4ab0-9a59-554be5b07457 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.639613] systemd[1]: Mounted /sysroot. worker2 # [ 3.640768] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.643670] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.710533] EXT4-fs (vda): mounted filesystem ba156868-730c-4d97-a9e9-8eaf4c1f531d r/w with ordered data mode. Quota mode: none. lb # [ 3.697824] EXT4-fs (vda): mounted filesystem 21a7c695-b047-4094-9690-b968796664c3 r/w with ordered data mode. Quota mode: none. client # [ 3.659618] EXT4-fs (vda): mounted filesystem 328b0766-fb02-4fb9-bf6e-0f8db200de6a r/w with ordered data mode. Quota mode: none. worker1 # [ 3.697747] systemd[1]: Mounted /sysroot. worker1 # [ 3.698878] systemd[1]: Reached target Initrd Root File System. client # [ 3.650135] systemd[1]: Mounted /sysroot. lb # [ 3.684838] systemd[1]: Mounted /sysroot. client # [ 3.653481] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.704150] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.687821] systemd[1]: Reached target Initrd Root File System. client # [ 3.659750] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.694309] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.675971] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.682247] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 3.687605] systemd[1]: Reloading... worker1 # [ 3.738936] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.744003] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.695503] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.729740] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.750279] systemd[1]: Reloading... client # [ 3.701707] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.736141] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.738641] systemd[1]: Reloading... client # [ 3.707501] systemd[1]: Reloading... worker2 # [ 3.935306] systemd[1]: Reloading finished in 249 ms. worker1 # [ 3.994200] systemd[1]: Reloading finished in 245 ms. lb # [ 3.984153] systemd[1]: Reloading finished in 247 ms. client # [ 3.951240] systemd[1]: Reloading finished in 246 ms. worker2 # [ 3.969528] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.975840] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker2 # [ 3.980151] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.992981] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 4.028874] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.996261] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 4.015694] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.999528] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.985003] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... lb # [ 4.019770] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker1 # [ 4.036218] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker1 # [ 4.040283] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.991986] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 4.028859] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.996160] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 4.032589] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 4.035995] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 4.052910] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 4.055366] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 4.040766] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 4.057398] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 4.009233] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 4.023674] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 4.011800] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 4.027250] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 4.015418] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 4.068788] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 4.037385] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 4.071454] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 4.040580] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 4.091371] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 4.108995] systemd[1]: Mounting /sysroot/run... worker1 # [ 4.111330] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 4.116358] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 4.086093] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 4.128331] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 4.115986] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 4.104306] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 4.127117] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 4.117914] systemd[1]: Mounting /sysroot/run... worker1 # [ 4.156954] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 4.148334] systemd[1]: Mounting /sysroot/run... client # [ 4.123834] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 4.133972] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 4.186459] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 4.170997] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 4.154171] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 4.148128] systemd[1]: Mounting /sysroot/run... lb # [ 4.196301] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 4.169847] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 4.187441] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 4.228169] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 4.234705] systemd[1]: Mounted /sysroot/run. worker2 # [ 4.203501] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 4.242838] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 4.216387] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 4.250311] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 4.230841] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.246305] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 4.284364] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.257744] systemd[1]: Mounted /sysroot/run. worker1 # [ 4.294324] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 4.246454] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 4.298712] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 4.282699] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 4.257375] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 4.277955] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 4.299391] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.323039] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.324826] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.308809] systemd[1]: Mounted /sysroot/run. worker2 # [ 4.294058] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.318904] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 4.300238] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 4.287703] systemd[1]: Mounted /sysroot/run. worker2 # [ 4.304810] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 4.326347] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 4.312966] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.303793] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 4.358211] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.326862] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.361940] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 4.329359] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 4.365872] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.364781] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.366407] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.370086] systemd[1]: Starting Find NixOS closure... client # [ 4.358119] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.359731] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.380256] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.419420] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.421039] systemd[1]: Reached target Initrd File Systems. lb # [ 4.425196] systemd[1]: Starting Find NixOS closure... lb # [ 4.444896] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.429774] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.452148] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.455211] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.458413] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.488889] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.510198] systemd[1]: Finished Find NixOS closure. lb # [ 4.513158] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.499971] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.519128] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.503596] systemd[1]: Stopped target Basic System. worker2 # [ 4.509290] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.510148] systemd[1]: Stopped target Path Units. worker2 # [ 4.510856] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.511982] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.517960] systemd[1]: Stopped target Slice Units. worker2 # [ 4.524706] systemd[1]: Stopped target Socket Units. worker2 # [ 4.526639] systemd[1]: Stopped target System Initialization. worker2 # [ 4.528719] systemd[1]: Stopped target Swaps. worker2 # [ 4.529443] systemd[1]: Stopped target Timer Units. worker2 # [ 4.532185] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.534534] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.541368] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 4.562434] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 4.543778] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.544693] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 4.566434] systemd[1]: Stopped target Basic System. worker2 # [ 4.548232] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.568412] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.570815] systemd[1]: Stopped target Path Units. worker2 # [ 4.552180] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 4.575820] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.557173] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.559353] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 4.579180] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 4.583878] systemd[1]: Stopped target Slice Units. lb # [ 4.584831] systemd[1]: Stopped target Socket Units. worker2 # [ 4.565675] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 4.566537] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 4.567835] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 4.588228] systemd[1]: Stopped target System Initialization. lb # [ 4.590531] systemd[1]: Stopped target Swaps. lb # [ 4.592875] systemd[1]: Stopped target Timer Units. lb # [ 4.597193] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.579700] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.599651] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.602141] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 4.584657] systemd[1]: Stopped Create System Files and Directories. lb # [ 4.609023] systemd[1]: Stopped Find NixOS closure. lb # [ 4.611314] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 4.612375] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.614680] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.596217] systemd[1]: Stopped target Local File Systems. worker2 # [ 4.600447] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 4.601775] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 4.622631] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.609018] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 4.627618] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 4.610761] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 4.633269] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 4.613512] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.634091] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 4.635225] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 4.618082] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.620811] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.623231] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 4.628005] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 4.629419] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 4.649357] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 4.630271] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.631269] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.635853] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 4.656301] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 4.639063] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 4.640646] systemd[1]: systemd-udevd.service: Consumed 1.010s CPU time over 2.281s wall clock time, 16.1M memory peak. worker2 # [ 4.644507] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 4.664822] systemd[1]: Stopped target Local File Systems. lb # [ 4.667162] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 4.648437] systemd[1]: Closed udev Control Socket. worker2 # [ 4.649279] systemd[1]: Starting Cleanup udev Database... worker2 # [ 4.650087] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 4.670407] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 4.652371] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.674067] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 4.655358] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 4.656824] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 4.657794] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.677587] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 4.658758] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.680818] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.684819] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.688537] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 4.689643] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 4.690536] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.692278] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.695349] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.696830] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.711740] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 4.714947] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 4.695184] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 4.699597] systemd[1]: Finished Cleanup udev Database. worker2 # [ 4.701147] systemd[1]: Reached target Switch Root. lb # [ 4.720547] systemd[1]: systemd-udevd.service: Consumed 1.026s CPU time over 2.388s wall clock time, 18.5M memory peak. lb # [ 4.722165] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 4.702479] systemd[1]: Starting NixOS Activation... lb # [ 4.723247] systemd[1]: Closed udev Control Socket. lb # [ 4.724361] systemd[1]: Starting Cleanup udev Database... lb # [ 4.726061] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 4.728491] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.730701] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 4.731875] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 4.733086] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.734048] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.763054] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 4.765449] systemd[1]: Finished Cleanup udev Database. lb # [ 4.768665] systemd[1]: Reached target Switch Root. lb # [ 4.771017] systemd[1]: Starting NixOS Activation... worker2 # [ 4.965808] initrd-nixos-activation-start[172]: booting system configuration /nix/store/zwss4dc02qc6i44w7sb05pfw9f3zvc9l-nixos-system-worker2-test lb # [ 5.021153] initrd-nixos-activation-start[172]: booting system configuration /nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test worker1 # [ 5.065516] (udev-worker)[97]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 5.068911] (udev-worker)[97]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker2 # [ 5.044942] initrd-nixos-activation-start[172]: running activation script... worker1 # [ 5.092194] systemd[1]: Mounting /sysroot/nix/store... client # [ 5.060345] (udev-worker)[93]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory client # [ 5.065717] (udev-worker)[93]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 5.118472] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.123227] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 5.128250] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 5.147114] systemd[1]: Starting Virtual Console Setup... lb # [ 5.132912] initrd-nixos-activation-start[172]: running activation script... worker1 # [ 5.151252] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.102110] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.153628] systemd[1]: Stopped Virtual Console Setup. client # [ 5.104209] systemd[1]: Stopped Virtual Console Setup. client # [ 5.106286] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 5.161544] systemd[1]: Mounted /sysroot/nix/store. client # [ 5.111569] systemd[1]: Starting Virtual Console Setup... worker1 # [ 5.169518] systemd[1]: Reached target Initrd File Systems. client # [ 5.120778] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.172292] systemd[1]: Starting Find NixOS closure... client # [ 5.123007] systemd[1]: Stopped Virtual Console Setup. client # [ 5.127184] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 5.180425] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 5.136632] systemd[1]: Starting Virtual Console Setup... worker1 # [ 5.190600] systemd[1]: Starting Virtual Console Setup... worker1 # [ 5.237741] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 5.239081] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 5.197115] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 5.203099] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 5.254374] systemd-vconsole-setup[160]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 5.205433] systemd[1]: Finished Virtual Console Setup. client # [ 5.208366] systemd[1]: sysroot-run-credentials-systemd\x2dvconsole\x2dsetup.service.mount: Deactivated successfully. worker1 # [ 5.262190] systemd[1]: Finished Virtual Console Setup. client # [ 5.212244] systemd[1]: Reached target Initrd File Systems. worker1 # [ 5.263386] systemd[1]: sysroot-run-credentials-systemd\x2dvconsole\x2dsetup.service.mount: Deactivated successfully. client # [ 5.215242] systemd[1]: Starting Find NixOS closure... worker1 # [ 5.269235] systemd[1]: Finished Find NixOS closure. worker1 # [ 5.271779] systemd[1]: Reached target Initrd Default Target. worker1 # [ 5.273621] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 5.224545] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 5.298431] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 5.300587] systemd[1]: Stopped target Basic System. worker1 # [ 5.301660] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 5.304396] systemd[1]: Stopped target Path Units. worker1 # [ 5.305234] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 5.308313] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.310482] systemd[1]: Stopped target Slice Units. worker1 # [ 5.312598] systemd[1]: Stopped target Socket Units. client # [ 5.262996] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 5.316599] systemd[1]: Stopped target System Initialization. worker1 # [ 5.318431] systemd[1]: Stopped target Swaps. worker1 # [ 5.320153] systemd[1]: Stopped target Timer Units. worker1 # [ 5.321644] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 5.324370] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 5.328297] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.278467] systemd[1]: Finished Find NixOS closure. client # [ 5.281463] systemd[1]: Reached target Initrd Default Target. worker1 # [ 5.333225] systemd[1]: Stopped Find NixOS closure. worker1 # [ 5.337251] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 5.288563] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 5.340404] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.348273] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 5.351003] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.356395] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.359002] systemd[1]: Stopped Load Kernel Modules. client # [ 5.312611] systemd[1]: Stopped target Initrd Default Target. client # [ 5.314268] systemd[1]: Stopped target Basic System. client # [ 5.315312] systemd[1]: Stopped target Initrd Root Device. client # [ 5.320314] systemd[1]: Stopped target Path Units. worker1 # [ 5.369970] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.321112] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.322165] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 5.323247] systemd[1]: Stopped target Slice Units. client # [ 5.323960] systemd[1]: Stopped target Socket Units. worker1 # [ 5.376559] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.327255] systemd[1]: Stopped target System Initialization. client # [ 5.328615] systemd[1]: Stopped target Swaps. client # [ 5.332670] systemd[1]: Stopped target Timer Units. client # [ 5.334090] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.337365] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 5.387820] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.340853] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 5.390934] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.393290] systemd[1]: Stopped target Local File Systems. client # [ 5.345478] systemd[1]: Stopped Find NixOS closure. worker1 # [ 5.395621] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.397946] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 5.349721] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 5.400208] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 5.402164] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 5.406034] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.355980] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.407223] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 5.409239] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.359637] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.361156] systemd[1]: Stopped Apply Kernel Variables. client # [ 5.361935] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.412339] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.413477] systemd[1]: systemd-udevd.service: Consumed 1.607s CPU time over 3.078s wall clock time, 22.2M memory peak. client # [ 5.365949] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 5.418219] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.419513] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.420703] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 5.421752] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 5.422644] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.372317] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 5.423733] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.375110] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.428363] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.429538] systemd[1]: Closed udev Control Socket. client # [ 5.381192] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.432159] systemd[1]: Starting Cleanup udev Database... worker1 # [ 5.433650] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 5.386155] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.436378] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 5.440237] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 5.441521] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.392701] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.444165] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.445188] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 5.396234] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.400871] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 5.403481] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.408703] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.409937] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.410986] systemd[1]: Stopped Virtual Console Setup. client # [ 5.411716] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.416426] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.419197] systemd[1]: systemd-udevd.service: Consumed 1.650s CPU time over 3.069s wall clock time, 25.5M memory peak. client # [ 5.422174] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 5.424472] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.428331] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.429463] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.479233] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.430419] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 5.482133] systemd[1]: Finished Cleanup udev Database. client # [ 5.432689] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.433749] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.434801] systemd[1]: Closed udev Control Socket. worker1 # [ 5.484422] systemd[1]: Reached target Switch Root. client # [ 5.435559] systemd[1]: Starting Cleanup udev Database... worker1 # [ 5.486527] systemd[1]: Starting NixOS Activation... client # [ 5.436508] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 5.437607] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.438478] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.439607] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.444385] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.445525] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 5.485908] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.488689] systemd[1]: Finished Cleanup udev Database. client # [ 5.491471] systemd[1]: Reached target Switch Root. client # [ 5.493751] systemd[1]: Starting NixOS Activation... worker2 # [ 5.587441] initrd-nixos-activation-start[195]: setting up /etc... worker1 # [ 5.659284] initrd-nixos-activation-start[180]: booting system configuration /nix/store/wz2244whakjfkgc25yjaqssxl682ahpy-nixos-system-worker1-test lb # [ 5.660631] initrd-nixos-activation-start[195]: setting up /etc... client # [ 5.681687] initrd-nixos-activation-start[180]: booting system configuration /nix/store/7pfca4pninpmfbhvzygaqz91qmaivwdc-nixos-system-client-test worker1 # [ 5.753176] initrd-nixos-activation-start[180]: running activation script... client # [ 5.757004] initrd-nixos-activation-start[180]: running activation script... worker2 # [ 5.887277] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.890678] systemd[1]: Finished NixOS Activation. worker2 # [ 5.892123] systemd[1]: Starting Switch Root... worker2 # [ 5.919091] systemd[1]: Switching root. lb # [ 5.966348] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.970639] systemd[1]: Finished NixOS Activation. lb # [ 5.976502] systemd[1]: Starting Switch Root... lb # [ 5.999617] systemd[1]: Switching root. worker2 # [ 6.111271] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 6.189462] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 6.276656] initrd-nixos-activation-start[203]: setting up /etc... client # [ 6.327240] initrd-nixos-activation-start[203]: setting up /etc... worker1 # [ 6.622252] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 6.625698] systemd[1]: Finished NixOS Activation. worker1 # [ 6.627721] systemd[1]: Starting Switch Root... worker1 # [ 6.654639] systemd[1]: Switching root. client # [ 6.681553] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.684200] systemd[1]: Finished NixOS Activation. client # [ 6.686704] systemd[1]: Starting Switch Root... worker2 # [ 6.706089] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.719059] systemd[1]: Detected virtualization qemu. worker2 # [ 6.722626] systemd[1]: Detected architecture arm64. worker2 # [ 6.727274] systemd[1]: Detected first boot. lb # [ 6.750634] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.738630] systemd[1]: Initializing machine ID from random generator. lb # [ 6.763082] systemd[1]: Detected virtualization qemu. lb # [ 6.766255] systemd[1]: Detected architecture arm64. lb # [ 6.771302] systemd[1]: Detected first boot. client # [ 6.717548] systemd[1]: Switching root. lb # [ 6.779386] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.859461] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). client # [ 6.914007] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 7.008462] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 7.087203] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 7.206506] systemd[1]: Applying preset policy. worker2 # [ 7.304940] systemd[1]: Applying preset policy. worker1 # [ 7.527542] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 7.533021] systemd[1]: Detected virtualization qemu. worker1 # [ 7.535290] systemd[1]: Detected architecture arm64. worker1 # [ 7.539430] systemd[1]: Detected first boot. worker1 # [ 7.547665] systemd[1]: Initializing machine ID from random generator. client # [ 7.576753] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 7.583483] systemd[1]: Detected virtualization qemu. client # [ 7.585299] systemd[1]: Detected architecture arm64. client # [ 7.586069] systemd[1]: Detected first boot. client # [ 7.594779] systemd[1]: Initializing machine ID from random generator. lb # [ 7.876840] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.907194] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 7.915242] systemd[1]: Populated /etc with preset unit settings. client # [ 7.909500] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 8.111939] systemd[1]: Applying preset policy. client # [ 8.142879] systemd[1]: Applying preset policy. worker2 # [ 8.473068] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 8.475058] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 8.479763] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.486214] systemd[1]: Created slice Slice /system/getty. lb # [ 8.509282] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 8.510879] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 8.489169] systemd[1]: Created slice User and Session Slice. worker2 # [ 8.490804] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 8.515563] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.493633] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 8.496108] systemd[1]: Expecting device /dev/hvc0... lb # [ 8.520556] systemd[1]: Created slice Slice /system/getty. worker2 # [ 8.498419] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 8.522962] systemd[1]: Created slice User and Session Slice. lb # [ 8.525118] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 8.502124] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 8.526974] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 8.505175] systemd[1]: Stopped target initrd-fs.target. lb # [ 8.529852] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 8.507599] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 8.531832] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 8.510581] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 8.535723] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 8.513487] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 8.537430] systemd[1]: Stopped target initrd-fs.target. lb # [ 8.538898] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 8.514990] systemd[1]: Reached target Path Units. worker2 # [ 8.518244] systemd[1]: Reached target Remote File Systems. worker2 # [ 8.519796] systemd[1]: Reached target Slice Units. lb # [ 8.540553] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 8.521954] systemd[1]: Reached target Swaps. lb # [ 8.546170] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 8.548456] systemd[1]: Reached target Path Units. lb # [ 8.550495] systemd[1]: Reached target Remote File Systems. worker2 # [ 8.529534] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 8.552952] systemd[1]: Reached target Slice Units. lb # [ 8.554003] systemd[1]: Reached target Swaps. lb # [ 8.558960] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 8.536403] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 8.541679] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 8.565045] systemd[1]: Listening on Process Core Dump Socket. lb # [ 8.570067] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 8.547113] systemd[1]: Listening on Factory Reset Management. worker2 # [ 8.548548] systemd[1]: Listening on Hostname Service Socket. lb # [ 8.574349] systemd[1]: Listening on Factory Reset Management. lb # [ 8.575780] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 8.558370] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.582583] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 8.561536] systemd[1]: Listening on Journal Audit Socket. lb # [ 8.585816] systemd[1]: Listening on Journal Audit Socket. lb # [ 8.591396] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 8.594819] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 8.598557] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.576504] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 8.601870] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 8.581412] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 8.584298] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.587605] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 8.625351] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 8.627739] systemd[1]: Listening on udev Control Socket. lb # [ 8.629819] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 8.612796] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 8.636860] systemd[1]: Mounting Huge Pages File System... worker2 # [ 8.618270] systemd[1]: Listening on udev Control Socket. lb # [ 8.644881] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 8.623004] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 8.671093] systemd[1]: Populated /etc with preset unit settings. lb # [ 8.656185] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 8.633554] systemd[1]: Mounting Huge Pages File System... lb # [ 8.665873] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 8.641240] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 8.651047] systemd[1]: Mounting Kernel Debug File System... lb # [ 8.691196] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 8.669902] systemd[1]: Mounting Kernel Trace File System... lb # [ 8.698920] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.701142] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 8.691887] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 8.724102] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.725675] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 8.732064] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.710197] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 8.715494] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 8.745389] systemd[1]: Starting Load Kernel Module fuse... lb # [ 8.747892] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.730459] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 8.730964] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 8.731294] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 8.722603] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 8.751586] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 8.757757] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.821287] systemd[1]: Starting Journal Service... lb # [ 8.850352] systemd[1]: Starting Journal Service... worker2 # [ 8.842038] systemd[1]: Starting Load Kernel Modules... lb # [ 8.881786] systemd[1]: Starting Load Kernel Modules... worker2 # [ 8.872475] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 8.901820] fuse: init (API version 7.45) worker2 # [ 8.887890] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 8.888442] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.896700] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.923525] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 8.903549] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 8.912831] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.913685] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 8.914218] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 8.914694] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 8.915151] systemd[1]: Mounted Kernel Configuration File System. lb # [ 8.966768] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 8.958854] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.984055] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.967742] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 9.003932] systemd-journald[267]: Collecting audit messages is enabled. lb # [ 8.999155] systemd[1]: Queued start job for default target Multi-User System. lb # [ 9.022846] systemd[1]: Starting Coldplug All udev Devices... lb # [ 9.007716] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 9.050670] systemd[1]: Started Journal Service. lb # [ 9.043016] systemd-modules-load[268]: Module 'atkbd' is built in lb # [ 9.050408] systemd-modules-load[268]: Module 'loop' is built in lb # [ 9.053650] systemd[1]: Listening on Journal Log Access Socket. lb # [ 9.061883] systemd[1]: Mounted Huge Pages File System. lb # [ 9.066493] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 9.064107] systemd[1]: Finished Load Kernel Modules. lb # [ 9.074692] systemd[1]: Mounted Kernel Debug File System. lb # [ 9.077035] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 9.072192] systemd[1]: Starting Firewall... worker2 # [ 9.079508] systemd[1]: Starting Apply Kernel Variables... lb # [ 9.083319] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 9.092862] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 9.093894] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 9.094724] systemd[1]: Mounted Kernel Configuration File System. lb # [ 9.095580] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 9.109427] systemd[1]: Finished Load Kernel Module fuse. lb # [ 9.115851] systemd[1]: Finished Load Kernel Modules. worker2 # [ 9.108535] EXT4-fs (vda): re-mounted 0af5c4d8-35e9-4ab0-9a59-554be5b07457. lb # [ 9.143826] EXT4-fs (vda): re-mounted 21a7c695-b047-4094-9690-b968796664c3. worker2 # [ 9.125852] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 9.129263] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 9.134733] systemd-journald[267]: Collecting audit messages is enabled. lb # [ 9.141645] systemd[1]: Mounting FUSE Control File System... worker2 # [ 9.149851] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 9.153171] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 9.160612] systemd[1]: Starting Firewall... worker2 # [ 9.156568] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 9.154151] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 9.178185] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 9.178643] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 9.186333] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 9.179199] systemd[1]: Started Journal Service. worker2 # [ 9.175049] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 9.213277] systemd-oomd[269]: No swap; memory pressure usage will be degraded lb # [ 9.215444] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 9.225294] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 9.227330] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 9.208750] systemd-modules-load[268]: Module 'atkbd' is built in worker2 # [ 9.215702] systemd-modules-load[268]: Module 'loop' is built in lb # [ 9.250052] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 9.237730] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 9.238238] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 9.239498] systemd[1]: Stopped initrd-switch-root.service. client # [ 9.243959] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 9.249660] systemd[1]: Created slice Slice /system/getty. client # [ 9.253423] systemd[1]: Created slice User and Session Slice. lb # [ 9.275947] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 9.256143] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 9.272841] fuse: init (API version 7.45) client # [ 9.258979] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 9.262365] systemd[1]: Expecting device /dev/hvc0... lb # [ 9.277997] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 9.265246] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 9.267907] systemd[1]: Reached target Local Encrypted Volumes. client # [ 9.270457] systemd[1]: Stopped target initrd-fs.target. lb # [ 9.288675] systemd[1]: Starting Load/Save OS Random Seed... client # [ 9.272973] systemd[1]: Stopped target initrd-root-fs.target. client # [ 9.275357] systemd[1]: Stopped target initrd-switch-root.target. client # [ 9.278036] systemd[1]: Reached target Virtual Machines and Containers. client # [ 9.280761] systemd[1]: Reached target Path Units. lb # [ 9.299528] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 9.283212] systemd[1]: Reached target Remote File Systems. client # [ 9.286059] systemd[1]: Reached target Slice Units. worker2 # [ 9.287833] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 9.289698] systemd[1]: Reached target Swaps. client # [ 9.300766] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 9.302333] systemd[1]: Finished Load Kernel Module fuse. client # [ 9.307503] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 9.307974] systemd-oomd[269]: No swap; memory pressure usage will be degraded client # [ 9.314461] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 9.320839] systemd[1]: Listening on Factory Reset Management. client # [ 9.323627] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 9.327531] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 9.331379] systemd[1]: Starting Journal Log Access Socket... client # [ 9.335363] systemd[1]: Listening on Journal Audit Socket. client # [ 9.344318] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 9.345224] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 9.345647] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.405694] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 9.366383] systemd-journald[267]: Received client request to flush runtime journal. client # [ 9.345956] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 9.408179] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 9.412335] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 9.364911] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 9.421433] systemd[1]: Created slice Slice /system/getty. client # [ 9.368222] systemd[1]: Listening on udev Control Socket. client # [ 9.370077] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 9.424168] systemd[1]: Created slice User and Session Slice. worker1 # [ 9.424918] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 9.425409] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 9.376909] systemd[1]: Mounting Huge Pages File System... worker1 # [ 9.425809] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 9.426166] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 9.426525] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 9.426909] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 9.427255] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 9.427581] systemd[1]: Stopped target initrd-switch-root.target. client # [ 9.381926] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 9.436570] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 9.440061] systemd[1]: Reached target Path Units. worker1 # [ 9.442405] systemd[1]: Reached target Remote File Systems. client # [ 9.390425] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 9.445391] systemd[1]: Reached target Slice Units. worker1 # [ 9.447821] systemd[1]: Reached target Swaps. worker1 # [ 9.453634] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 9.401909] systemd[1]: Mounting Kernel Trace File System... lb # [ 9.423371] systemd[1]: Mounted FUSE Control File System. worker1 # [ 9.464229] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 9.469913] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 9.479154] systemd[1]: Listening on Factory Reset Management. client # [ 9.428539] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 9.481999] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 9.489934] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 9.438464] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 9.495120] systemd[1]: Listening on Journal Audit Socket. lb # [ 9.479340] systemd-journald[267]: Received client request to flush runtime journal. client # [ 9.444717] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 9.447864] systemd[1]: Reached target First Boot Complete. client # [ 9.446594] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 9.503605] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 9.506854] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 9.452922] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 9.509676] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.512583] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 9.464828] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 9.525357] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 9.528352] systemd[1]: Listening on udev Control Socket. client # [ 9.475071] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 9.473317] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 9.531119] systemd[1]: Listening on udev Varlink Socket. client # [ 9.476933] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 9.480046] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 9.538237] systemd[1]: Mounting Huge Pages File System... worker2 # [ 9.482940] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 9.545090] systemd[1]: Mounting POSIX Message Queue File System... client # [ 9.500686] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 9.500201] systemd[1]: Mounting FUSE Control File System... worker1 # [ 9.560197] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 9.568646] systemd[1]: Mounting Kernel Trace File System... client # [ 9.515258] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 9.540713] systemd[1]: Finished Apply Kernel Variables. lb # [ 9.543574] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 9.551334] systemd[1]: Reached target First Boot Complete. lb # [ 9.552706] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 9.555640] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 9.558578] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 9.540968] systemd[1]: Mounted FUSE Control File System. worker1 # [ 9.598612] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 9.628153] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 9.629822] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 9.575391] systemd[1]: Starting Journal Service... worker1 # [ 9.647015] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 9.652414] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 9.660237] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 9.625793] systemd[1]: Starting Load Kernel Modules... worker2 # [ 9.629706] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 9.685823] systemd[1]: Starting Load Kernel Module fuse... client # [ 9.635321] fuse: init (API version 7.45) worker2 # [ 9.635749] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 9.642528] systemd[1]: Mounting /run/wrappers... worker1 # [ 9.701056] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 9.667911] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 9.649799] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 9.672427] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 9.680372] systemd[1]: Mounting /run/wrappers... lb # [ 9.685158] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 9.665427] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 9.750718] systemd[1]: Starting Journal Service... worker1 # [ 9.768031] systemd[1]: Starting Load Kernel Modules... client # [ 9.723261] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 9.727882] systemd[1]: Mounted /run/wrappers. worker2 # [ 9.730322] systemd[1]: Reached target Local File Systems. client # [ 9.727302] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.790967] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 9.740394] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 9.742399] systemd-journald[274]: Collecting audit messages is enabled. worker2 # [ 9.750036] systemd[1]: Starting register-nix-paths.service... client # [ 9.741134] systemd[1]: Queued start job for default target Multi-User System. lb # [ 9.777171] systemd[1]: Mounted /run/wrappers. lb # [ 9.778273] systemd[1]: Reached target Local File Systems. worker2 # [ 9.760452] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 9.783596] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 9.746873] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 9.770215] systemd[1]: Starting Coldplug All udev Devices... lb # [ 9.796161] systemd[1]: Starting register-nix-paths.service... worker1 # [ 9.831320] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 9.777738] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 9.764809] systemd-modules-load[275]: Module 'atkbd' is built in worker1 # [ 9.836207] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 9.772362] systemd-modules-load[275]: Module 'loop' is built in worker2 # [ 9.792576] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 9.796480] systemd[1]: Started Journal Service. worker2 # [ 9.798181] systemd[1]: Starting Create System Files and Directories... lb # [ 9.820949] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 9.859787] systemd[1]: Starting Coldplug All udev Devices... lb # [ 9.823068] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 9.866855] systemd[1]: Listening on Journal Log Access Socket. client # [ 9.799654] systemd[1]: Listening on Journal Log Access Socket. client # [ 9.803337] systemd[1]: Mounted Huge Pages File System. worker1 # [ 9.876004] systemd[1]: Mounted Huge Pages File System. worker1 # [ 9.879182] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 9.848222] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 9.814441] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 9.883459] systemd[1]: Mounted Kernel Debug File System. client # [ 9.815788] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 9.887260] systemd[1]: Mounted Kernel Trace File System. client # [ 9.822113] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 9.893917] systemd[1]: Mounted Kernel Configuration File System. client # [ 9.829758] systemd[1]: Finished Create List of Static Device Nodes. client # [ 9.838786] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 9.876611] systemd[1]: Starting Create System Files and Directories... client # [ 9.843738] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 9.852959] systemd[1]: Mounted Kernel Configuration File System. client # [ 9.862137] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 9.867107] systemd[1]: Finished Load Kernel Module fuse. client # [ 9.873790] systemd[1]: Finished Load Kernel Modules. worker1 # [ 9.949759] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 9.909586] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.902777] systemd[1]: Mounting FUSE Control File System... worker1 # [ 9.974401] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 9.923932] EXT4-fs (vda): re-mounted 328b0766-fb02-4fb9-bf6e-0f8db200de6a. client # [ 9.914045] systemd[1]: Starting Apply Kernel Variables... client # [ 9.931448] systemd-oomd[277]: No swap; memory pressure usage will be degraded client # [ 9.945896] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 9.960060] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 9.968794] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 9.992796] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 10.051009] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 10.018460] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 10.021035] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 10.107415] systemd[1]: Finished Load Kernel Modules. worker1 # [ 10.112313] EXT4-fs (vda): re-mounted ba156868-730c-4d97-a9e9-8eaf4c1f531d. client # [ 10.054121] systemd[1]: Starting Load/Save OS Random Seed... client # [ 10.057399] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 10.124951] systemd-journald[274]: Collecting audit messages is enabled. worker1 # [ 10.133246] systemd[1]: Starting Firewall... worker2 # [ 10.091476] systemd[1]: Finished Create System Files and Directories. worker1 # [ 10.152068] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 10.099201] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 10.111641] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 10.176994] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 10.178186] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 10.178655] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 10.199164] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 10.203156] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 10.186970] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 10.209178] systemd[1]: Started Journal Service. lb # [ 10.176319] systemd[1]: Finished Create System Files and Directories. client # [ 10.140934] systemd[1]: Mounted FUSE Control File System. lb # [ 10.182779] systemd[1]: Starting Rebuild Journal Catalog... client # [ 10.162190] systemd-journald[274]: Received client request to flush runtime journal. lb # [ 10.187523] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 10.207662] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 10.237423] systemd-modules-load[275]: Module 'atkbd' is built in worker1 # [ 10.261406] systemd-modules-load[275]: Module 'loop' is built in client # [ 10.219808] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 10.243939] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 10.227931] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 10.280704] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 10.231956] systemd[1]: Reached target First Boot Complete. client # [ 10.236309] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 10.323551] fuse: init (API version 7.45) worker1 # [ 10.308337] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 10.258931] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 10.266777] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 10.314995] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 10.370784] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 10.381072] systemd[1]: Finished Load Kernel Module fuse. lb # [ 10.381204] systemd-udevd[309]: Using default interface naming scheme 'v261'. worker1 # [ 10.401082] systemd-oomd[276]: No swap; memory pressure usage will be degraded lb # [ 10.394943] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 10.380294] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 10.385597] systemd[1]: Starting Update is Completed... client # [ 10.381051] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 10.383793] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 10.417100] systemd[1]: Mounting FUSE Control File System... client # [ 10.394179] systemd[1]: Mounting /run/wrappers... worker1 # [ 10.449698] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 10.401109] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 10.477499] systemd-journald[274]: Received client request to flush runtime journal. worker2 # [ 10.457690] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 10.491355] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 10.484619] systemd-udevd[310]: Using default interface naming scheme 'v261'. worker2 # [ 10.502924] systemd[1]: Finished Update is Completed. client # [ 10.489296] systemd[1]: Mounted /run/wrappers. lb # [ 10.521911] systemd[1]: Finished Rebuild Journal Catalog. client # [ 10.492712] systemd[1]: Reached target Local File Systems. client # [ 10.497212] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 10.536189] systemd[1]: Starting Update is Completed... client # [ 10.504729] systemd[1]: Starting register-nix-paths.service... worker1 # [ 10.555419] systemd[1]: Mounted FUSE Control File System. client # [ 10.516203] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 10.567742] systemd[1]: Finished Load/Save OS Random Seed. client # [ 10.524368] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 10.571587] systemd[1]: Reached target First Boot Complete. worker1 # [ 10.580107] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 10.591449] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 10.547624] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 10.598473] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 10.599841] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 10.551822] systemd-udevd[307]: Using default interface naming scheme 'v261'. client # [ 10.583962] systemd[1]: Starting Create System Files and Directories... lb # [ 10.648387] systemd[1]: Finished Update is Completed. worker1 # [ 10.688884] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 10.690147] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 10.693736] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 10.705490] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 10.751785] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 10.804166] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 10.845612] systemd-udevd[315]: Using default interface naming scheme 'v261'. client # [ 10.802782] systemd[1]: Finished Create System Files and Directories. client # [ 10.814929] systemd[1]: Starting Rebuild Journal Catalog... client # [ 10.839631] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 10.891679] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 10.979200] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 11.022041] systemd[1]: Finished Rebuild Journal Catalog. client # [ 11.031570] systemd[1]: Starting Update is Completed... worker1 # [ 11.100212] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 11.113896] systemd[1]: Finished Update is Completed. worker2 # [ 11.189411] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 11.194653] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 11.228759] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 11.341803] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 11.349082] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 11.394442] systemd[1]: Mounting /run/wrappers... worker1 # [ 11.461849] systemd[1]: Mounted /run/wrappers. worker1 # [ 11.468478] systemd[1]: Reached target Local File Systems. worker1 # [ 11.469623] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 11.480149] systemd[1]: Starting register-nix-paths.service... worker1 # [ 11.484541] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 11.494332] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 11.510537] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 11.516242] systemd[1]: Starting Create System Files and Directories... worker1 # [ 11.646011] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 11.654423] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 11.695261] systemd[1]: Finished Coldplug All udev Devices. lb # [ 11.766968] systemd[1]: Finished register-nix-paths.service. worker1 # [ 11.783346] systemd[1]: Finished Create System Files and Directories. lb # [ 11.770069] systemd[1]: Reached target System Initialization. lb # [ 11.775024] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 11.792328] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 11.779697] systemd[1]: Started niks3 garbage collection timer. worker1 # [ 11.798265] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 11.782984] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 11.789166] systemd[1]: Reached target Timer Units. lb # [ 11.789978] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 11.790893] systemd[1]: Listening on niks3 server socket. lb # [ 11.791674] systemd[1]: Listening on Nix Daemon Socket. lb # [ 11.801840] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 11.806281] systemd[1]: Reached target Socket Units. client # [ 11.779339] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 11.811103] systemd[1]: Reached target Basic System. lb # [ 11.817840] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 11.786129] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 11.827788] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.841208] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.850068] systemd[1]: Finished Coldplug All udev Devices. lb # [ 11.878074] systemd[1]: Started Reset console on configuration changes. lb # [ 11.904111] systemd[1]: Starting resolvconf update... client # [ 11.881825] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 11.954200] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 11.926015] systemd[1]: Finished Firewall. lb # [ 11.950598] systemd[1]: Started rustfs.service. client # [ 11.953487] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 11.993513] systemd[1]: Starting rustfs-bucket.service... worker1 # [ 12.047713] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 12.053161] systemd[1]: Starting Update is Completed... lb # [ 12.055556] nsncd[468]: Sep 20 08:05:47.470 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 12.072648] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 12.080390] systemd[1]: Finished Post-Boot Actions. lb # [ 12.125442] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 12.131754] systemd[1]: Reached target User and Group Name Lookups. lb # [ 12.145315] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 12.179348] systemd[1]: Finished Update is Completed. client # [ 12.159968] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 12.195310] systemd[1]: Starting User Login Management... lb # [ 12.206545] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 12.224140] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 12.427849] systemd[1]: Finished register-nix-paths.service. worker2 # [ 12.430898] systemd[1]: Reached target System Initialization. worker2 # [ 12.433088] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 12.435650] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 12.439528] systemd[1]: Reached target Timer Units. worker2 # [ 12.444544] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 12.446941] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 12.452734] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 12.456370] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 12.466829] systemd[1]: Reached target Socket Units. worker2 # [ 12.473595] systemd[1]: Reached target Basic System. worker2 # [ 12.483817] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 12.487366] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 12.493820] systemd[1]: Starting Post-Boot Actions... lb # [ 12.525894] dbus-broker-launch[502]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 12.512831] systemd[1]: Started Reset console on configuration changes. worker2 # [ 12.522233] systemd[1]: Starting resolvconf update... lb # [ 12.539352] dbus-broker-launch[502]: NSS returned no entry for 'systemd-timesync' worker2 # [ 12.533598] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 12.570151] systemd[1]: Finished Coldplug All udev Devices. lb # [ 12.550192] dbus-broker-launch[502]: Invalid user-name in /nix/store/r3k08synkldj3yxnxmc97ljig0y68d44-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 12.571921] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 12.581185] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 12.594150] systemd[1]: Stopped target User and Group Name Lookups. client # [ 12.574434] (udev-worker)[366]: Network interface NamePolicy= disabled on kernel command line. lb # [ 12.608501] systemd[1]: Stopping User and Group Name Lookups... lb # [ 12.617382] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 12.579607] (udev-worker)[371]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 12.588205] (udev-worker)[371]: Network interface NamePolicy= disabled on kernel command line. lb # [ 12.630404] systemd-logind[509]: New seat seat0. worker2 # [ 12.613994] systemd[1]: Finished Post-Boot Actions. lb # [ 12.641134] systemd[1]: nscd.service: Deactivated successfully. lb # [ 12.646420] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 12.656561] systemd[1]: Started D-Bus System Message Bus. lb # [ 12.664477] systemd[1]: Started User Login Management. lb # [ 12.683643] systemd[1]: Starting linger-users.service... client # [ 12.653767] systemd[1]: Finished register-nix-paths.service. client # [ 12.656920] systemd[1]: Reached target System Initialization. client # [ 12.660535] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 12.663009] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 12.698389] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 12.665902] systemd[1]: Reached target Timer Units. client # [ 12.669656] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 12.684268] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 12.685721] nsncd[488]: Sep 20 08:05:48.094 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 12.722668] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 12.673550] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 12.687832] systemd[1]: Reached target Host and Network Name Lookups. client # [ 12.676189] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 12.680454] systemd[1]: Reached target Socket Units. lb # [ 12.714970] dbus-broker-launch[502]: Ready client # [ 12.685199] systemd[1]: Reached target Basic System. lb # [ 12.721737] systemd[1]: Finished Firewall. client # [ 12.689232] systemd[1]: Started backdoor.service. client # [ 12.690567] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 12.709296] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 12.717939] systemd[1]: Starting User Login Management... client # [ 12.707973] systemd[1]: Starting nftables firewall... worker2 # [ 12.724277] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 12.731729] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 12.815659] systemd[1]: Finished Firewall. client # [ 12.768666] systemd[1]: Starting Post-Boot Actions... worker1 # [ 12.823658] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 12.827035] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 12.808660] dbus-broker-launch[492]: Looking up NSS user entry for 'systemd-timesync'... client # [ 12.803243] systemd[1]: Started Reset console on configuration changes. worker2 # [ 12.833800] dbus-broker-launch[492]: NSS returned no entry for 'systemd-timesync' lb # [ 12.866640] systemd[1]: Finished resolvconf update. worker2 # [ 12.837921] dbus-broker-launch[492]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 12.874574] systemd[1]: Reached target Preparation for Network. lb # [ 12.886106] systemd[1]: Starting DHCP Client... client # [ 12.853268] systemd[1]: Starting resolvconf update... lb # [ 12.895214] nsncd[576]: Sep 20 08:05:48.310 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # connecting to host... worker2 # [ 12.891580] systemd[1]: Started D-Bus System Message Bus. lb # [ 12.913958] systemd[1]: Starting Extra networking commands.... lb # [ 12.924926] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 12.929083] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 12.935874] systemd[1]: Finished linger-users.service. worker2 # [ 12.916355] systemd-logind[509]: New seat seat0. worker2 # [ 12.925177] systemd[1]: Started User Login Management. worker2 # [ 12.929148] systemd[1]: Starting linger-users.service... lb # [ 12.962131] systemd[1]: Reached target Host and Network Name Lookups. client: Guest shell says: b'Spawning backdoor root shell...\n' lb # [ 12.967324] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 12.987408] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 12.968110] dbus-broker-launch[492]: Ready client # [ 12.939355] nsncd[399]: Sep 20 08:05:48.356 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 12.971104] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 12.953248] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 12.982765] systemd[1]: Stopping Host and Network Name Lookups... client # [ 12.961267] systemd[1]: Finished Post-Boot Actions. worker1 # [ 13.058878] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. client # [ 13.003094] systemd[1]: Reached target Host and Network Name Lookups. client: connected to guest root shell worker2 # [ 12.987731] systemd[1]: Stopped target User and Group Name Lookups. client # [ 13.011385] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 12.994627] systemd[1]: Stopping User and Group Name Lookups... client # [ 13.019853] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 13.005076] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 13.010781] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 13.020568] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 13.025594] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 13.066145] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 13.070460] systemd[1]: Finished linger-users.service. client: (connecting took 13.55 seconds) client # [ 13.055785] systemd[1]: Starting User Login Management... client: (finished: waiting for the VM to finish booting, in 13.55 seconds) client # [ 13.065935] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 13.119119] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker2 # [ 13.117571] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 13.122652] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 13.127236] nsncd[557]: Sep 20 08:05:48.536 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 13.133880] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 13.176475] systemd[1]: Finished resolvconf update. worker2 # [ 13.179669] systemd[1]: Reached target Preparation for Network. worker2 # [ 13.184777] systemd[1]: Starting DHCP Client... worker2 # [ 13.190634] systemd[1]: Starting Extra networking commands.... client # [ 13.223957] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 13.268604] dhcpcd[610]: dhcpcd-10.3.2 starting lb # [ 13.291021] dhcpcd[644]: dev: loaded udev lb # [ 13.302444] dhcpcd[644]: no valid interfaces found lb # [ 13.305151] dhcpcd[644]: no valid interfaces found worker1 # [ 13.332796] (udev-worker)[346]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 13.344626] (udev-worker)[346]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 13.349651] (udev-worker)[349]: Network interface NamePolicy= disabled on kernel command line. client # [ 13.325434] dbus-broker-launch[429]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 13.377545] systemd[1]: Finished Extra networking commands.. lb # [ 13.381240] systemd[1]: Reached target Network. client # [ 13.359316] dbus-broker-launch[429]: NSS returned no entry for 'systemd-timesync' lb # [ 13.394736] systemd[1]: Starting PostgreSQL Server... lb # [ 13.400620] systemd[1]: Starting Permit User Sessions... client # [ 13.367269] dbus-broker-launch[429]: Invalid user-name in /nix/store/i87y3v12qnxz4jgnndbs0w0ih92vmmjw-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 13.387142] systemd-logind[431]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 13.402929] systemd-logind[431]: New seat seat0. client # [ 13.410050] systemd[1]: Started User Login Management. client # [ 13.421135] systemd[1]: Starting linger-users.service... lb # [ 13.481105] systemd[1]: Finished Permit User Sessions. client # [ 13.449062] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 13.463688] dhcpcd[591]: dhcpcd-10.3.2 starting lb # [ 13.497549] systemd[1]: Started Getty on tty1. client # [ 13.477211] mousedev: PS/2 mouse device common for all mice worker2 # [ 13.481476] dhcpcd[628]: dev: loaded udev lb # [ 13.501472] systemd[1]: Reached target Login Prompts. worker2 # [ 13.490916] dhcpcd[628]: no valid interfaces found worker2 # [ 13.496295] dhcpcd[628]: no valid interfaces found client # [ 13.510113] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 13.517939] systemd[1]: Stopping Host and Network Name Lookups... client # [ 13.518958] systemd[1]: Stopped target User and Group Name Lookups. client # [ 13.519832] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 13.543857] systemd[1]: Finished Extra networking commands.. worker2 # [ 13.545254] systemd[1]: Reached target Network. worker2 # [ 13.548408] systemd[1]: Starting Permit User Sessions... client # [ 13.535081] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 13.543886] dbus-broker-launch[429]: Ready client # [ 13.550530] systemd[1]: nscd.service: Deactivated successfully. client # [ 13.556568] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 13.574925] systemd[1]: linger-users.service: Deactivated successfully. client # [ 13.580276] systemd[1]: Finished linger-users.service. worker1 # [ 13.631723] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 13.604164] systemd[1]: Finished Permit User Sessions. worker1 # [ 13.641465] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 13.609875] systemd[1]: Started Getty on tty1. worker1 # [ 13.646835] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 13.612885] systemd[1]: Reached target Login Prompts. client # [ 13.598707] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 13.657606] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 13.662869] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 13.668455] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 13.672866] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 13.677793] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 13.722237] mousedev: PS/2 mouse device common for all mice client # [ 13.655621] systemd-logind[431]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 13.695861] nsncd[500]: Sep 20 08:05:49.112 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 13.705852] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 13.710978] systemd[1]: Reached target Host and Network Name Lookups. client # [ 13.717908] systemd[1]: Reached target User and Group Name Lookups. client # [ 13.733030] systemd[1]: Finished resolvconf update. client # [ 13.750412] systemd[1]: Starting DHCP Client... lb # [ 13.820641] postgresql-pre-start[684]: The files belonging to this database system will be owned by user "postgres". lb # [ 13.823891] postgresql-pre-start[684]: This user must also own the server process. lb # [ 13.838913] postgresql-pre-start[684]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 13.843250] postgresql-pre-start[684]: The default database encoding has accordingly been set to "UTF8". lb # [ 13.848438] postgresql-pre-start[684]: The default text search configuration will be set to "english". worker1 # [ 13.865489] systemd[1]: Finished register-nix-paths.service. lb # [ 13.851578] postgresql-pre-start[684]: Data page checksums are enabled. lb # [ 13.854837] postgresql-pre-start[684]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 13.860944] postgresql-pre-start[684]: creating subdirectories ... ok lb # [ 13.866186] postgresql-pre-start[684]: selecting dynamic shared memory implementation ... posix worker2 # [ 13.894819] systemd[1]: Starting Virtual Console Setup... worker2 # [ 13.922074] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 13.926388] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 13.930678] systemd[1]: Starting Virtual Console Setup... worker2 # [ 13.944852] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 14.007180] dhcpcd[542]: dhcpcd-10.3.2 starting lb # [ 14.055972] postgresql-pre-start[684]: selecting default "max_connections" ... 100 client # [ 14.031266] dhcpcd[551]: dev: loaded udev client # [ 14.096512] 8021q: 802.1Q VLAN Support v1.8 client # [ 14.114673] systemd[1]: Finished nftables firewall. client # [ 14.124464] systemd[1]: Reached target Preparation for Network. client # [ 14.132863] systemd[1]: Starting Address configuration of eth1... worker2 # [ 14.158677] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 14.153226] systemd[1]: Starting Extra networking commands.... worker2 # [ 14.216290] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 14.223084] systemd[1]: Started backdoor.service. lb # [ 14.260995] postgresql-pre-start[684]: selecting default "shared_buffers" ... 128MB client # [ 14.265974] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 14.330313] 8021q: 802.1Q VLAN Support v1.8 client # [ 14.318513] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 14.319039] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 14.366265] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 14.330866] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 14.331306] cfg80211: failed to load regulatory.db client # [ 14.351990] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # connecting to host... client # [ 14.377395] network-addresses-eth1-start[558]: adding address 192.168.1.1/24... done client # [ 14.407784] network-addresses-eth1-start[558]: adding address 2001:db8:1::1/64... done worker2 # [ 14.434338] (udev-worker)[651]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.[ 14.458372] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # worker2 # [ 14.458842] (udev-worker)[651]: Network interface NamePolicy= disabled on kernel command line. client # [ 14.448920] dhcpcd[585]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (561) - Operation not permitted client # [ 14.450888] dhcpcd[585]: .resolvconf-wrapped: clearing stale lock pid 561 worker1 # [ 14.508727] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 14.510595] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 14.512492] systemd[1]: Reached target System Initialization. client # [ 14.462337] systemd[1]: Finished Address configuration of eth1. worker1 # [ 14.516333] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 14.521336] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 14.503766] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 14.506379] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 14.528290] systemd[1]: Reached target Timer Units. worker2 # [ 14.512066] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 14.512613] cfg80211: failed to load regulatory.db worker1 # [ 14.536290] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 14.502707] (udev-worker)[647]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 14.548377] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 14.552311] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 14.558872] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 14.576938] systemd[1]: Reached target Socket Units. worker1 # [ 14.579108] systemd[1]: Reached target Basic System. client # [ 14.545154] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 14.533060] dhcpcd[551]: eth0: waiting for carrier client # [ 14.538516] dhcpcd[551]: libudev: received NULL device client # [ 14.539569] dhcpcd[551]: libudev: received NULL device worker1 # [ 14.590379] systemd[1]: Started backdoor.service. client # [ 14.547351] dhcpcd[551]: eth0: carrier acquired worker1 # [ 14.604588] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 14.617849] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 14.568463] dhcpcd[551]: DUID 00:01:00:01:32:42:50:5d:52:54:00:12:34:56 client # [ 14.573828] dhcpcd[551]: eth0: IAID 00:12:34:56 client # [ 14.575618] dhcpcd[551]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 14.615088] rustfs-bucket-start[702]: mb s3://farm worker1 # [ 14.627818] systemd[1]: Starting Post-Boot Actions... worker1 # [ 14.648447] systemd[1]: Started Reset console on configuration changes. lb # [ 14.632657] systemd[1]: Finished rustfs-bucket.service. client # [ 14.603150] systemd[1]: Finished Extra networking commands.. client # [ 14.608170] systemd[1]: Reached target Network. worker1 # [ 14.658746] systemd[1]: Starting resolvconf update... client # [ 14.613336] systemd[1]: Starting Permit User Sessions... worker1 # [ 14.669513] systemd[1]: Starting D-Bus System Message Bus... client: (finished: waiting for unit network-addresses-eth1.service, in 15.15 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client # [ 14.694500] systemd[1]: Finished Permit User Sessions. worker2 # [ 14.712428] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 14.720935] systemd[1]: Starting Address configuration of eth1... client # [ 14.707078] systemd[1]: Started Getty on tty1. worker1 # [ 14.761265] systemd[1]: Finished Post-Boot Actions. client # [ 14.711427] systemd[1]: Reached target Login Prompts. worker2 # [ 14.733788] systemd-vconsole-setup[659]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 14.743847] systemd[1]: Finished Virtual Console Setup. client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.09 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting worker1 # connecting to host... worker1 # [ 14.815772] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 14.827425] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 14.840324] nsncd[570]: Sep 20 08:05:50.234 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 14.854077] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 14.861955] systemd[1]: Starting User Login Management... worker1 # [ 14.881049] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 14.883434] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 14.898426] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 14.886236] dhcpcd[628]: eth0: waiting for carrier worker2 # [ 14.887613] dhcpcd[628]: eth0: carrier acquired worker2 # [ 14.907693] network-addresses-eth1-start[677]: adding address 192.168.1.4/24... done worker2 # [ 14.913749] dhcpcd[628]: DUID 00:01:00:01:32:42:50:5e:52:54:00:12:34:56 worker2 # [ 14.916718] dhcpcd[628]: eth0: IAID 00:12:34:56 worker1 # [ 14.952888] dbus-broker-launch[574]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 14.918365] dhcpcd[628]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 14.930830] network-addresses-eth1-start[677]: adding address 2001:db8:1::4/64... done worker1 # [ 14.975171] dbus-broker-launch[574]: NSS returned no entry for 'systemd-timesync' worker1 # [ 14.983345] dbus-broker-launch[574]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 14.957461] systemd-logind[509]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 14.961725] systemd[1]: Finished Address configuration of eth1. lb # [ 15.002098] systemd[1]: Starting Virtual Console Setup... worker1 # [ 15.030458] systemd[1]: Started D-Bus System Message Bus. lb # [ 15.038679] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 15.044979] systemd[1]: Stopped Virtual Console Setup. lb # [ 15.050204] systemd[1]: Starting Virtual Console Setup... lb # [ 15.063331] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 15.090021] dbus-broker-launch[574]: Ready worker1 # [ 15.096152] systemd-logind[589]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 15.105833] systemd-logind[589]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 15.107133] systemd-logind[589]: New seat seat0. worker1 # [ 15.107812] systemd[1]: Started User Login Management. worker1 # [ 15.117639] systemd[1]: Starting linger-users.service... worker1 # [ 15.135753] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 15.137986] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 15.138940] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 15.139883] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 15.146296] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 15.151429] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 15.134323] mousedev: PS/2 mouse device common for all mice worker1 # [ 15.160425] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 15.181964] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 15.198136] systemd-logind[509]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 15.256991] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 15.258156] systemd[1]: Finished linger-users.service. worker1 # [ 15.309010] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 15.310910] nsncd[643]: Sep 20 08:05:50.722 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 15.320379] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 15.323756] systemd[1]: Reached target User and Group Name Lookups. client # [ 15.294606] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker1 # [ 15.375801] systemd[1]: Finished resolvconf update. worker1 # [ 15.381470] systemd[1]: Reached target Preparation for Network. worker1 # [ 15.384350] systemd[1]: Starting DHCP Client... worker1 # [ 15.390039] systemd[1]: Starting Address configuration of eth1... worker1 # [ 15.398908] systemd[1]: Starting Extra networking commands.... lb # [ 15.399216] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 15.519282] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 15.527415] systemd[1]: Started backdoor.service. client # [ 15.508254] dhcpcd[551]: eth0: soliciting a DHCP lease client # [ 15.517120] dhcpcd[551]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 15.524476] dhcpcd[551]: eth0: probing address 10.0.2.15/24 worker1 # [ 15.608714] network-addresses-eth1-start[670]: adding address 192.168.1.3/24... done lb # [ 15.617915] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 15.641114] network-addresses-eth1-start[670]: adding address 2001:db8:1::3/64... done client # [ 15.611140] systemd[1]: Starting Virtual Console Setup... lb # [ 15.657357] systemd-vconsole-setup[715]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 15.669642] systemd[1]: Finished Virtual Console Setup. worker1 # [ 15.692646] systemd[1]: Finished Address configuration of eth1. lb # connecting to host... lb # [ 15.690299] (udev-worker)[685]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 15.658540] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 15.672662] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 15.673894] systemd[1]: Stopped Virtual Console Setup. lb # [ 15.716208] (udev-worker)[685]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 15.733491] dhcpcd[677]: dhcpcd-10.3.2 starting client # [ 15.690714] systemd[1]: Starting Virtual Console Setup... lb # [ 15.731040] (udev-worker)[673]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 15.755535] dhcpcd[718]: dev: loaded udev lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.97 seconds) lb: (finished: waiting for the VM to finish booting, in 0.97 seconds) client # [ 15.723272] systemd-logind[431]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 15.803842] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 15.823944] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 15.824383] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 15.842467] systemd[1]: Finished Extra networking commands.. lb # [ 15.848969] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 15.849512] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 15.847810] systemd[1]: Reached target Network. worker1 # [ 15.851944] systemd[1]: Starting Permit User Sessions... lb # [ 15.855463] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 15.855922] cfg80211: failed to load regulatory.db worker1 # [ 15.930973] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 15.974820] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 15.975434] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 15.983272] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 15.983683] cfg80211: failed to load regulatory.db worker1 # [ 15.968880] systemd[1]: Finished Permit User Sessions. worker1 # [ 15.973599] systemd[1]: Started Getty on tty1. worker1 # [ 15.980191] systemd[1]: Reached target Login Prompts. lb # [ 16.059303] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 16.069321] systemd[1]: Starting Address configuration of eth1... worker1 # [ 16.115312] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 16.100280] dhcpcd[718]: eth0: waiting for carrier worker1 # [ 16.103558] dhcpcd[718]: libudev: received NULL device worker1 # [ 16.106212] dhcpcd[718]: libudev: received NULL device worker1 # [ 16.107186] dhcpcd[718]: eth0: carrier acquired worker1 # [ 16.126923] dhcpcd[718]: DUID 00:01:00:01:32:42:50:5f:52:54:00:12:34:56 worker1 # [ 16.130271] dhcpcd[718]: eth0: IAID 00:12:34:56 worker1 # [ 16.131152] dhcpcd[718]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 16.234870] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 16.254425] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 16.240629] dhcpcd[644]: eth0: waiting for carrier lb # [ 16.243893] dhcpcd[644]: eth0: carrier acquired lb # [ 16.252475] network-addresses-eth1-start[743]: adding address 192.168.1.2/24... done client # [ 16.229422] systemd-vconsole-setup[649]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 16.234259] systemd[1]: Finished Virtual Console Setup. lb # [ 16.268764] dhcpcd[644]: DUID 00:01:00:01:32:42:50:5f:52:54:00:12:34:56 lb # [ 16.272183] dhcpcd[644]: eth0: IAID 00:12:34:56 lb # [ 16.272929] dhcpcd[644]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 16.253007] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 16.279636] network-addresses-eth1-start[743]: adding address 2001:db8:1::2/64... done worker2 # [ 16.272509] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 16.273740] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 16.274430] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 16.283706] systemd[1]: Starting Virtual Console Setup... lb # [ 16.308796] systemd[1]: Finished Address configuration of eth1. worker1 # [ 16.351363] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker2 # [ 16.314723] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 16.315939] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 16.319741] systemd[1]: Starting Virtual Console Setup... lb # [ 16.358719] systemd-logind[509]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 16.351234] systemd-logind[509]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 16.452404] dhcpcd[551]: eth0: soliciting an IPv6 router client # [ 16.456841] dhcpcd[551]: eth0: Router Advertisement from fe80::2 client # [ 16.459854] dhcpcd[551]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 16.463817] dhcpcd[551]: eth0: adding route to fec0::/64 client # [ 16.466772] dhcpcd[551]: eth0: adding default route via fe80::2 lb # [ 16.667003] mousedev: PS/2 mouse device common for all mice worker1 # [ 16.718245] systemd[1]: Starting Virtual Console Setup... worker1 # [ 16.751359] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 16.757486] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 16.758354] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 16.723907] systemd-vconsole-setup[702]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 16.727943] systemd[1]: Finished Virtual Console Setup. worker1 # [ 16.763153] systemd[1]: Starting Virtual Console Setup... lb # [ 16.764399] systemd-logind[509]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 16.816113] systemd-logind[589]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 16.827446] dhcpcd[628]: eth0: soliciting a DHCP lease worker2 # [ 16.830249] dhcpcd[628]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 16.836674] dhcpcd[628]: eth0: probing address 10.0.2.15/24 worker2 # [ 17.004320] dhcpcd[628]: eth0: soliciting an IPv6 router worker2 # [ 17.007224] dhcpcd[628]: eth0: Router Advertisement from fe80::2 worker2 # [ 17.008961] dhcpcd[628]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 17.010086] dhcpcd[628]: eth0: adding route to fec0::/64 worker2 # [ 17.011000] dhcpcd[628]: eth0: adding default route via fe80::2 lb: (finished: waiting for unit network-addresses-eth1.service, in 2.28 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.07 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1 # [ 17.255480] systemd-vconsole-setup[758]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 17.262575] systemd[1]: Finished Virtual Console Setup. worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.04 seconds) lb: waiting for unit niks3.service worker1 # [ 17.483389] dhcpcd[718]: eth0: soliciting a DHCP lease worker1 # [ 17.487193] dhcpcd[718]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 17.492615] dhcpcd[718]: eth0: probing address 10.0.2.15/24 lb # [ 17.744629] postgresql-pre-start[684]: selecting default time zone ... UTC lb # [ 17.750280] postgresql-pre-start[684]: creating configuration files ... ok lb # [ 17.975360] dhcpcd[644]: eth0: soliciting a DHCP lease lb # [ 17.978554] dhcpcd[644]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 17.984408] dhcpcd[644]: eth0: probing address 10.0.2.15/24 worker1 # [ 18.122009] dhcpcd[718]: eth0: soliciting an IPv6 router worker1 # [ 18.125806] dhcpcd[718]: eth0: Router Advertisement from fe80::2 worker1 # [ 18.128949] dhcpcd[718]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 18.131908] dhcpcd[718]: eth0: adding route to fec0::/64 worker1 # [ 18.134282] dhcpcd[718]: eth0: adding default route via fe80::2 lb # [ 18.218806] dhcpcd[644]: eth0: soliciting an IPv6 router lb # [ 18.221321] dhcpcd[644]: eth0: Router Advertisement from fe80::2 lb # [ 18.222346] dhcpcd[644]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 18.223311] dhcpcd[644]: eth0: adding route to fec0::/64 lb # [ 18.230540] dhcpcd[644]: eth0: adding default route via fe80::2 lb # [ 18.360174] postgresql-pre-start[684]: running bootstrap script ... ok lb # [ 19.361907] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 19.373349] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 19.374514] systemd[1]: Stopped Virtual Console Setup. lb # [ 19.375272] systemd[1]: Stopping Virtual Console Setup... lb # [ 19.387630] systemd[1]: Starting Virtual Console Setup... lb # [ 19.445187] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 19.446405] systemd[1]: Stopped Virtual Console Setup. lb # [ 19.459748] systemd[1]: Starting Virtual Console Setup... lb # [ 19.723351] systemd-logind[509]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 19.944418] systemd-vconsole-setup[809]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 19.955629] systemd[1]: Finished Virtual Console Setup. lb # [ 20.003135] postgresql-pre-start[684]: performing post-bootstrap initialization ... ok lb # [ 20.160349] postgresql-pre-start[684]: syncing data to disk ... ok lb # [ 20.162750] postgresql-pre-start[684]: initdb: warning: enabling "trust" authentication for local connections lb # [ 20.164435] postgresql-pre-start[684]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 20.166672] postgresql-pre-start[684]: Success. You can now start the database server using: lb # [ 20.167882] postgresql-pre-start[684]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 20.308642] postgres[834]: [834] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 20.313714] postgres[834]: [834] LOG: listening on IPv6 address "::1", port 5432 lb # [ 20.315266] postgres[834]: [834] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 20.318559] postgres[834]: [834] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 20.340675] postgres[843]: [843] LOG: database system was shut down at 2026-09-20 08:05:55 GMT lb # [ 20.349141] postgres[834]: [834] LOG: database system is ready to accept connections lb # [ 20.354192] systemd[1]: Started PostgreSQL Server. lb # [ 20.370815] systemd[1]: Starting niks3 server... lb # [ 20.374160] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 20.713760] postgres[861]: [861] FATAL: role "niks3" does not exist lb # [ 20.729644] postgres[862]: [862] FATAL: role "niks3" does not exist lb # [ 20.736541] niks3-server[847]: 2026/09/20 08:05:56 ERROR Failed to run server error="failed to connect to database: failed to migrate db: failed to connect to `user=niks3 database=niks3`: /var/run/postgresql/.s.PGSQL.5432 (/var/run/postgresql): server error: FATAL: role \"niks3\" does not exist (SQLSTATE 28000); failed to connect to `user=niks3 database=niks3`: /var/run/postgresql/.s.PGSQL.5432 (/var/run/postgresql): server error: FATAL: role \"niks3\" does not exist (SQLSTATE 28000)" lb # [ 20.756300] systemd[1]: niks3.service: Main process exited, code=exited, status=1/FAILURE lb # [ 20.757627] systemd[1]: niks3.service: Failed with result 'exit-code'. lb # [ 20.759111] systemd[1]: Failed to start niks3 server. lb # [ 20.784819] postgresql-setup-start[859]: CREATE DATABASE lb # [ 20.854004] postgresql-setup-start[869]: CREATE ROLE lb # [ 20.884357] postgresql-setup-start[871]: ALTER DATABASE lb # [ 20.892726] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 20.895150] systemd[1]: Reached target PostgreSQL. client # [ 20.901043] dhcpcd[551]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 20.904845] dhcpcd[551]: eth0: adding route to 10.0.2.0/24 client # [ 20.905081] dhcpcd[551]: eth0: adding default route via 10.0.2.2 client # [ 21.081709] systemd[1]: Started DHCP Client. client # [ 21.086824] systemd[1]: Reached target Multi-User System. client # [ 21.087758] systemd[1]: Startup finished in 1.163s (kernel) + 5.878s (initrd) + 14.043s (userspace) = 21.086s. worker2 # [ 21.270372] dhcpcd[628]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 21.273764] dhcpcd[628]: eth0: adding route to 10.0.2.0/24 worker2 # [ 21.279325] dhcpcd[628]: eth0: adding default route via 10.0.2.2 worker2 # [ 21.441438] systemd[1]: Started DHCP Client. worker2 # [ 21.443904] systemd[1]: Reached target Multi-User System. worker2 # [ 21.445509] systemd[1]: Startup finished in 1.166s (kernel) + 5.046s (initrd) + 15.230s (userspace) = 21.443s. lb # [ 22.459212] dhcpcd[644]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 22.459617] dhcpcd[644]: eth0: adding route to 10.0.2.0/24 lb # [ 22.459760] dhcpcd[644]: eth0: adding default route via 10.0.2.2 worker1 # [ 22.552705] dhcpcd[718]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 22.555415] dhcpcd[718]: eth0: adding route to 10.0.2.0/24 worker1 # [ 22.559589] dhcpcd[718]: eth0: adding default route via 10.0.2.2 lb # [ 22.703262] systemd[1]: Started DHCP Client. lb # [ 22.707064] systemd[1]: Reached target Network is Online. lb # [ 22.713616] systemd[1]: Started Envoy reverse proxy. lb # [ 22.720866] systemd[1]: Started mock-oidc.service. worker1 # [ 22.737415] systemd[1]: Started DHCP Client. worker1 # [ 22.739443] systemd[1]: Reached target Multi-User System. lb # [ 22.724558] systemd[1]: Reached target Multi-User System. worker1 # [ 22.741370] systemd[1]: Startup finished in 1.169s (kernel) + 5.810s (initrd) + 15.760s (userspace) = 22.740s. lb # [ 22.727740] systemd[1]: Startup finished in 1.166s (kernel) + 5.092s (initrd) + 16.467s (userspace) = 22.726s. lb # [ 22.844437] mock-oidc-server[939]: Mock OIDC Server running lb # [ 22.845656] mock-oidc-server[939]: OIDC Address: 192.168.1.2:8080 lb # [ 22.847038] mock-oidc-server[939]: Issue Address: 0.0.0.0:8081 lb # [ 22.849608] mock-oidc-server[939]: Issuer: http://192.168.1.2:8080/oidc lb # [ 22.851746] mock-oidc-server[939]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 22.854525] mock-oidc-server[939]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 22.857461] mock-oidc-server[939]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 23.526188] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 23.526350] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 23.526429] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 23.526463] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 23.526496] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 23.526540] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 23.526575] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 23.526641] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 23.565723] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 23.567632] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 23.576053] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 23.578166] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 23.581310] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 23.587416] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 23.590606] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 23.595814] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 23.599117] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 23.602788] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 23.607515] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 23.610196] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 23.613085] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 23.615079] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 23.621552] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 23.635931] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 23.638221] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 23.641183] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 23.644724] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 23.646935] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 23.649312] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 23.651465] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 23.653690] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 23.656685] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 23.658870] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 23.661307] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 23.663181] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 23.665429] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 23.671644] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 23.673640] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 23.676583] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 23.679969] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 23.682895] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 23.685131] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 23.688614] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 23.690776] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 23.693978] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 23.703692] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 23.708195] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 23.710380] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 23.716060] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 23.718909] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 23.722217] envoy[938]: [2026-09-20 08:05:58.942][938][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 23.724924] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 23.728479] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 23.731497] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 23.736725] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 23.738913] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 23.741333] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 23.745715] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 23.747848] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 23.751355] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 23.754667] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 23.758385] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 23.761268] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 23.764867] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 23.767963] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 23.770124] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 23.778169] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 23.779883] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 23.785366] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 23.787478] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 23.792851] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 23.798524] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 23.832339] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 23.834503] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 23.836576] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 23.838907] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 23.843027] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 23.845337] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 23.848386] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 23.850416] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 23.852717] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 23.855368] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 23.863978] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 23.871528] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 23.875022] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 23.877601] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 23.880108] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 23.882437] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 23.885911] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 23.888706] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 23.890963] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 23.893139] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 23.894960] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 23.897171] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 23.900988] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 23.908226] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 23.910553] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 23.917511] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 23.919531] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 23.922951] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 23.926314] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 23.928772] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 23.932046] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 23.939018] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 23.941396] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 23.943669] envoy[938]: [2026-09-20 08:05:58.943][938][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 23.947615] envoy[938]: [2026-09-20 08:05:58.993][938][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 23.949769] envoy[938]: [2026-09-20 08:05:59.016][938][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 23.966942] envoy[938]: [2026-09-20 08:05:59.016][938][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 23.969326] envoy[938]: [2026-09-20 08:05:59.016][938][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 23.979148] envoy[938]: [2026-09-20 08:05:59.016][938][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 23.981147] envoy[938]: [2026-09-20 08:05:59.315][938][info][main] [source/server/server.cc:968] runtime: {} lb # [ 23.982648] envoy[938]: [2026-09-20 08:05:59.343][938][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 23.984934] envoy[938]: [2026-09-20 08:05:59.343][938][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 23.986704] envoy[938]: [2026-09-20 08:05:59.343][938][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 23.988495] envoy[938]: [2026-09-20 08:05:59.358][938][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 23.990540] envoy[938]: [2026-09-20 08:05:59.358][938][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 23.992426] envoy[938]: [2026-09-20 08:05:59.358][938][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 24.026985] envoy[938]: [2026-09-20 08:05:59.443][938][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker1 # [ 24.049263] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 24.041155] envoy[938]: [2026-09-20 08:05:59.458][938][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker2 # [ 24.024947] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 24.043979] envoy[938]: [2026-09-20 08:05:59.461][938][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 24.047643] envoy[938]: [2026-09-20 08:05:59.461][938][info][main] [source/server/server.cc:1077] starting main dispatch loop worker1 # [ 24.300193] nix-grpc-daemon[832]: ts=2026-09-20T08:05:59Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 24.314077] nix-grpc-daemon[832]: ts=2026-09-20T08:05:59Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 24.298670] nix-grpc-daemon[776]: ts=2026-09-20T08:05:59Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 24.314093] nix-grpc-daemon[776]: ts=2026-09-20T08:05:59Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 24.365441] nix-grpc-daemon[832]: ts=2026-09-20T08:05:59Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 24.367382] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 24.366279] nix-grpc-daemon[776]: ts=2026-09-20T08:05:59Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 24.403039] nix-grpc-daemon[832]: ts=2026-09-20T08:05:59Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 24.387525] envoy[938]: [2026-09-20 08:05:59.804][938][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization worker2 # [ 24.373080] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 24.394477] envoy[938]: [2026-09-20 08:05:59.804][938][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 24.399256] envoy[938]: [2026-09-20 08:05:59.804][938][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 24.407080] envoy[938]: [2026-09-20 08:05:59.804][938][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 24.416869] nix-grpc-daemon[776]: ts=2026-09-20T08:05:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.444702] nix-grpc-daemon[776]: ts=2026-09-20T08:05:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 24.604078] nix-grpc-daemon[832]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 24.645931] nix-grpc-daemon[776]: ts=2026-09-20T08:06:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.666852] nix-grpc-daemon[776]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 24.867689] nix-grpc-daemon[776]: ts=2026-09-20T08:06:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.874407] nix-grpc-daemon[776]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 25.004982] nix-grpc-daemon[832]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 25.075385] nix-grpc-daemon[776]: ts=2026-09-20T08:06:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.079990] nix-grpc-daemon[776]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 25.281557] nix-grpc-daemon[776]: ts=2026-09-20T08:06:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.285438] nix-grpc-daemon[776]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 25.490393] nix-grpc-daemon[776]: ts=2026-09-20T08:06:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.496459] nix-grpc-daemon[776]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 25.696834] nix-grpc-daemon[776]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.701771] nix-grpc-daemon[776]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 25.807781] nix-grpc-daemon[832]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.903412] nix-grpc-daemon[776]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.909698] nix-grpc-daemon[776]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 25.814272] nix-grpc-daemon[832]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 26.018480] nix-grpc-daemon[832]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.030133] nix-grpc-daemon[832]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 26.111062] nix-grpc-daemon[776]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.117239] nix-grpc-daemon[776]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 26.230643] nix-grpc-daemon[832]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.234888] nix-grpc-daemon[832]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 26.318454] nix-grpc-daemon[776]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.324833] nix-grpc-daemon[776]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 26.436553] nix-grpc-daemon[832]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.441025] nix-grpc-daemon[832]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 26.526061] nix-grpc-daemon[776]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.528639] nix-grpc-daemon[776]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 26.642489] nix-grpc-daemon[832]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.648923] nix-grpc-daemon[832]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 26.729891] nix-grpc-daemon[776]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.735135] nix-grpc-daemon[776]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 26.851722] nix-grpc-daemon[832]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.857785] nix-grpc-daemon[832]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 26.935718] nix-grpc-daemon[776]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.938994] nix-grpc-daemon[776]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 27.059011] nix-grpc-daemon[832]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.065271] nix-grpc-daemon[832]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 27.140508] nix-grpc-daemon[776]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.146488] nix-grpc-daemon[776]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 27.266554] nix-grpc-daemon[832]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.274016] nix-grpc-daemon[832]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 27.347523] nix-grpc-daemon[776]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.353631] nix-grpc-daemon[776]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 27.474529] nix-grpc-daemon[832]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.478386] nix-grpc-daemon[832]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 27.556135] nix-grpc-daemon[776]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.562236] nix-grpc-daemon[776]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 27.679523] nix-grpc-daemon[832]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.683258] nix-grpc-daemon[832]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 27.763773] nix-grpc-daemon[776]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.769766] nix-grpc-daemon[776]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 27.884890] nix-grpc-daemon[832]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.887508] nix-grpc-daemon[832]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 27.970412] nix-grpc-daemon[776]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.973869] nix-grpc-daemon[776]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 28.089217] nix-grpc-daemon[832]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.096093] nix-grpc-daemon[832]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 28.175293] nix-grpc-daemon[776]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.181678] nix-grpc-daemon[776]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 28.296934] nix-grpc-daemon[832]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.301429] nix-grpc-daemon[832]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 28.382640] nix-grpc-daemon[776]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.389138] nix-grpc-daemon[776]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 28.502037] nix-grpc-daemon[832]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.505814] nix-grpc-daemon[832]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 28.591885] nix-grpc-daemon[776]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.597961] nix-grpc-daemon[776]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 28.707199] nix-grpc-daemon[832]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.713461] nix-grpc-daemon[832]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 28.798540] nix-grpc-daemon[776]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.802157] nix-grpc-daemon[776]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 28.915870] nix-grpc-daemon[832]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.921977] nix-grpc-daemon[832]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 29.003719] nix-grpc-daemon[776]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.009878] nix-grpc-daemon[776]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 29.123304] nix-grpc-daemon[832]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.130051] nix-grpc-daemon[832]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 29.210887] nix-grpc-daemon[776]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.217264] nix-grpc-daemon[776]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 29.330550] nix-grpc-daemon[832]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.335630] nix-grpc-daemon[832]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 29.417700] nix-grpc-daemon[776]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.424354] nix-grpc-daemon[776]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 29.537422] nix-grpc-daemon[832]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.542160] nix-grpc-daemon[832]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 29.627331] nix-grpc-daemon[776]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.633365] nix-grpc-daemon[776]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 29.743221] nix-grpc-daemon[832]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.747351] nix-grpc-daemon[832]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 29.834259] nix-grpc-daemon[776]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.840342] nix-grpc-daemon[776]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 29.950022] nix-grpc-daemon[832]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.955691] nix-grpc-daemon[832]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 30.041353] nix-grpc-daemon[776]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.047045] nix-grpc-daemon[776]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 30.156568] nix-grpc-daemon[832]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.161929] nix-grpc-daemon[832]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 30.248417] nix-grpc-daemon[776]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.255049] nix-grpc-daemon[776]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 30.362821] nix-grpc-daemon[832]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.368846] nix-grpc-daemon[832]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 30.455676] nix-grpc-daemon[776]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.461460] nix-grpc-daemon[776]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 30.570195] nix-grpc-daemon[832]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.576858] nix-grpc-daemon[832]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 30.664400] nix-grpc-daemon[776]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.670657] nix-grpc-daemon[776]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 30.778203] nix-grpc-daemon[832]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.785085] nix-grpc-daemon[832]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" lb # [ 30.827468] systemd[1]: niks3.service: Scheduled restart job, restart counter is at 1. lb # [ 30.848989] systemd[1]: Starting niks3 server... worker2 # [ 30.871900] nix-grpc-daemon[776]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.877868] nix-grpc-daemon[776]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" lb # [ 30.954899] postgres[993]: [993] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 30.960220] postgres[993]: [993] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC worker1 # [ 30.987103] nix-grpc-daemon[832]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.990427] nix-grpc-daemon[832]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" lb # [ 31.001224] niks3-server[988]: 2026/09/20 08:06:06 OK 20241026095416_initial_model.sql (28.3ms) lb # [ 31.006214] niks3-server[988]: 2026/09/20 08:06:06 OK 20251210153512_drop_unused_gin_index.sql (2.99ms) lb # [ 31.013261] niks3-server[988]: 2026/09/20 08:06:06 OK 20251218171726_add_pins.sql (6.98ms) lb # [ 31.020139] niks3-server[988]: 2026/09/20 08:06:06 OK 20260628120000_add_object_size_and_stats.sql (6.74ms) lb # [ 31.026486] niks3-server[988]: 2026/09/20 08:06:06 OK 20260905000000_add_claims.sql (6.34ms) lb # [ 31.033020] niks3-server[988]: 2026/09/20 08:06:06 OK 20260920000000_drop_claims.sql (6.38ms) lb # [ 31.034427] niks3-server[988]: 2026/09/20 08:06:06 goose: successfully migrated database to version: 20260920000000 lb # [ 31.040811] niks3-server[988]: 2026/09/20 08:06:06 OK 1_commit_pending_closure.sql (7.73ms) lb # [ 31.044502] niks3-server[988]: 2026/09/20 08:06:06 OK 2_object_stats_trigger.sql (3.33ms) lb # [ 31.047277] niks3-server[988]: 2026/09/20 08:06:06 goose: up to current file version: 2 lb # [ 31.051607] niks3-server[988]: 2026/09/20 08:06:06 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key worker2 # [ 31.078911] nix-grpc-daemon[776]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.084997] nix-grpc-daemon[776]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" lb # [ 31.115059] niks3-server[988]: 2026/09/20 08:06:06 INFO Read proxy enabled — serving cache objects from S3 lb # [ 31.117954] niks3-server[988]: 2026/09/20 08:06:06 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 31.122215] niks3-server[988]: 2026/09/20 08:06:06 INFO systemd watchdog enabled interval=15s lb # [ 31.125827] systemd[1]: Started niks3 server. lb # [ 31.126663] niks3-server[988]: 2026/09/20 08:06:06 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 31.132772] niks3-server[988]: 2026/09/20 08:06:06 INFO lead: acquired remote=192.168.1.4:52376 worker2 # [ 31.119824] nix-grpc-daemon[776]: ts=2026-09-20T08:06:06Z level=info event=scheduler_take_over worker1 # [ 31.191502] nix-grpc-daemon[832]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.159272] nix-grpc-daemon[776]: ts=2026-09-20T08:06:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 31.285771] nix-grpc-daemon[776]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.291504] nix-grpc-daemon[776]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 31.492766] nix-grpc-daemon[776]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.498759] nix-grpc-daemon[776]: ts=2026-09-20T08:06:06Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: waiting for unit niks3.service, in 14.55 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.06 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 32.101653] envoy[938]: conn peer=[::1]:43090 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy ??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 128 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.08 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.12 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.17 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 32.900736] nix-grpc-daemon[776]: ts=2026-09-20T08:06:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 32.909513] systemd[1]: Started Nix Daemon. worker2 # [ 33.322890] nix-daemon[838]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 33.364761] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 1/5) worker2 # [ 33.469631] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 142 ms (attempt 2/5) worker2 # [ 33.612040] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 188 ms (attempt 3/5) worker2 # [ 33.804231] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 220 ms (attempt 4/5) worker2 # [ 34.037837] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 34.113908] nix-grpc-daemon[832]: ts=2026-09-20T08:06:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 34.133394] systemd[1]: Started Nix Daemon. worker1 # [ 34.472623] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 34.506828] nix-grpc-daemon[832]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 1/5) worker1 # [ 34.580768] nix-grpc-daemon[832]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 2/5) worker1 # [ 34.631024] nix-grpc-daemon[832]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 303 ms (attempt 3/5) worker1 # [ 34.943435] nix-grpc-daemon[832]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 428 ms (attempt 4/5) worker1 # [ 35.385545] nix-grpc-daemon[832]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 35.396126] nix-grpc-daemon[832]: ts=2026-09-20T08:06:10Z level=debug event=path_info_miss path=7pfca4pninpmfbhvzygaqz91qmaivwdc-nixos-system-client-test error="error: path '/nix/store/7pfca4pninpmfbhvzygaqz91qmaivwdc-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 35.416245] nix-grpc-daemon[832]: ts=2026-09-20T08:06:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 35.431496] nix-grpc-daemon[832]: ts=2026-09-20T08:06:10Z level=debug event=path_info_miss path=7pfca4pninpmfbhvzygaqz91qmaivwdc-nixos-system-client-test error="error: path '/nix/store/7pfca4pninpmfbhvzygaqz91qmaivwdc-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.12 seconds) client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds) worker1 # [ 35.932258] nix-grpc-daemon[832]: ts=2026-09-20T08:06:11Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 35.934410] nix-grpc-daemon[832]: ts=2026-09-20T08:06:11Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:43254 worker1 # [ 35.950988] nix-grpc-daemon[832]: ts=2026-09-20T08:06:11Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:43254 worker1 # [ 35.959733] nix-grpc-daemon[832]: ts=2026-09-20T08:06:11Z level=debug event=path_info_miss path=7pfca4pninpmfbhvzygaqz91qmaivwdc-nixos-system-client-test error="error: path '/nix/store/7pfca4pninpmfbhvzygaqz91qmaivwdc-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 35.945490] nix-grpc-daemon[776]: ts=2026-09-20T08:06:11Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 35.952599] nix-grpc-daemon[776]: ts=2026-09-20T08:06:11Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:44092 worker2 # [ 35.967007] nix-grpc-daemon[776]: ts=2026-09-20T08:06:11Z level=debug event=path_info_miss path=7pfca4pninpmfbhvzygaqz91qmaivwdc-nixos-system-client-test error="error: path '/nix/store/7pfca4pninpmfbhvzygaqz91qmaivwdc-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds) worker2 # [ 36.310169] nix-grpc-daemon[776]: ts=2026-09-20T08:06:11Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 36.620867] nix-grpc-daemon[832]: ts=2026-09-20T08:06:12Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.11 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2 worker2 # [ 36.876095] nix-grpc-daemon[776]: ts=2026-09-20T08:06:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44092 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 36.911468] nix-grpc-daemon[776]: ts=2026-09-20T08:06:12Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 36.918510] nix-grpc-daemon[776]: ts=2026-09-20T08:06:12Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 37.004973] nix-grpc-daemon[832]: ts=2026-09-20T08:06:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 37.029349] nix-grpc-daemon[832]: ts=2026-09-20T08:06:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43254 client # copying 1 paths to 'lb:50051'... worker1 # [ 37.048483] nix-grpc-daemon[832]: ts=2026-09-20T08:06:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker1 # [ 37.074986] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 37.103859] nix-grpc-daemon[832]: ts=2026-09-20T08:06:12Z level=info event=niks3_push_started pid=899 worker1 # [ 37.628441] nix-daemon[889]: accepted connection from pid 912, user nix-grpc-daemon (trusted) worker1 # [ 37.653075] nix-daemon[889]: reaped child process 915, status = succeeded worker1 # [ 37.859036] nix-daemon[889]: accepted connection from pid 917, user nix-grpc-daemon (trusted) worker1 # [ 37.880947] nix-daemon[889]: reaped child process 920, status = succeeded lb # [ 37.878523] niks3-server[988]: 2026/09/20 08:06:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 37.929148] nix-grpc-daemon[899]: time=2026-09-20T08:06:13.339Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 37.931035] nix-grpc-daemon[899]: time=2026-09-20T08:06:13.340Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 37.963032] niks3-server[988]: 2026/09/20 08:06:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 37.996506] niks3-server[988]: 2026/09/20 08:06:13 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 38.014135] niks3-server[988]: 2026/09/20 08:06:13 INFO Signed narinfos id=1 count=1 worker1 # [ 38.035029] nix-grpc-daemon[899]: time=2026-09-20T08:06:13.447Z level=INFO msg="Uploading 1 narinfos" lb # [ 38.033830] niks3-server[988]: 2026/09/20 08:06:13 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 38.038655] niks3-server[988]: 2026/09/20 08:06:13 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 38.057313] niks3-server[988]: 2026/09/20 08:06:13 INFO Completed upload id=1 worker1 # [ 38.074377] nix-grpc-daemon[899]: time=2026-09-20T08:06:13.488Z level=INFO msg="Upload complete. (658ms)" worker1 # [ 38.081269] nix-grpc-daemon[832]: ts=2026-09-20T08:06:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=1 paths=1 nar_bytes_in=504 worker1 # [ 38.092476] nix-grpc-daemon[832]: ts=2026-09-20T08:06:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 38.107022] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 38.110385] nix-daemon[889]: reaped child process 897, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... worker1 # [ 38.123064] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 38.290472] niks3-server[988]: 2026/09/20 08:06:13 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo client # farm-a> LOG-farm-a-t1 worker1 # [ 38.948405] nix-daemon[889]: reaped child process 924, status = succeeded worker1 # [ 39.150960] nix-daemon[889]: accepted connection from pid 939, user nix-grpc-daemon (trusted) worker1 # [ 39.184712] nix-daemon[889]: reaped child process 942, status = succeeded lb # [ 39.181302] niks3-server[988]: 2026/09/20 08:06:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 39.231472] nix-grpc-daemon[899]: time=2026-09-20T08:06:14.643Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 39.237062] nix-grpc-daemon[899]: time=2026-09-20T08:06:14.643Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 39.258890] niks3-server[988]: 2026/09/20 08:06:14 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 39.279173] niks3-server[988]: 2026/09/20 08:06:14 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 39.293351] niks3-server[988]: 2026/09/20 08:06:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 39.301079] niks3-server[988]: 2026/09/20 08:06:14 INFO Signed narinfos id=2 count=1 worker1 # [ 39.317292] nix-grpc-daemon[899]: time=2026-09-20T08:06:14.729Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.303282] niks3-server[988]: 2026/09/20 08:06:14 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 39.315767] niks3-server[988]: 2026/09/20 08:06:14 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 39.332207] niks3-server[988]: 2026/09/20 08:06:14 INFO Completed upload id=2 worker1 # [ 39.349009] nix-grpc-daemon[899]: time=2026-09-20T08:06:14.763Z level=INFO msg="Upload complete. (413ms)" worker1 # [ 39.361321] nix-grpc-daemon[832]: ts=2026-09-20T08:06:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker1 # [ 39.377257] nix-daemon[889]: reaped child process 922, status = succeeded worker2 # [ 39.339389] nix-grpc-daemon[776]: ts=2026-09-20T08:06:14Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker2 # [ 39.339721] nix-grpc-daemon[776]: ts=2026-09-20T08:06:14Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=1 lb # [ 39.406845] niks3-server[988]: 2026/09/20 08:06:14 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker1 # [ 39.431095] nix-grpc-daemon[832]: ts=2026-09-20T08:06:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 39.450993] nix-grpc-daemon[832]: ts=2026-09-20T08:06:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 39.480658] nix-grpc-daemon[899]: time=2026-09-20T08:06:14.894Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker1 # [ 39.491857] nix-grpc-daemon[832]: ts=2026-09-20T08:06:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 39.510327] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 39.758981] nix-daemon[889]: accepted connection from pid 947, user nix-grpc-daemon (trusted) worker1 # [ 39.781892] nix-daemon[889]: reaped child process 950, status = succeeded worker1 # [ 39.991563] nix-daemon[889]: accepted connection from pid 952, user nix-grpc-daemon (trusted) worker1 # [ 40.013397] nix-daemon[889]: reaped child process 955, status = succeeded lb # [ 40.010107] niks3-server[988]: 2026/09/20 08:06:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.037961] nix-grpc-daemon[899]: time=2026-09-20T08:06:15.451Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 40.039805] nix-grpc-daemon[899]: time=2026-09-20T08:06:15.451Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 40.047709] niks3-server[988]: 2026/09/20 08:06:15 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst lb # [ 40.064470] niks3-server[988]: 2026/09/20 08:06:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign worker1 # [ 40.091822] nix-grpc-daemon[899]: time=2026-09-20T08:06:15.505Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.082230] niks3-server[988]: 2026/09/20 08:06:15 INFO Signed narinfos id=3 count=1 lb # [ 40.089340] niks3-server[988]: 2026/09/20 08:06:15 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 40.099981] niks3-server[988]: 2026/09/20 08:06:15 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 40.112620] niks3-server[988]: 2026/09/20 08:06:15 INFO Completed upload id=3 worker1 # [ 40.129386] nix-grpc-daemon[899]: time=2026-09-20T08:06:15.543Z level=INFO msg="Upload complete. (596ms)" lb # [ 40.116523] niks3-server[988]: 2026/09/20 08:06:15 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker1 # [ 40.141891] nix-grpc-daemon[832]: ts=2026-09-20T08:06:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 40.161060] nix-grpc-daemon[832]: ts=2026-09-20T08:06:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 40.170307] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 40.176895] nix-daemon[889]: reaped child process 945, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker1 # [ 40.194648] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-t1 worker1 # [ 41.033168] nix-daemon[889]: reaped child process 959, status = succeeded worker1 # [ 41.222743] nix-daemon[889]: accepted connection from pid 974, user nix-grpc-daemon (trusted) worker1 # [ 41.248591] nix-daemon[889]: reaped child process 977, status = succeeded lb # [ 41.244864] niks3-server[988]: 2026/09/20 08:06:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 41.302614] nix-grpc-daemon[899]: time=2026-09-20T08:06:16.714Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 41.305716] nix-grpc-daemon[899]: time=2026-09-20T08:06:16.714Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 41.331802] niks3-server[988]: 2026/09/20 08:06:16 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst worker1 # [ 41.360091] nix-grpc-daemon[899]: time=2026-09-20T08:06:16.773Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.344629] niks3-server[988]: 2026/09/20 08:06:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 41.354158] niks3-server[988]: 2026/09/20 08:06:16 INFO Signed narinfos id=4 count=1 lb # [ 41.359696] niks3-server[988]: 2026/09/20 08:06:16 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 41.364836] niks3-server[988]: 2026/09/20 08:06:16 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 41.372879] niks3-server[988]: 2026/09/20 08:06:16 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 41.379262] niks3-server[988]: 2026/09/20 08:06:16 INFO Completed upload id=4 worker1 # [ 41.395247] nix-grpc-daemon[899]: time=2026-09-20T08:06:16.809Z level=INFO msg="Upload complete. (387ms)" lb # [ 41.382057] niks3-server[988]: 2026/09/20 08:06:16 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker1 # [ 41.409452] nix-grpc-daemon[832]: ts=2026-09-20T08:06:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker2 # [ 41.379554] nix-grpc-daemon[776]: ts=2026-09-20T08:06:16Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker2 # [ 41.386429] nix-grpc-daemon[776]: ts=2026-09-20T08:06:16Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 41.431783] nix-daemon[889]: reaped child process 957, status = succeeded worker1 # [ 41.462590] nix-grpc-daemon[832]: ts=2026-09-20T08:06:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 41.482626] nix-grpc-daemon[832]: ts=2026-09-20T08:06:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 41.504401] nix-grpc-daemon[899]: time=2026-09-20T08:06:16.918Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 41.522987] nix-grpc-daemon[832]: ts=2026-09-20T08:06:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker1 # [ 41.544270] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 41.789184] nix-daemon[889]: accepted connection from pid 981, user nix-grpc-daemon (trusted) worker1 # [ 41.811344] nix-daemon[889]: reaped child process 984, status = succeeded worker1 # [ 42.032625] nix-daemon[889]: accepted connection from pid 986, user nix-grpc-daemon (trusted) worker1 # [ 42.055619] nix-daemon[889]: reaped child process 989, status = succeeded lb # [ 42.047902] niks3-server[988]: 2026/09/20 08:06:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 42.078256] nix-grpc-daemon[899]: time=2026-09-20T08:06:17.491Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 42.079899] nix-grpc-daemon[899]: time=2026-09-20T08:06:17.491Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 42.085468] niks3-server[988]: 2026/09/20 08:06:17 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 42.103849] niks3-server[988]: 2026/09/20 08:06:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign worker1 # [ 42.126689] nix-grpc-daemon[899]: time=2026-09-20T08:06:17.540Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.116981] niks3-server[988]: 2026/09/20 08:06:17 INFO Signed narinfos id=5 count=1 lb # [ 42.124503] niks3-server[988]: 2026/09/20 08:06:17 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 42.133234] niks3-server[988]: 2026/09/20 08:06:17 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 42.153113] niks3-server[988]: 2026/09/20 08:06:17 INFO Completed upload id=5 worker1 # [ 42.170174] nix-grpc-daemon[899]: time=2026-09-20T08:06:17.584Z level=INFO msg="Upload complete. (600ms)" lb # [ 42.161428] niks3-server[988]: 2026/09/20 08:06:17 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker1 # [ 42.180434] nix-grpc-daemon[832]: ts=2026-09-20T08:06:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 42.195134] nix-grpc-daemon[832]: ts=2026-09-20T08:06:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 42.207387] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 42.216263] nix-daemon[889]: reaped child process 979, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 42.237930] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 43.668398] nix-daemon[889]: reaped child process 993, status = succeeded client # farm-top> LOG-farm-top-t1 worker1 # [ 43.861906] nix-daemon[889]: accepted connection from pid 1010, user nix-grpc-daemon (trusted) worker1 # [ 43.887313] nix-daemon[889]: reaped child process 1013, status = succeeded lb # [ 43.886002] niks3-server[988]: 2026/09/20 08:06:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 43.918651] nix-grpc-daemon[899]: time=2026-09-20T08:06:19.330Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 43.920460] nix-grpc-daemon[899]: time=2026-09-20T08:06:19.330Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 43.937866] niks3-server[988]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 43.953563] niks3-server[988]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst lb # [ 43.966253] niks3-server[988]: 2026/09/20 08:06:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign worker1 # [ 43.987700] nix-grpc-daemon[899]: time=2026-09-20T08:06:19.401Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.973744] niks3-server[988]: 2026/09/20 08:06:19 INFO Signed narinfos id=6 count=1 lb # [ 43.979118] niks3-server[988]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 43.987864] niks3-server[988]: 2026/09/20 08:06:19 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 43.996712] niks3-server[988]: 2026/09/20 08:06:19 INFO Completed upload id=6 worker1 # [ 44.013287] nix-grpc-daemon[899]: time=2026-09-20T08:06:19.427Z level=INFO msg="Upload complete. (352ms)" lb # [ 44.001630] niks3-server[988]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo worker1 # [ 44.025532] nix-grpc-daemon[832]: ts=2026-09-20T08:06:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 lb # [ 44.026976] envoy[938]: conn peer=[2001:db8:1::1]:36804 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=2544 lb # [ 44.031360] envoy[938]: conn peer=[2001:db8:1::1]:36810 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=95 worker1 # [ 44.049596] nix-daemon[889]: reaped child process 991, status = succeeded lb # [ 44.034667] envoy[938]: conn peer=[2001:db8:1::1]:36818 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=13 lb # [ 44.038289] envoy[938]: conn peer=[2001:db8:1::1]:36826 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=21 lb # [ 44.041922] envoy[938]: conn peer=[2001:db8:1::1]:36836 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9427 tx=3855 ms=7145 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 7.42 seconds) client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.32 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.05 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.37 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.32 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.35 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.34 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2 worker1 # [ 45.957782] nix-grpc-daemon[832]: ts=2026-09-20T08:06:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43254 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # [ 45.955791] nix-grpc-daemon[776]: ts=2026-09-20T08:06:21Z level=debug event=want client=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=1 worker2 # [ 45.970261] nix-grpc-daemon[776]: ts=2026-09-20T08:06:21Z level=debug event=want client=2 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=1 worker2 # [ 45.984276] nix-grpc-daemon[776]: ts=2026-09-20T08:06:21Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 0.39 seconds) client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.25 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.09 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.69 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 46.727428] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.12 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup worker2 # [ 47.029204] nix-grpc-daemon[776]: ts=2026-09-20T08:06:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44092 client # Running as unit: dedup1.service; invocation ID: 07f6b468ff114b97969ff407ddb6a329 client # [ 47.022487] nix[863]: don't know how to build these paths: client # [ 47.025143] nix[863]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 47.045669] nix-grpc-daemon[776]: ts=2026-09-20T08:06:22Z level=debug event=want client=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 47.051750] nix-grpc-daemon[776]: ts=2026-09-20T08:06:22Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 47.057472] nix-grpc-daemon[776]: ts=2026-09-20T08:06:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 47.072906] nix-grpc-daemon[776]: ts=2026-09-20T08:06:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44092 client # [ 47.068196] nix[863]: copying 1 paths to 'lb:50051'... worker2 # [ 47.084063] nix-grpc-daemon[776]: ts=2026-09-20T08:06:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44092 client # [ 47.071207] nix[863]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker2 # [ 47.094039] nix-daemon[838]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 47.117449] nix-grpc-daemon[776]: ts=2026-09-20T08:06:22Z level=info event=niks3_push_started pid=883 worker2 # [ 47.625171] nix-daemon[838]: accepted connection from pid 896, user nix-grpc-daemon (trusted) worker2 # [ 47.648159] nix-daemon[838]: reaped child process 899, status = succeeded worker2 # [ 47.835472] nix-daemon[838]: accepted connection from pid 901, user nix-grpc-daemon (trusted) worker2 # [ 47.863589] nix-daemon[838]: reaped child process 904, status = succeeded client # [ 47.858781] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. lb # [ 47.905929] niks3-server[988]: 2026/09/20 08:06:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 47.899753] nix-grpc-daemon[883]: time=2026-09-20T08:06:23.314Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds) worker2 # [ 47.907792] nix-grpc-daemon[883]: time=2026-09-20T08:06:23.316Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" lb # [ 47.957998] niks3-server[988]: 2026/09/20 08:06:23 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst worker2 # [ 47.951524] nix-grpc-daemon[883]: time=2026-09-20T08:06:23.365Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.970209] niks3-server[988]: 2026/09/20 08:06:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 47.979213] niks3-server[988]: 2026/09/20 08:06:23 INFO Signed narinfos id=7 count=1 lb # [ 47.991688] niks3-server[988]: 2026/09/20 08:06:23 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 48.000188] niks3-server[988]: 2026/09/20 08:06:23 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete worker2 # [ 47.990275] nix-grpc-daemon[883]: time=2026-09-20T08:06:23.405Z level=INFO msg="Upload complete. (587ms)" lb # [ 48.011563] niks3-server[988]: 2026/09/20 08:06:23 INFO Completed upload id=7 worker2 # [ 47.995620] nix-grpc-daemon[776]: ts=2026-09-20T08:06:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44092 duration_s=0 paths=1 nar_bytes_in=432 lb # [ 48.015780] niks3-server[988]: 2026/09/20 08:06:23 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker2 # [ 48.002708] nix-grpc-daemon[776]: ts=2026-09-20T08:06:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 48.014731] nix-daemon[838]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 48.019462] nix-daemon[838]: reaped child process 881, status = succeeded client # Running as unit: dedup2.service; invocation ID: e97b548679e34d0c8533c40718d2a9a7 client # [ 48.017098] nix[863]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 48.040197] nix-daemon[838]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 48.357746] nix-grpc-daemon[832]: ts=2026-09-20T08:06:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43254 client # [ 48.318085] nix[879]: don't know how to build these paths: client # [ 48.319415] nix[879]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 48.343594] nix-grpc-daemon[776]: ts=2026-09-20T08:06:23Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 48.358580] nix-grpc-daemon[776]: ts=2026-09-20T08:06:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44092 client # [ 48.352365] nix[879]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.07 seconds) ??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 client: waiting for success: ! systemctl is-active dedup1 dedup2 ??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 worker2 # [ 51.677591] nix-daemon[838]: reaped child process 913, status = succeeded worker2 # [ 51.857351] nix-daemon[838]: accepted connection from pid 940, user nix-grpc-daemon (trusted) worker2 # [ 51.881155] nix-daemon[838]: reaped child process 943, status = succeeded lb # [ 51.919064] niks3-server[988]: 2026/09/20 08:06:27 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 51.910338] nix-grpc-daemon[883]: time=2026-09-20T08:06:27.323Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 51.912678] nix-grpc-daemon[883]: time=2026-09-20T08:06:27.323Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 51.975793] niks3-server[988]: 2026/09/20 08:06:27 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 51.991294] niks3-server[988]: 2026/09/20 08:06:27 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 52.003655] niks3-server[988]: 2026/09/20 08:06:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign worker2 # [ 51.994315] nix-grpc-daemon[883]: time=2026-09-20T08:06:27.406Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.014881] niks3-server[988]: 2026/09/20 08:06:27 INFO Signed narinfos id=8 count=1 lb # [ 52.020064] niks3-server[988]: 2026/09/20 08:06:27 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 52.031864] niks3-server[988]: 2026/09/20 08:06:27 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 52.043751] niks3-server[988]: 2026/09/20 08:06:27 INFO Completed upload id=8 worker2 # [ 52.023241] nix-grpc-daemon[883]: time=2026-09-20T08:06:27.438Z level=INFO msg="Upload complete. (367ms)" lb # [ 52.047734] niks3-server[988]: 2026/09/20 08:06:27 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker2 # [ 52.037403] nix-grpc-daemon[776]: ts=2026-09-20T08:06:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44092 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=1 worker2 # [ 52.060360] nix-grpc-daemon[776]: ts=2026-09-20T08:06:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44092 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=1 worker2 # [ 52.067646] nix-daemon[838]: reaped child process 910, status = succeeded client # [ 52.078069] systemd[1]: dedup2.service: Deactivated successfully. client # [ 52.085928] systemd[1]: dedup2.service: Consumed 245ms CPU time over 4.225s wall clock time, 31M memory peak, 7.3K incoming IP traffic, 6.3K outgoing IP traffic. client # [ 52.126862] systemd[1]: dedup1.service: Deactivated successfully. client # [ 52.130964] systemd[1]: dedup1.service: Consumed 188ms CPU time over 5.402s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.16 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.11 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds) (finished: subtest: two clients wanting the same drv build it once, in 6.52 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 53.422933] systemd[1]: Started Nix Daemon. client # [ 53.635458] nix-daemon[920]: accepted connection from pid 917, user root (trusted) worker2 # [ 53.885397] nix-grpc-daemon[776]: ts=2026-09-20T08:06:29Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 53.893166] nix-grpc-daemon[776]: ts=2026-09-20T08:06:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 53.910626] nix-grpc-daemon[776]: ts=2026-09-20T08:06:29Z level=debug event=want client=5 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 53.917165] nix-grpc-daemon[776]: ts=2026-09-20T08:06:29Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 53.998349] nix-grpc-daemon[832]: ts=2026-09-20T08:06:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 54.017481] nix-grpc-daemon[832]: ts=2026-09-20T08:06:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 54.036644] nix-grpc-daemon[832]: ts=2026-09-20T08:06:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 lb # [ 54.029253] envoy[938]: conn peer=[2001:db8:1::1]:35852 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1162 tx=481 ms=90 lb # [ 54.034886] envoy[938]: conn peer=[2001:db8:1::1]:35862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1086 ms=3747 lb # [ 54.040715] envoy[938]: conn peer=[2001:db8:1::1]:35860 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1373 ms=5069 worker1 # [ 54.070188] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 54.296452] nix-daemon[889]: accepted connection from pid 1055, user nix-grpc-daemon (trusted) worker1 # [ 54.319449] nix-daemon[889]: reaped child process 1058, status = succeeded worker1 # [ 54.516169] nix-daemon[889]: accepted connection from pid 1060, user nix-grpc-daemon (trusted) worker1 # [ 54.539664] nix-daemon[889]: reaped child process 1063, status = succeeded lb # [ 54.538716] niks3-server[988]: 2026/09/20 08:06:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 54.568647] nix-grpc-daemon[899]: time=2026-09-20T08:06:29.981Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 54.570207] nix-grpc-daemon[899]: time=2026-09-20T08:06:29.981Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 54.575166] niks3-server[988]: 2026/09/20 08:06:29 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst lb # [ 54.591616] niks3-server[988]: 2026/09/20 08:06:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign worker1 # [ 54.614432] nix-grpc-daemon[899]: time=2026-09-20T08:06:30.028Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.603820] niks3-server[988]: 2026/09/20 08:06:30 INFO Signed narinfos id=9 count=1 lb # [ 54.609987] niks3-server[988]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 54.620354] niks3-server[988]: 2026/09/20 08:06:30 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 54.628319] niks3-server[988]: 2026/09/20 08:06:30 INFO Completed upload id=9 worker1 # [ 54.645286] nix-grpc-daemon[899]: time=2026-09-20T08:06:30.059Z level=INFO msg="Upload complete. (552ms)" lb # [ 54.631621] niks3-server[988]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker1 # [ 54.656443] nix-grpc-daemon[832]: ts=2026-09-20T08:06:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 54.672616] nix-grpc-daemon[832]: ts=2026-09-20T08:06:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 54.679695] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 54.685879] nix-daemon[889]: reaped child process 1053, status = succeeded worker1 # [ 54.702867] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 55.930047] nix-daemon[889]: reaped child process 1067, status = succeeded worker1 # [ 56.105526] nix-daemon[889]: accepted connection from pid 1082, user nix-grpc-daemon (trusted) worker1 # [ 56.127652] nix-daemon[889]: reaped child process 1085, status = succeeded lb # [ 56.125604] niks3-server[988]: 2026/09/20 08:06:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 56.156475] nix-grpc-daemon[899]: time=2026-09-20T08:06:31.569Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 56.158080] nix-grpc-daemon[899]: time=2026-09-20T08:06:31.569Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 56.174107] niks3-server[988]: 2026/09/20 08:06:31 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 56.195881] niks3-server[988]: 2026/09/20 08:06:31 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst worker1 # [ 56.224105] nix-grpc-daemon[899]: time=2026-09-20T08:06:31.637Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.210700] niks3-server[988]: 2026/09/20 08:06:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 56.218206] niks3-server[988]: 2026/09/20 08:06:31 INFO Signed narinfos id=10 count=1 lb # [ 56.222968] niks3-server[988]: 2026/09/20 08:06:31 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 56.228999] niks3-server[988]: 2026/09/20 08:06:31 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 56.236667] niks3-server[988]: 2026/09/20 08:06:31 INFO Completed upload id=10 worker1 # [ 56.253436] nix-grpc-daemon[899]: time=2026-09-20T08:06:31.667Z level=INFO msg="Upload complete. (338ms)" lb # [ 56.239063] niks3-server[988]: 2026/09/20 08:06:31 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker2 # [ 56.231914] nix-grpc-daemon[776]: ts=2026-09-20T08:06:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:44092 worker1 # [ 56.269086] nix-grpc-daemon[832]: ts=2026-09-20T08:06:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=5 outputs=1 worker2 # [ 56.247416] nix-grpc-daemon[776]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker1 # [ 56.287216] nix-daemon[889]: reaped child process 1065, status = succeeded worker1 # [ 56.340525] nix-grpc-daemon[832]: ts=2026-09-20T08:06:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 56.349685] nix-grpc-daemon[832]: ts=2026-09-20T08:06:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 56.627475] nix-grpc-daemon[832]: ts=2026-09-20T08:06:32Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 56.639072] nix-grpc-daemon[832]: ts=2026-09-20T08:06:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 56.650035] nix-grpc-daemon[899]: time=2026-09-20T08:06:32.063Z level=INFO msg="All 1 paths already cached" worker2 # [ 56.636528] nix-grpc-daemon[776]: ts=2026-09-20T08:06:32Z level=debug event=want client=6 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker1 # [ 56.676686] nix-grpc-daemon[832]: ts=2026-09-20T08:06:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 worker2 # [ 56.642833] nix-grpc-daemon[776]: ts=2026-09-20T08:06:32Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 56.694933] nix-grpc-daemon[832]: ts=2026-09-20T08:06:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 56.711992] nix-grpc-daemon[899]: time=2026-09-20T08:06:32.125Z level=INFO msg="All 1 paths already cached" worker1 # [ 56.723184] nix-grpc-daemon[832]: ts=2026-09-20T08:06:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 56.739676] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 56.957758] nix-daemon[889]: accepted connection from pid 1089, user nix-grpc-daemon (trusted) worker1 # [ 56.981436] nix-daemon[889]: reaped child process 1092, status = succeeded worker1 # [ 57.166182] nix-daemon[889]: accepted connection from pid 1094, user nix-grpc-daemon (trusted) worker1 # [ 57.188546] nix-daemon[889]: reaped child process 1097, status = succeeded lb # [ 57.185285] niks3-server[988]: 2026/09/20 08:06:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 57.213257] nix-grpc-daemon[899]: time=2026-09-20T08:06:32.626Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 57.214831] nix-grpc-daemon[899]: time=2026-09-20T08:06:32.626Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 57.222240] niks3-server[988]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst worker1 # [ 57.251667] nix-grpc-daemon[899]: time=2026-09-20T08:06:32.665Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.236989] niks3-server[988]: 2026/09/20 08:06:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 57.248851] niks3-server[988]: 2026/09/20 08:06:32 INFO Signed narinfos id=11 count=1 lb # [ 57.251540] niks3-server[988]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 57.262277] niks3-server[988]: 2026/09/20 08:06:32 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 57.268608] niks3-server[988]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo lb # [ 57.274080] niks3-server[988]: 2026/09/20 08:06:32 INFO Completed upload id=11 worker1 # [ 57.290730] nix-grpc-daemon[899]: time=2026-09-20T08:06:32.704Z level=INFO msg="Upload complete. (532ms)" worker1 # [ 57.302313] nix-grpc-daemon[832]: ts=2026-09-20T08:06:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 57.316485] nix-grpc-daemon[832]: ts=2026-09-20T08:06:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 57.324228] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 57.329772] nix-daemon[889]: reaped child process 1087, status = succeeded worker1 # [ 57.345264] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 58.569872] nix-daemon[889]: reaped child process 1101, status = succeeded worker1 # [ 58.737864] nix-daemon[889]: accepted connection from pid 1116, user nix-grpc-daemon (trusted) worker1 # [ 58.758401] nix-daemon[889]: reaped child process 1119, status = succeeded lb # [ 58.753127] niks3-server[988]: 2026/09/20 08:06:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 58.784188] nix-grpc-daemon[899]: time=2026-09-20T08:06:34.194Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 58.785738] nix-grpc-daemon[899]: time=2026-09-20T08:06:34.194Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 58.805310] niks3-server[988]: 2026/09/20 08:06:34 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 58.819141] niks3-server[988]: 2026/09/20 08:06:34 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv lb # [ 58.828573] niks3-server[988]: 2026/09/20 08:06:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 58.836512] niks3-server[988]: 2026/09/20 08:06:34 INFO Signed narinfos id=12 count=1 worker1 # [ 58.853111] nix-grpc-daemon[899]: time=2026-09-20T08:06:34.266Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.842200] niks3-server[988]: 2026/09/20 08:06:34 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 58.855825] niks3-server[988]: 2026/09/20 08:06:34 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 58.864408] niks3-server[988]: 2026/09/20 08:06:34 INFO Completed upload id=12 worker1 # [ 58.881094] nix-grpc-daemon[899]: time=2026-09-20T08:06:34.295Z level=INFO msg="Upload complete. (324ms)" lb # [ 58.868233] niks3-server[988]: 2026/09/20 08:06:34 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker2 # [ 58.866305] nix-grpc-daemon[776]: ts=2026-09-20T08:06:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:44092 worker1 # [ 58.893308] nix-grpc-daemon[832]: ts=2026-09-20T08:06:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=6 outputs=1 worker1 # [ 58.915250] nix-daemon[889]: reaped child process 1099, status = succeeded worker2 # [ 58.882400] nix-grpc-daemon[776]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker2 # [ 58.938721] nix-grpc-daemon[776]: ts=2026-09-20T08:06:34Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 58.947802] nix-grpc-daemon[776]: ts=2026-09-20T08:06:34Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44092 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 59.320262] nix-grpc-daemon[832]: ts=2026-09-20T08:06:34Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43254 worker2 # [ 59.298348] nix-grpc-daemon[776]: ts=2026-09-20T08:06:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 59.311297] nix-grpc-daemon[883]: time=2026-09-20T08:06:34.725Z level=INFO msg="All 2 paths already cached" worker2 # [ 59.332473] nix-grpc-daemon[776]: ts=2026-09-20T08:06:34Z level=debug event=want client=7 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker2 # [ 59.339813] nix-grpc-daemon[776]: ts=2026-09-20T08:06:34Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 59.379977] nix-grpc-daemon[832]: ts=2026-09-20T08:06:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 59.398935] nix-grpc-daemon[832]: ts=2026-09-20T08:06:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 59.416764] nix-grpc-daemon[899]: time=2026-09-20T08:06:34.830Z level=INFO msg="All 2 paths already cached" worker1 # [ 59.427063] nix-grpc-daemon[832]: ts=2026-09-20T08:06:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 59.442809] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 59.678006] nix-daemon[889]: accepted connection from pid 1123, user nix-grpc-daemon (trusted) worker1 # [ 59.699311] nix-daemon[889]: reaped child process 1126, status = succeeded worker1 # [ 59.891567] nix-daemon[889]: accepted connection from pid 1128, user nix-grpc-daemon (trusted) worker1 # [ 59.912640] nix-daemon[889]: reaped child process 1131, status = succeeded lb # [ 59.903743] niks3-server[988]: 2026/09/20 08:06:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 60.123585] nix-grpc-daemon[899]: time=2026-09-20T08:06:35.536Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 60.175872] nix-grpc-daemon[899]: time=2026-09-20T08:06:35.536Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 60.288893] niks3-server[988]: 2026/09/20 08:06:35 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst lb # [ 60.290968] niks3-server[988]: 2026/09/20 08:06:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign worker1 # [ 60.310642] nix-grpc-daemon[899]: time=2026-09-20T08:06:35.724Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.298904] niks3-server[988]: 2026/09/20 08:06:35 INFO Signed narinfos id=13 count=1 lb # [ 60.302096] niks3-server[988]: 2026/09/20 08:06:35 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 60.308310] niks3-server[988]: 2026/09/20 08:06:35 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 60.312865] niks3-server[988]: 2026/09/20 08:06:35 INFO Completed upload id=13 worker1 # [ 60.329440] nix-grpc-daemon[899]: time=2026-09-20T08:06:35.743Z level=INFO msg="Upload complete. (866ms)" lb # [ 60.317535] niks3-server[988]: 2026/09/20 08:06:35 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker1 # [ 60.334620] nix-grpc-daemon[832]: ts=2026-09-20T08:06:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 60.340597] nix-grpc-daemon[832]: ts=2026-09-20T08:06:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 60.351248] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 60.355454] nix-daemon[889]: reaped child process 1121, status = succeeded worker1 # [ 60.370078] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 61.630778] nix-daemon[889]: reaped child process 1135, status = succeeded worker1 # [ 61.822174] nix-daemon[889]: accepted connection from pid 1150, user nix-grpc-daemon (trusted) worker1 # [ 61.842899] nix-daemon[889]: reaped child process 1153, status = succeeded lb # [ 61.841573] niks3-server[988]: 2026/09/20 08:06:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 61.872230] nix-grpc-daemon[899]: time=2026-09-20T08:06:37.284Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 61.873983] nix-grpc-daemon[899]: time=2026-09-20T08:06:37.284Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 61.894757] niks3-server[988]: 2026/09/20 08:06:37 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 61.905564] niks3-server[988]: 2026/09/20 08:06:37 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 61.912270] niks3-server[988]: 2026/09/20 08:06:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign worker1 # [ 61.933861] nix-grpc-daemon[899]: time=2026-09-20T08:06:37.347Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.920565] niks3-server[988]: 2026/09/20 08:06:37 INFO Signed narinfos id=14 count=1 lb # [ 61.925573] niks3-server[988]: 2026/09/20 08:06:37 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 61.936223] niks3-server[988]: 2026/09/20 08:06:37 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 61.943379] niks3-server[988]: 2026/09/20 08:06:37 INFO Completed upload id=14 worker1 # [ 61.959296] nix-grpc-daemon[899]: time=2026-09-20T08:06:37.373Z level=INFO msg="Upload complete. (374ms)" lb # [ 61.946208] niks3-server[988]: 2026/09/20 08:06:37 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker1 # [ 61.973443] nix-grpc-daemon[832]: ts=2026-09-20T08:06:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=7 outputs=1 worker1 # [ 61.996394] nix-grpc-daemon[832]: ts=2026-09-20T08:06:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 62.001961] nix-daemon[889]: reaped child process 1133, status = succeeded worker1 # [ 62.011135] nix-grpc-daemon[832]: ts=2026-09-20T08:06:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 62.016252] nix-grpc-daemon[832]: ts=2026-09-20T08:06:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=0 paths=1 nar_bytes_out=232 client # [ 62.106536] nix-daemon[920]: reaped child process 922, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.97 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.06 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 9.12 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.51 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.22 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.29 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 63.594707] nix-daemon[920]: accepted connection from pid 1000, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker1 # [ 63.866857] nix-grpc-daemon[832]: ts=2026-09-20T08:06:39Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43254 client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 63.840812] nix-grpc-daemon[776]: ts=2026-09-20T08:06:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44092 client # copying 1 paths... client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'... worker1 # [ 63.890788] nix-grpc-daemon[832]: ts=2026-09-20T08:06:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 63.908858] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) lb # [ 64.028189] envoy[938]: conn peer=[2001:db8:1::1]:33852 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=334 ms=39 lb # [ 64.028688] envoy[938]: conn peer=[2001:db8:1::1]:33846 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3401 tx=1771 ms=2454 lb # [ 64.028871] envoy[938]: conn peer=[2001:db8:1::1]:33860 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3875 tx=1965 ms=2420 lb # [ 64.028972] envoy[938]: conn peer=[2001:db8:1::1]:33864 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=84 lb # [ 64.029077] envoy[938]: conn peer=[2001:db8:1::1]:57482 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=62 lb # [ 64.029184] envoy[938]: conn peer=[2001:db8:1::1]:33874 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4352 tx=2111 ms=2756 worker1 # [ 64.138786] nix-daemon[889]: accepted connection from pid 1162, user nix-grpc-daemon (trusted) worker1 # [ 64.163026] nix-daemon[889]: reaped child process 1165, status = succeeded lb # [ 64.159607] niks3-server[988]: 2026/09/20 08:06:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 64.185376] nix-grpc-daemon[899]: time=2026-09-20T08:06:39.598Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 64.186968] nix-grpc-daemon[899]: time=2026-09-20T08:06:39.598Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 64.189571] niks3-server[988]: 2026/09/20 08:06:39 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker1 # [ 64.223636] nix-grpc-daemon[899]: time=2026-09-20T08:06:39.637Z level=INFO msg="Uploading 1 narinfos" lb # [ 64.201632] niks3-server[988]: 2026/09/20 08:06:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 64.211995] niks3-server[988]: 2026/09/20 08:06:39 INFO Signed narinfos id=15 count=1 lb # [ 64.214222] niks3-server[988]: 2026/09/20 08:06:39 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 64.225531] niks3-server[988]: 2026/09/20 08:06:39 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete worker1 # [ 64.246757] nix-grpc-daemon[899]: time=2026-09-20T08:06:39.660Z level=INFO msg="Upload complete. (320ms)" lb # [ 64.232603] niks3-server[988]: 2026/09/20 08:06:39 INFO Completed upload id=15 lb # [ 64.236256] niks3-server[988]: 2026/09/20 08:06:39 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker1 # [ 64.256391] nix-grpc-daemon[832]: ts=2026-09-20T08:06:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=0 paths=1 nar_bytes_in=120 worker1 # [ 64.268300] nix-daemon[889]: reaped child process 1160, status = succeeded worker2 # [ 64.241055] nix-grpc-daemon[776]: ts=2026-09-20T08:06:39Z level=debug event=want client=8 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 64.250199] nix-grpc-daemon[776]: ts=2026-09-20T08:06:39Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 64.293630] nix-grpc-daemon[776]: ts=2026-09-20T08:06:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 64.311301] nix-grpc-daemon[776]: ts=2026-09-20T08:06:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44092 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 64.335255] nix-grpc-daemon[776]: ts=2026-09-20T08:06:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44092 client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 64.349099] nix-daemon[838]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 64.589323] nix-daemon[838]: accepted connection from pid 971, user nix-grpc-daemon (trusted) worker2 # [ 64.611987] nix-daemon[838]: reaped child process 974, status = succeeded worker2 # [ 64.796157] nix-daemon[838]: accepted connection from pid 976, user nix-grpc-daemon (trusted) worker2 # [ 64.816893] nix-daemon[838]: reaped child process 979, status = succeeded lb # [ 64.848537] niks3-server[988]: 2026/09/20 08:06:40 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 64.858925] niks3-server[988]: 2026/09/20 08:06:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 64.851091] nix-grpc-daemon[883]: time=2026-09-20T08:06:40.264Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 64.852811] nix-grpc-daemon[883]: time=2026-09-20T08:06:40.264Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" worker2 # [ 64.854554] nix-grpc-daemon[883]: time=2026-09-20T08:06:40.264Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" lb # [ 64.901586] niks3-server[988]: 2026/09/20 08:06:40 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 64.911144] niks3-server[988]: 2026/09/20 08:06:40 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 64.927701] niks3-server[988]: 2026/09/20 08:06:40 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls worker2 # [ 64.917096] nix-grpc-daemon[883]: time=2026-09-20T08:06:40.331Z level=INFO msg="Uploading 3 narinfos" lb # [ 64.936839] niks3-server[988]: 2026/09/20 08:06:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 64.939314] niks3-server[988]: 2026/09/20 08:06:40 INFO Signed narinfos id=16 count=1 lb # [ 64.946680] niks3-server[988]: 2026/09/20 08:06:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 64.953338] niks3-server[988]: 2026/09/20 08:06:40 INFO Signed narinfos id=17 count=2 lb # [ 64.955112] niks3-server[988]: 2026/09/20 08:06:40 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 64.970362] niks3-server[988]: 2026/09/20 08:06:40 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 64.977689] niks3-server[988]: 2026/09/20 08:06:40 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 64.984091] niks3-server[988]: 2026/09/20 08:06:40 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 64.987630] niks3-server[988]: 2026/09/20 08:06:40 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 64.990536] niks3-server[988]: 2026/09/20 08:06:40 INFO Completed upload id=16 lb # [ 64.994152] niks3-server[988]: 2026/09/20 08:06:40 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 64.997352] niks3-server[988]: 2026/09/20 08:06:40 INFO Completed upload id=17 worker2 # [ 64.978308] nix-grpc-daemon[883]: time=2026-09-20T08:06:40.393Z level=INFO msg="Upload complete. (612ms)" worker2 # [ 64.992354] nix-grpc-daemon[776]: ts=2026-09-20T08:06:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44092 duration_s=0 paths=2 nar_bytes_in=984 worker2 # [ 65.008641] nix-grpc-daemon[776]: ts=2026-09-20T08:06:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 65.021311] nix-daemon[838]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 65.031349] nix-daemon[838]: reaped child process 969, status = succeeded worker2 # [ 65.043819] nix-grpc-daemon[776]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker2 # [ 65.067037] nix-daemon[838]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 66.294376] nix-daemon[838]: reaped child process 984, status = succeeded worker2 # [ 66.480182] nix-daemon[838]: accepted connection from pid 999, user nix-grpc-daemon (trusted) worker2 # [ 66.502734] nix-daemon[838]: reaped child process 1002, status = succeeded lb # [ 66.537199] niks3-server[988]: 2026/09/20 08:06:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 66.542542] nix-grpc-daemon[883]: time=2026-09-20T08:06:41.956Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" worker2 # [ 66.583738] nix-grpc-daemon[883]: time=2026-09-20T08:06:41.998Z level=INFO msg="Uploading 1 narinfos" lb # [ 66.593121] niks3-server[988]: 2026/09/20 08:06:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 66.608778] niks3-server[988]: 2026/09/20 08:06:42 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls lb # [ 66.618958] niks3-server[988]: 2026/09/20 08:06:42 INFO Signed narinfos id=18 count=1 lb # [ 66.625707] niks3-server[988]: 2026/09/20 08:06:42 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 66.634711] niks3-server[988]: 2026/09/20 08:06:42 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 66.644262] niks3-server[988]: 2026/09/20 08:06:42 INFO Completed upload id=18 worker2 # [ 66.623948] nix-grpc-daemon[883]: time=2026-09-20T08:06:42.038Z level=INFO msg="Upload complete. (343ms)" lb # [ 66.647059] niks3-server[988]: 2026/09/20 08:06:42 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo worker2 # [ 66.637578] nix-grpc-daemon[776]: ts=2026-09-20T08:06:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44092 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=8 outputs=1 worker2 # [ 66.658888] nix-daemon[838]: reaped child process 981, status = succeeded client # copying 1 paths... worker1 # [ 66.723472] nix-grpc-daemon[832]: ts=2026-09-20T08:06:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 66.746832] nix-grpc-daemon[832]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 66.807482] nix-grpc-daemon[832]: ts=2026-09-20T08:06:42Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 66.811147] nix-grpc-daemon[832]: ts=2026-09-20T08:06:42Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=0 paths=1 nar_bytes_out=120 client # [ 66.893155] nix-daemon[920]: reaped child process 1003, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.58 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 67.147278] nix-daemon[920]: accepted connection from pid 1021, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 67.395736] nix-grpc-daemon[776]: ts=2026-09-20T08:06:42Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:44092 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 67.407162] nix-grpc-daemon[776]: ts=2026-09-20T08:06:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 67.417773] nix-grpc-daemon[883]: time=2026-09-20T08:06:42.832Z level=INFO msg="All 1 paths already cached" worker2 # [ 67.438635] nix-grpc-daemon[776]: ts=2026-09-20T08:06:42Z level=debug event=want client=9 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker1 # [ 67.486046] nix-grpc-daemon[832]: ts=2026-09-20T08:06:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 worker2 # [ 67.446397] nix-grpc-daemon[776]: ts=2026-09-20T08:06:42Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 67.505386] nix-grpc-daemon[832]: ts=2026-09-20T08:06:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43254 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 67.537789] nix-grpc-daemon[832]: ts=2026-09-20T08:06:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 67.557375] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 67.586866] nix-grpc-daemon[832]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 1/5) worker1 # [ 67.683805] nix-grpc-daemon[832]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 110 ms (attempt 2/5) worker1 # [ 67.805602] nix-grpc-daemon[832]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 315 ms (attempt 3/5) worker1 # [ 68.120066] nix-grpc-daemon[832]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 152 ms (attempt 4/5) worker1 # [ 68.281473] nix-grpc-daemon[832]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 68.293710] nix-grpc-daemon[832]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 68.569877] nix-daemon[889]: accepted connection from pid 1174, user nix-grpc-daemon (trusted) worker1 # [ 68.592531] nix-daemon[889]: reaped child process 1177, status = succeeded worker1 # [ 68.804599] nix-daemon[889]: accepted connection from pid 1179, user nix-grpc-daemon (trusted) worker1 # [ 68.826644] nix-daemon[889]: reaped child process 1182, status = succeeded lb # [ 68.826788] niks3-server[988]: 2026/09/20 08:06:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 68.857193] nix-grpc-daemon[899]: time=2026-09-20T08:06:44.270Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 68.858798] nix-grpc-daemon[899]: time=2026-09-20T08:06:44.270Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 68.876323] niks3-server[988]: 2026/09/20 08:06:44 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst worker1 # [ 68.906761] nix-grpc-daemon[899]: time=2026-09-20T08:06:44.320Z level=INFO msg="Uploading 1 narinfos" lb # [ 68.894264] niks3-server[988]: 2026/09/20 08:06:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 68.904439] niks3-server[988]: 2026/09/20 08:06:44 INFO Signed narinfos id=19 count=1 lb # [ 68.906767] niks3-server[988]: 2026/09/20 08:06:44 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 68.916892] niks3-server[988]: 2026/09/20 08:06:44 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 68.923962] niks3-server[988]: 2026/09/20 08:06:44 INFO Completed upload id=19 worker1 # [ 68.938860] nix-grpc-daemon[899]: time=2026-09-20T08:06:44.352Z level=INFO msg="Upload complete. (607ms)" lb # [ 68.926618] niks3-server[988]: 2026/09/20 08:06:44 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker1 # [ 68.955632] nix-grpc-daemon[832]: ts=2026-09-20T08:06:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=1 paths=1 nar_bytes_in=568 worker1 # [ 68.968535] nix-grpc-daemon[832]: ts=2026-09-20T08:06:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 68.986716] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) worker1 # [ 68.994499] nix-daemon[889]: reaped child process 1168, status = succeeded client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... worker1 # [ 69.009242] nix-daemon[889]: accepted connection from pid 832, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 70.470151] nix-daemon[889]: reaped child process 1186, status = succeeded worker1 # [ 70.680134] nix-daemon[889]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) worker1 # [ 70.701162] nix-daemon[889]: reaped child process 1204, status = succeeded lb # [ 70.704598] niks3-server[988]: 2026/09/20 08:06:46 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 70.736563] nix-grpc-daemon[899]: time=2026-09-20T08:06:46.145Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 70.748295] niks3-server[988]: 2026/09/20 08:06:46 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv lb # [ 70.755828] niks3-server[988]: 2026/09/20 08:06:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker1 # [ 70.778604] nix-grpc-daemon[899]: time=2026-09-20T08:06:46.192Z level=INFO msg="Uploading 1 narinfos" lb # [ 70.764677] niks3-server[988]: 2026/09/20 08:06:46 INFO Signed narinfos id=20 count=1 lb # [ 70.771990] niks3-server[988]: 2026/09/20 08:06:46 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls lb # [ 70.783644] niks3-server[988]: 2026/09/20 08:06:46 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete worker1 # [ 70.806461] nix-grpc-daemon[899]: time=2026-09-20T08:06:46.220Z level=INFO msg="Upload complete. (377ms)" lb # [ 70.792108] niks3-server[988]: 2026/09/20 08:06:46 INFO Completed upload id=20 lb # [ 70.795306] niks3-server[988]: 2026/09/20 08:06:46 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo worker1 # [ 70.820354] nix-grpc-daemon[832]: ts=2026-09-20T08:06:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43254 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=9 outputs=1 worker1 # [ 70.835667] nix-daemon[889]: reaped child process 1184, status = succeeded client # copying 1 paths... worker1 # [ 70.865593] nix-grpc-daemon[832]: ts=2026-09-20T08:06:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43254 client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 70.874865] nix-grpc-daemon[776]: ts=2026-09-20T08:06:46Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 70.890840] nix-grpc-daemon[776]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'... worker2 # [ 70.918234] nix-grpc-daemon[776]: ts=2026-09-20T08:06:46Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44092 duration_s=0 paths=1 nar_bytes_out=120 client # [ 71.045489] nix-daemon[920]: reaped child process 1024, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 4.15 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 71.294849] nix-daemon[920]: accepted connection from pid 1042, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker2 # [ 71.534394] nix-grpc-daemon[776]: ts=2026-09-20T08:06:46Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:44092 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 71.545762] nix-grpc-daemon[776]: ts=2026-09-20T08:06:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 71.554129] nix-grpc-daemon[883]: time=2026-09-20T08:06:46.966Z level=INFO msg="All 1 paths already cached" worker2 # [ 71.569194] nix-grpc-daemon[776]: ts=2026-09-20T08:06:46Z level=debug event=want client=10 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker2 # [ 71.577532] nix-grpc-daemon[776]: ts=2026-09-20T08:06:46Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 71.618353] nix-grpc-daemon[776]: ts=2026-09-20T08:06:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 71.638582] nix-grpc-daemon[776]: ts=2026-09-20T08:06:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 71.657580] nix-grpc-daemon[883]: time=2026-09-20T08:06:47.072Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 71.670864] nix-grpc-daemon[776]: ts=2026-09-20T08:06:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 71.689711] nix-daemon[838]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 71.927545] nix-daemon[838]: accepted connection from pid 1011, user nix-grpc-daemon (trusted) worker2 # [ 71.951319] nix-daemon[838]: reaped child process 1014, status = succeeded worker2 # [ 72.135237] nix-daemon[838]: accepted connection from pid 1016, user nix-grpc-daemon (trusted) worker2 # [ 72.155300] nix-daemon[838]: reaped child process 1019, status = succeeded lb # [ 72.189090] niks3-server[988]: 2026/09/20 08:06:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 72.184693] nix-grpc-daemon[883]: time=2026-09-20T08:06:47.599Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 72.186436] nix-grpc-daemon[883]: time=2026-09-20T08:06:47.599Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 72.234581] niks3-server[988]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst worker2 # [ 72.228598] nix-grpc-daemon[883]: time=2026-09-20T08:06:47.643Z level=INFO msg="Uploading 1 narinfos" lb # [ 72.247855] niks3-server[988]: 2026/09/20 08:06:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 72.260176] niks3-server[988]: 2026/09/20 08:06:47 INFO Signed narinfos id=21 count=1 lb # [ 72.262621] niks3-server[988]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 72.274058] niks3-server[988]: 2026/09/20 08:06:47 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 72.281525] niks3-server[988]: 2026/09/20 08:06:47 INFO Completed upload id=21 worker2 # [ 72.261449] nix-grpc-daemon[883]: time=2026-09-20T08:06:47.676Z level=INFO msg="Upload complete. (552ms)" lb # [ 72.284436] niks3-server[988]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker2 # [ 72.274563] nix-grpc-daemon[776]: ts=2026-09-20T08:06:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44092 duration_s=0 paths=1 nar_bytes_in=568 worker2 # [ 72.288462] nix-grpc-daemon[776]: ts=2026-09-20T08:06:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 72.300849] nix-daemon[838]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 72.303981] nix-daemon[838]: reaped child process 1009, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... worker2 # [ 72.321048] nix-daemon[838]: accepted connection from pid 776, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker2 # [ 73.555957] nix-daemon[838]: reaped child process 1023, status = succeeded worker2 # [ 73.723813] nix-daemon[838]: accepted connection from pid 1038, user nix-grpc-daemon (trusted) worker2 # [ 73.744216] nix-daemon[838]: reaped child process 1041, status = succeeded lb # [ 73.777991] niks3-server[988]: 2026/09/20 08:06:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 73.769649] nix-grpc-daemon[883]: time=2026-09-20T08:06:49.182Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 73.815139] niks3-server[988]: 2026/09/20 08:06:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign worker2 # [ 73.803558] nix-grpc-daemon[883]: time=2026-09-20T08:06:49.218Z level=INFO msg="Uploading 1 narinfos" lb # [ 73.827664] niks3-server[988]: 2026/09/20 08:06:49 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 73.843526] niks3-server[988]: 2026/09/20 08:06:49 INFO Signed narinfos id=22 count=1 worker2 # [ 73.829274] nix-grpc-daemon[883]: time=2026-09-20T08:06:49.244Z level=INFO msg="Upload complete. (295ms)" lb # [ 73.849103] niks3-server[988]: 2026/09/20 08:06:49 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 73.854371] niks3-server[988]: 2026/09/20 08:06:49 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 73.858625] niks3-server[988]: 2026/09/20 08:06:49 INFO Completed upload id=22 lb # [ 73.860809] niks3-server[988]: 2026/09/20 08:06:49 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker2 # [ 73.840772] nix-grpc-daemon[776]: ts=2026-09-20T08:06:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44092 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=10 outputs=1 worker2 # [ 73.852075] nix-daemon[838]: reaped child process 1021, status = succeeded client # copying 1 paths... worker1 # [ 73.924945] nix-grpc-daemon[832]: ts=2026-09-20T08:06:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 73.940416] nix-grpc-daemon[832]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 73.953231] nix-grpc-daemon[776]: ts=2026-09-20T08:06:49Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44092 worker2 # [ 73.960223] nix-grpc-daemon[776]: ts=2026-09-20T08:06:49Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44092 duration_s=0 paths=1 nar_bytes_out=120 lb # [ 74.029031] envoy[938]: conn peer=[2001:db8:1::1]:57510 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=68 lb # [ 74.033986] envoy[938]: conn peer=[2001:db8:1::1]:57494 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4232 tx=1886 ms=3006 lb # [ 74.038923] envoy[938]: conn peer=[2001:db8:1::1]:57522 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3723 tx=1799 ms=3585 lb # [ 74.044262] envoy[938]: conn peer=[2001:db8:1::1]:46572 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=119 lb # [ 74.049413] envoy[938]: conn peer=[2001:db8:1::1]:46594 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=29 lb # [ 74.054146] envoy[938]: conn peer=[2001:db8:1::1]:46582 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3741 tx=1931 ms=2445 client # [ 74.035230] nix-daemon[920]: reaped child process 1045, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.99 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 11.77 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.48 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.45 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.21 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.26 seconds) worker2 # [ 75.542641] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 76.410077] nix-grpc-daemon[776]: ts=2026-09-20T08:06:51Z level=info event=signal_exit worker2 # [ 76.650888] nix-grpc-daemon[776]: ts=2026-09-20T08:06:52Z level=info event=scheduler_yield worker2 # [ 76.656897] nix-grpc-daemon[776]: ts=2026-09-20T08:06:52Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 76.680795] niks3-server[988]: 2026/09/20 08:06:52 INFO lead: released remote=192.168.1.4:52376 worker2 # [ 76.662336] nix-grpc-daemon[776]: ts=2026-09-20T08:06:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:56708 worker1 # [ 76.700703] nix-grpc-daemon[832]: ts=2026-09-20T08:06:52Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 76.668889] nix-grpc-daemon[776]: ts=2026-09-20T08:06:52Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 76.673235] nix-grpc-daemon[776]: ts=2026-09-20T08:06:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:56708 worker2 # [ 76.677748] nix-grpc-daemon[776]: ts=2026-09-20T08:06:52Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 76.858066] nix-grpc-daemon[776]: ts=2026-09-20T08:06:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 76.901133] nix-grpc-daemon[832]: ts=2026-09-20T08:06:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 76.869777] nix-grpc-daemon[776]: ts=2026-09-20T08:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 76.908220] nix-grpc-daemon[832]: ts=2026-09-20T08:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 77.071241] nix-grpc-daemon[776]: ts=2026-09-20T08:06:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 77.109321] nix-grpc-daemon[832]: ts=2026-09-20T08:06:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 77.079066] nix-grpc-daemon[776]: ts=2026-09-20T08:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 77.116700] nix-grpc-daemon[832]: ts=2026-09-20T08:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 77.280386] nix-grpc-daemon[776]: ts=2026-09-20T08:06:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 77.317782] nix-grpc-daemon[832]: ts=2026-09-20T08:06:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 77.287370] nix-grpc-daemon[776]: ts=2026-09-20T08:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 77.324713] nix-grpc-daemon[832]: ts=2026-09-20T08:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 77.525634] nix-grpc-daemon[832]: ts=2026-09-20T08:06:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 77.491324] nix-grpc-daemon[776]: ts=2026-09-20T08:06:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 77.530308] nix-grpc-daemon[832]: ts=2026-09-20T08:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 77.495726] nix-grpc-daemon[776]: ts=2026-09-20T08:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 77.657012] nix-grpc-daemon[776]: ts=2026-09-20T08:06:53Z level=info event=scheduler_restarting worker1 # [ 77.733098] nix-grpc-daemon[832]: ts=2026-09-20T08:06:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 77.713816] nix-daemon[838]: reaped child process 840, status = succeeded worker2 # [ 77.716546] nix-grpc-daemon[776]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 77.719903] nix-grpc-daemon[776]: E0000 00:00:1789891613.113501 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true worker2 # [ 77.725094] nix-grpc-daemon[776]: ts=2026-09-20T08:06:53Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 78.565998] nix-grpc-daemon[776]: E0000 00:00:1789891613.979454 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker2 # [ 78.572747] nix-grpc-daemon[776]: E0000 00:00:1789891613.979809 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 79.255242] nix-grpc-daemon[832]: ts=2026-09-20T08:06:54Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure" worker2 # [ 79.237992] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 79.248916] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 79.251264] systemd[1]: nix-grpc-daemon.service: Consumed 2.038s CPU time over 55.213s wall clock time, 52.1M memory peak, 53K incoming IP traffic, 92.8K outgoing IP traffic. worker2 # [ 79.268109] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 79.271740] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 79.274192] systemd[1]: nix-grpc-daemon.socket: Consumed 879us CPU time over 1min 6.834s wall clock time, 256K memory peak, 86.9K incoming IP traffic, 71.5K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 79.455282] nix-grpc-daemon[832]: ts=2026-09-20T08:06:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 79.464164] nix-grpc-daemon[832]: ts=2026-09-20T08:06:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 79.651119] nix-grpc-daemon[832]: ts=2026-09-20T08:06:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43254 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker1 # [ 79.659798] nix-grpc-daemon[832]: ts=2026-09-20T08:06:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43254 worker1 # [ 79.666426] nix-grpc-daemon[832]: ts=2026-09-20T08:06:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 79.671942] nix-grpc-daemon[832]: ts=2026-09-20T08:06:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure" client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.28 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds) worker2 # [ 79.762512] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 79.872675] nix-grpc-daemon[832]: ts=2026-09-20T08:06:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 79.885144] nix-grpc-daemon[832]: ts=2026-09-20T08:06:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 79.901324] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 80.083963] nix-grpc-daemon[832]: ts=2026-09-20T08:06:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.062699] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 80.287559] nix-grpc-daemon[1062]: ts=2026-09-20T08:06:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 80.291724] nix-grpc-daemon[1062]: ts=2026-09-20T08:06:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 80.300310] nix-grpc-daemon[1062]: ts=2026-09-20T08:06:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 80.302288] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 80.317576] nix-grpc-daemon[1062]: ts=2026-09-20T08:06:55Z level=info event=scheduler_take_over lb # [ 80.338160] niks3-server[988]: 2026/09/20 08:06:55 INFO lead: acquired remote=192.168.1.4:57736 worker2 # [ 80.338002] nix-grpc-daemon[1062]: ts=2026-09-20T08:06:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.343710] nix-grpc-daemon[1062]: ts=2026-09-20T08:06:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 80.380970] nix-grpc-daemon[832]: ts=2026-09-20T08:06:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 80.418367] nix-grpc-daemon[832]: ts=2026-09-20T08:06:55Z level=info event=signal_exit worker1 # [ 80.579987] nix-grpc-daemon[832]: ts=2026-09-20T08:06:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.545086] nix-grpc-daemon[1062]: ts=2026-09-20T08:06:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.551837] nix-grpc-daemon[1062]: ts=2026-09-20T08:06:55Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 80.557648] nix-grpc-daemon[1062]: ts=2026-09-20T08:06:55Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 81.685582] nix-grpc-daemon[832]: ts=2026-09-20T08:06:57Z level=info event=scheduler_restarting worker2 # [ 81.649083] nix-grpc-daemon[1062]: ts=2026-09-20T08:06:57Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60542 worker2 # [ 81.654024] nix-grpc-daemon[1062]: ts=2026-09-20T08:06:57Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 81.713628] nix-grpc-daemon[832]: ts=2026-09-20T08:06:57Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 81.738684] nix-daemon[889]: reaped child process 891, status = succeeded worker1 # [ 82.520042] nix-grpc-daemon[832]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 82.524758] nix-grpc-daemon[832]: E0000 00:00:1789891617.933670 875 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 82.524939] nix-grpc-daemon[832]: E0000 00:00:1789891617.933977 875 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 83.182864] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 83.188606] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 83.190174] systemd[1]: nix-grpc-daemon.service: Consumed 3.723s CPU time over 59.134s wall clock time, 56.2M memory peak, 74.8K incoming IP traffic, 133.4K outgoing IP traffic. worker1 # [ 83.202519] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 83.207020] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 83.209879] systemd[1]: nix-grpc-daemon.socket: Consumed 902us CPU time over 1min 8.693s wall clock time, 256K memory peak, 92K incoming IP traffic, 77.1K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.06 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 83.492733] nix-grpc-daemon[1062]: ts=2026-09-20T08:06:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40822 worker2 # [ 83.501756] nix-daemon[838]: accepted connection from pid 1062, user nix-grpc-daemon (trusted) worker2 # [ 83.516389] nix-grpc-daemon[1062]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 1/5) worker2 # [ 83.527791] nix-grpc-daemon[1062]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 104 ms (attempt 2/5) worker2 # [ 83.634929] nix-grpc-daemon[1062]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 369 ms (attempt 3/5) lb # [ 84.025742] envoy[938]: conn peer=[2001:db8:1::4]:38074 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6051 tx=1772 ms=53298 worker2 # [ 84.011788] nix-grpc-daemon[1062]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 699 ms (attempt 4/5) lb # [ 84.030943] envoy[938]: conn peer=[2001:db8:1::1]:46602 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=22 lb # [ 84.035851] envoy[938]: conn peer=192.168.1.3:39102 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6730 tx=2074 ms=56430 worker2 # [ 84.715977] nix-grpc-daemon[1062]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 84.744117] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40822 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 84.764004] nix-daemon[838]: accepted connection from pid 1062, user nix-grpc-daemon (trusted) worker2 # [ 84.794070] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:00Z level=info event=niks3_push_started pid=1118 worker2 # [ 85.203011] nix-daemon[838]: accepted connection from pid 1131, user nix-grpc-daemon (trusted) worker2 # [ 85.222902] nix-daemon[838]: reaped child process 1134, status = succeeded lb # [ 85.256443] niks3-server[988]: 2026/09/20 08:07:00 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 85.261710] niks3-server[988]: 2026/09/20 08:07:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 85.247579] nix-grpc-daemon[1118]: time=2026-09-20T08:07:00.661Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 85.252177] nix-grpc-daemon[1118]: time=2026-09-20T08:07:00.661Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" worker2 # [ 85.254125] nix-grpc-daemon[1118]: time=2026-09-20T08:07:00.661Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" lb # [ 85.314116] niks3-server[988]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 85.322713] niks3-server[988]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 85.331307] niks3-server[988]: 2026/09/20 08:07:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 85.335999] niks3-server[988]: 2026/09/20 08:07:00 INFO Signed narinfos id=23 count=1 lb # [ 85.338219] niks3-server[988]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 85.345149] niks3-server[988]: 2026/09/20 08:07:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign worker2 # [ 85.326637] nix-grpc-daemon[1118]: time=2026-09-20T08:07:00.739Z level=INFO msg="Uploading 3 narinfos" lb # [ 85.349293] niks3-server[988]: 2026/09/20 08:07:00 INFO Signed narinfos id=24 count=2 lb # [ 85.351164] niks3-server[988]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 85.371693] niks3-server[988]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 85.380172] niks3-server[988]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 85.382644] niks3-server[988]: 2026/09/20 08:07:00 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 85.391316] niks3-server[988]: 2026/09/20 08:07:00 INFO Completed upload id=23 lb # [ 85.393036] niks3-server[988]: 2026/09/20 08:07:00 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 85.395653] niks3-server[988]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 85.397939] niks3-server[988]: 2026/09/20 08:07:00 INFO Completed upload id=24 worker2 # [ 85.377136] nix-grpc-daemon[1118]: time=2026-09-20T08:07:00.791Z level=INFO msg="Upload complete. (358ms)" worker2 # [ 85.388544] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40822 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 85.402874] nix-daemon[838]: reaped child process 1116, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 2.18 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds) worker1 # [ 85.560637] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 85.565677] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 85.748827] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 85.751394] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 85.760083] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:01Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 85.761879] systemd[1]: Started Nix worker-protocol over gRPC. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 85.789166] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.759578] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:01Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.19 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 12.87 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 87.238286] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 87.305987] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:02Z level=info event=signal_exit worker2 # [ 87.323540] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:02Z level=info event=scheduler_yield lb # [ 87.345418] niks3-server[988]: 2026/09/20 08:07:02 INFO lead: released remote=192.168.1.4:57736 worker1 # [ 87.367344] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:02Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 87.335015] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:02Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60542 worker2 # [ 87.340265] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:02Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 87.347000] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:02Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 87.351305] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:02Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60542 worker2 # [ 87.355908] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:02Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 87.566643] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.547381] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.591500] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 87.572704] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 87.792856] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.798824] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 87.773709] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.779478] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 87.999489] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.005231] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 87.980285] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.985808] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 88.205713] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.211492] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 88.186382] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.191983] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 88.335323] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:03Z level=info event=scheduler_restarting worker2 # [ 88.365109] nix-daemon[838]: reaped child process 1111, status = succeeded worker2 # [ 88.368410] nix-grpc-daemon[1062]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 88.373288] nix-grpc-daemon[1062]: E0000 00:00:1789891623.779606 1105 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker1 # [ 88.414623] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.380677] nix-grpc-daemon[1062]: E0000 00:00:1789891623.795296 1105 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true worker2 # [ 88.386601] nix-grpc-daemon[1062]: E0000 00:00:1789891623.795590 1105 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true worker2 # [ 88.407321] nix-grpc-daemon[1062]: ts=2026-09-20T08:07:03Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 90.352697] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:05Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure" worker2 # [ 90.338510] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 90.345655] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 90.350770] systemd[1]: nix-grpc-daemon.service: Consumed 505ms CPU time over 10.272s wall clock time, 30.8M memory peak, 17.7K incoming IP traffic, 22.3K outgoing IP traffic. worker2 # [ 90.362376] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 90.366925] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 90.370062] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 10.609s wall clock time, 256K memory peak, 27.3K incoming IP traffic, 23.5K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1 # [ 90.552168] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.559841] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 90.760667] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.763968] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:06Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure" worker1 # [ 90.775303] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:06Z level=info event=scheduler_take_over lb # [ 90.758263] niks3-server[988]: 2026/09/20 08:07:06 INFO lead: acquired remote=192.168.1.3:56688 worker1 # [ 90.964726] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.967670] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.19 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&2 worker1 # [ 91.939770] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59008 worker1 # [ 91.958107] nix-daemon[889]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 91.997717] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:07Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker1 # [ 92.005258] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:07Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 92.055540] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59008 worker1 # [ 92.076679] nix-grpc-daemon[1228]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 1/5) worker1 # [ 92.180235] nix-grpc-daemon[1228]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 187 ms (attempt 2/5) worker1 # [ 92.367738] nix-grpc-daemon[1228]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 237 ms (attempt 3/5) worker1 # [ 92.613177] nix-grpc-daemon[1228]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 259 ms (attempt 4/5) worker1 # [ 92.881670] nix-grpc-daemon[1228]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 92.905530] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59008 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker1 # [ 92.925452] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59008 worker1 # [ 92.941318] nix-daemon[889]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) worker1 # [ 92.977837] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:08Z level=info event=niks3_push_started pid=1303 worker1 # [ 93.421027] nix-daemon[889]: accepted connection from pid 1316, user nix-grpc-daemon (trusted) worker1 # [ 93.442294] nix-daemon[889]: reaped child process 1319, status = succeeded worker1 # [ 93.630849] nix-daemon[889]: accepted connection from pid 1321, user nix-grpc-daemon (trusted) worker1 # [ 93.650799] nix-daemon[889]: reaped child process 1324, status = succeeded lb # [ 93.647403] niks3-server[988]: 2026/09/20 08:07:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 93.680558] nix-grpc-daemon[1303]: time=2026-09-20T08:07:09.093Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 93.682095] nix-grpc-daemon[1303]: time=2026-09-20T08:07:09.093Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 93.712914] niks3-server[988]: 2026/09/20 08:07:09 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst worker1 # [ 93.738383] nix-grpc-daemon[1303]: time=2026-09-20T08:07:09.152Z level=INFO msg="Uploading 1 narinfos" lb # [ 93.726588] niks3-server[988]: 2026/09/20 08:07:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 93.734930] niks3-server[988]: 2026/09/20 08:07:09 INFO Signed narinfos id=25 count=1 lb # [ 93.748597] niks3-server[988]: 2026/09/20 08:07:09 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 93.751730] niks3-server[988]: 2026/09/20 08:07:09 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 93.757610] niks3-server[988]: 2026/09/20 08:07:09 INFO Completed upload id=25 worker1 # [ 93.774449] nix-grpc-daemon[1303]: time=2026-09-20T08:07:09.188Z level=INFO msg="Upload complete. (572ms)" lb # [ 93.760080] niks3-server[988]: 2026/09/20 08:07:09 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo worker1 # [ 93.786161] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59008 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 93.803542] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59008 worker1 # [ 93.810291] nix-daemon[889]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) worker1 # [ 93.815586] nix-daemon[889]: reaped child process 1301, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker1 # [ 93.831836] nix-daemon[889]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) lb # [ 94.028628] envoy[938]: conn peer=[2001:db8:1::1]:59078 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1007 tx=282 ms=1910 lb # [ 94.034053] envoy[938]: conn peer=[2001:db8:1::4]:39182 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1133 tx=413 ms=8069 client # farm-a> LOG-farm-a-on-standby worker1 # [ 94.467023] nix-daemon[889]: reaped child process 1328, status = succeeded worker1 # [ 94.661556] nix-daemon[889]: accepted connection from pid 1343, user nix-grpc-daemon (trusted) worker1 # [ 94.682062] nix-daemon[889]: reaped child process 1346, status = succeeded lb # [ 94.681736] niks3-server[988]: 2026/09/20 08:07:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 94.708478] nix-grpc-daemon[1303]: time=2026-09-20T08:07:10.121Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 94.710047] nix-grpc-daemon[1303]: time=2026-09-20T08:07:10.121Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 94.715396] niks3-server[988]: 2026/09/20 08:07:10 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 94.722357] niks3-server[988]: 2026/09/20 08:07:10 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 94.729835] niks3-server[988]: 2026/09/20 08:07:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign worker1 # [ 94.751688] nix-grpc-daemon[1303]: time=2026-09-20T08:07:10.164Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.738609] niks3-server[988]: 2026/09/20 08:07:10 INFO Signed narinfos id=26 count=1 lb # [ 94.742783] niks3-server[988]: 2026/09/20 08:07:10 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 94.750753] niks3-server[988]: 2026/09/20 08:07:10 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 94.756677] niks3-server[988]: 2026/09/20 08:07:10 INFO Completed upload id=26 worker1 # [ 94.773316] nix-grpc-daemon[1303]: time=2026-09-20T08:07:10.187Z level=INFO msg="Upload complete. (330ms)" lb # [ 94.759102] niks3-server[988]: 2026/09/20 08:07:10 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker1 # [ 94.790100] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59008 duration_s=0 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker1 # [ 94.803420] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:10Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker1 # [ 94.806579] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:10Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 94.809950] nix-daemon[889]: reaped child process 1326, status = succeeded worker1 # [ 94.838171] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59008 worker1 # [ 94.849325] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59008 worker1 # [ 94.864455] nix-grpc-daemon[1303]: time=2026-09-20T08:07:10.278Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker1 # [ 94.874917] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59008 worker1 # [ 94.884174] nix-daemon[889]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) worker1 # [ 95.097590] nix-daemon[889]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 95.118185] nix-daemon[889]: reaped child process 1355, status = succeeded worker1 # [ 95.314789] nix-daemon[889]: accepted connection from pid 1357, user nix-grpc-daemon (trusted) worker1 # [ 95.334531] nix-daemon[889]: reaped child process 1360, status = succeeded lb # [ 95.329739] niks3-server[988]: 2026/09/20 08:07:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 95.357703] nix-grpc-daemon[1303]: time=2026-09-20T08:07:10.771Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 95.359473] nix-grpc-daemon[1303]: time=2026-09-20T08:07:10.771Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 95.365812] niks3-server[988]: 2026/09/20 08:07:10 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst lb # [ 95.382876] niks3-server[988]: 2026/09/20 08:07:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign worker1 # [ 95.405301] nix-grpc-daemon[1303]: time=2026-09-20T08:07:10.818Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.396282] niks3-server[988]: 2026/09/20 08:07:10 INFO Signed narinfos id=27 count=1 lb # [ 95.399272] niks3-server[988]: 2026/09/20 08:07:10 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 95.414234] niks3-server[988]: 2026/09/20 08:07:10 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 95.419315] niks3-server[988]: 2026/09/20 08:07:10 INFO Completed upload id=27 worker1 # [ 95.436135] nix-grpc-daemon[1303]: time=2026-09-20T08:07:10.850Z level=INFO msg="Upload complete. (534ms)" lb # [ 95.422207] niks3-server[988]: 2026/09/20 08:07:10 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker1 # [ 95.444424] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59008 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 95.460580] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59008 worker1 # [ 95.471100] nix-daemon[889]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) worker1 # [ 95.474134] nix-daemon[889]: reaped child process 1350, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker1 # [ 95.490865] nix-daemon[889]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-on-standby worker1 # [ 96.119548] nix-daemon[889]: reaped child process 1364, status = succeeded worker1 # [ 96.296177] nix-daemon[889]: accepted connection from pid 1379, user nix-grpc-daemon (trusted) worker1 # [ 96.316472] nix-daemon[889]: reaped child process 1382, status = succeeded lb # [ 96.314283] niks3-server[988]: 2026/09/20 08:07:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 96.341396] nix-grpc-daemon[1303]: time=2026-09-20T08:07:11.754Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 96.342979] nix-grpc-daemon[1303]: time=2026-09-20T08:07:11.754Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 96.350689] niks3-server[988]: 2026/09/20 08:07:11 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 96.366292] niks3-server[988]: 2026/09/20 08:07:11 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 96.378544] niks3-server[988]: 2026/09/20 08:07:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign worker1 # [ 96.402590] nix-grpc-daemon[1303]: time=2026-09-20T08:07:11.816Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.393057] niks3-server[988]: 2026/09/20 08:07:11 INFO Signed narinfos id=28 count=1 lb # [ 96.400359] niks3-server[988]: 2026/09/20 08:07:11 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 96.409767] niks3-server[988]: 2026/09/20 08:07:11 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 96.420185] niks3-server[988]: 2026/09/20 08:07:11 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo lb # [ 96.429977] niks3-server[988]: 2026/09/20 08:07:11 INFO Completed upload id=28 worker1 # [ 96.446791] nix-grpc-daemon[1303]: time=2026-09-20T08:07:11.860Z level=INFO msg="Upload complete. (344ms)" worker1 # [ 96.466112] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59008 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker1 # [ 96.484299] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:11Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker1 # [ 96.488853] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:11Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 96.493740] nix-daemon[889]: reaped child process 1362, status = succeeded worker1 # [ 96.510555] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59008 worker1 # [ 96.528255] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59008 worker1 # [ 96.540743] nix-grpc-daemon[1303]: time=2026-09-20T08:07:11.954Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker1 # [ 96.552654] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59008 worker1 # [ 96.570497] nix-daemon[889]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) worker1 # [ 96.812474] nix-daemon[889]: accepted connection from pid 1388, user nix-grpc-daemon (trusted) worker1 # [ 96.834864] nix-daemon[889]: reaped child process 1391, status = succeeded worker1 # [ 97.021763] nix-daemon[889]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker1 # [ 97.043527] nix-daemon[889]: reaped child process 1396, status = succeeded lb # [ 97.039261] niks3-server[988]: 2026/09/20 08:07:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 97.066495] nix-grpc-daemon[1303]: time=2026-09-20T08:07:12.480Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 97.068111] nix-grpc-daemon[1303]: time=2026-09-20T08:07:12.480Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 97.080105] niks3-server[988]: 2026/09/20 08:07:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign worker1 # [ 97.104346] nix-grpc-daemon[1303]: time=2026-09-20T08:07:12.517Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.091224] niks3-server[988]: 2026/09/20 08:07:12 INFO Signed narinfos id=29 count=1 lb # [ 97.103680] niks3-server[988]: 2026/09/20 08:07:12 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 97.137220] niks3-server[988]: 2026/09/20 08:07:12 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst lb # [ 97.150328] niks3-server[988]: 2026/09/20 08:07:12 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 97.158645] niks3-server[988]: 2026/09/20 08:07:12 INFO Completed upload id=29 lb # [ 97.161688] niks3-server[988]: 2026/09/20 08:07:12 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker1 # [ 97.175614] nix-grpc-daemon[1303]: time=2026-09-20T08:07:12.589Z level=INFO msg="Upload complete. (581ms)" worker1 # [ 97.188726] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59008 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 97.204379] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59008 worker1 # [ 97.223572] nix-daemon[889]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) worker1 # [ 97.227837] nix-daemon[889]: reaped child process 1386, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... worker1 # [ 97.238678] nix-daemon[889]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv client # farm-top> LOG-farm-top-on-standby worker1 # [ 98.273600] nix-daemon[889]: reaped child process 1400, status = succeeded worker1 # [ 98.447363] nix-daemon[889]: accepted connection from pid 1415, user nix-grpc-daemon (trusted) worker1 # [ 98.470675] nix-daemon[889]: reaped child process 1418, status = succeeded lb # [ 98.469967] niks3-server[988]: 2026/09/20 08:07:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 98.497379] nix-grpc-daemon[1303]: time=2026-09-20T08:07:13.911Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 98.500994] nix-grpc-daemon[1303]: time=2026-09-20T08:07:13.913Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 98.511432] niks3-server[988]: 2026/09/20 08:07:13 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 98.525121] niks3-server[988]: 2026/09/20 08:07:13 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 98.537027] niks3-server[988]: 2026/09/20 08:07:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign worker1 # [ 98.558574] nix-grpc-daemon[1303]: time=2026-09-20T08:07:13.972Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.546608] niks3-server[988]: 2026/09/20 08:07:13 INFO Signed narinfos id=30 count=1 lb # [ 98.552735] niks3-server[988]: 2026/09/20 08:07:13 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 98.567308] niks3-server[988]: 2026/09/20 08:07:13 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 98.574890] niks3-server[988]: 2026/09/20 08:07:13 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo lb # [ 98.580647] niks3-server[988]: 2026/09/20 08:07:13 INFO Completed upload id=30 worker1 # [ 98.597386] nix-grpc-daemon[1303]: time=2026-09-20T08:07:14.011Z level=INFO msg="Upload complete. (345ms)" worker1 # [ 98.613394] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59008 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker1 # [ 98.631112] nix-daemon[889]: reaped child process 1398, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&2, in 6.99 seconds) client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath, in 0.25 seconds) worker2 # [ 98.963681] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 98.974069] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 99.181528] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 99.183401] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 99.191912] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 99.200683] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 99.214348] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 99.251982] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.67 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 99.660982] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 9a5c05738409468cbbebba14c7c20c2b client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds) client # [ 99.916763] nix[1144]: don't know how to build these paths: client # [ 99.919063] nix[1144]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker1 # [ 99.965733] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59008 worker1 # [ 99.982702] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:15Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker1 # [ 99.990422] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:15Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 100.030768] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59008 worker1 # [ 100.049075] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59008 client # [ 100.016239] nix[1144]: copying 1 paths to 'lb:50051'... worker1 # [ 100.067102] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59008 client # [ 100.018806] nix[1144]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker1 # [ 100.085724] nix-daemon[889]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) worker1 # [ 100.305427] nix-daemon[889]: accepted connection from pid 1433, user nix-grpc-daemon (trusted) worker1 # [ 100.327343] nix-daemon[889]: reaped child process 1436, status = succeeded worker1 # [ 100.540234] nix-daemon[889]: accepted connection from pid 1438, user nix-grpc-daemon (trusted) worker1 # [ 100.569024] nix-daemon[889]: reaped child process 1441, status = succeeded lb # [ 100.564919] niks3-server[988]: 2026/09/20 08:07:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 100.597771] nix-grpc-daemon[1303]: time=2026-09-20T08:07:16.010Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 100.599679] nix-grpc-daemon[1303]: time=2026-09-20T08:07:16.010Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 100.606497] niks3-server[988]: 2026/09/20 08:07:16 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst lb # [ 100.622945] niks3-server[988]: 2026/09/20 08:07:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign worker1 # [ 100.645903] nix-grpc-daemon[1303]: time=2026-09-20T08:07:16.059Z level=INFO msg="Uploading 1 narinfos" lb # [ 100.634104] niks3-server[988]: 2026/09/20 08:07:16 INFO Signed narinfos id=31 count=1 lb # [ 100.639987] niks3-server[988]: 2026/09/20 08:07:16 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 100.652213] niks3-server[988]: 2026/09/20 08:07:16 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 100.660889] niks3-server[988]: 2026/09/20 08:07:16 INFO Completed upload id=31 worker1 # [ 100.676913] nix-grpc-daemon[1303]: time=2026-09-20T08:07:16.090Z level=INFO msg="Upload complete. (572ms)" lb # [ 100.664680] niks3-server[988]: 2026/09/20 08:07:16 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker1 # [ 100.688452] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59008 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 100.696427] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59008 worker1 # [ 100.711168] nix-daemon[889]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) worker1 # [ 100.717145] nix-daemon[889]: reaped child process 1431, status = succeeded client # [ 100.679799] nix[1144]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker1 # [ 100.732242] nix-daemon[889]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 102.672144] systemd-journald[267]: Received client request to rotate journal, rotating. worker2 # [ 102.685553] systemd-journald[267]: Vacuuming done, freed 0B of archived journals from /var/log/journal/225a2a4bc7e34c28a140d7a3045a8018. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 102.766416] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 102.776141] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:18Z level=info event=draining worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds) ??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 573 client: must succeed: sleep 5.0 lb # [ 104.028148] envoy[938]: conn peer=[2001:db8:1::1]:59616 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9467 tx=3828 ms=6692 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker1 # [ 108.175252] nix-daemon[889]: reaped child process 1445, status = succeeded worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 108.358750] nix-daemon[889]: accepted connection from pid 1485, user nix-grpc-daemon (trusted) worker1 # [ 108.382024] nix-daemon[889]: reaped child process 1488, status = succeeded lb # [ 108.379082] niks3-server[988]: 2026/09/20 08:07:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 108.415055] nix-grpc-daemon[1303]: time=2026-09-20T08:07:23.826Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 108.416690] nix-grpc-daemon[1303]: time=2026-09-20T08:07:23.826Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 108.450177] niks3-server[988]: 2026/09/20 08:07:23 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv lb # [ 108.463160] niks3-server[988]: 2026/09/20 08:07:23 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 108.477287] niks3-server[988]: 2026/09/20 08:07:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker1 # [ 108.500231] nix-grpc-daemon[1303]: time=2026-09-20T08:07:23.913Z level=INFO msg="Uploading 1 narinfos" lb # [ 108.486482] niks3-server[988]: 2026/09/20 08:07:23 INFO Signed narinfos id=32 count=1 lb # [ 108.491850] niks3-server[988]: 2026/09/20 08:07:23 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 108.500275] niks3-server[988]: 2026/09/20 08:07:23 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 108.510557] niks3-server[988]: 2026/09/20 08:07:23 INFO Completed upload id=32 worker1 # [ 108.527450] nix-grpc-daemon[1303]: time=2026-09-20T08:07:23.941Z level=INFO msg="Upload complete. (371ms)" lb # [ 108.513585] niks3-server[988]: 2026/09/20 08:07:23 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker1 # [ 108.545472] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59008 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 108.565242] nix-daemon[889]: reaped child process 1443, status = succeeded client # [ 108.538217] systemd[1]: rs.service: Deactivated successfully. client # [ 108.543962] systemd[1]: rs.service: Consumed 174ms CPU time over 8.881s wall clock time, 37M memory peak, 8.4K incoming IP traffic, 8.8K outgoing IP traffic. worker1 # [ 108.777925] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:24Z level=info event=signal_exit worker1 # [ 108.999958] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:24Z level=info event=scheduler_yield lb # [ 108.988245] niks3-server[988]: 2026/09/20 08:07:24 INFO lead: released remote=192.168.1.3:56688 worker1 # [ 109.011437] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:24Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 108.977875] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:24Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 109.017652] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:24Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:45582 worker1 # [ 109.022583] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:24Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 109.026979] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:24Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:45582 worker1 # [ 109.031653] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:24Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 109.213087] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.177552] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.186432] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 109.224347] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" lb # [ 109.223225] niks3-server[988]: 2026/09/20 08:07:24 INFO lead: acquired remote=192.168.1.4:36434 worker2 # [ 109.208774] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:24Z level=info event=scheduler_take_over worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.14 seconds) client: waiting for success: ! systemctl is-active rs worker2 # [ 109.388896] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.425452] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:24Z level=info event=scheduler_connected addr=lb:50051 client: (finished: waiting for success: ! systemctl is-active rs, in 0.08 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } worker2 # [ 109.401669] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:24Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 109.448110] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker1 # [ 109.651725] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.616945] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:25Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=0 running=0 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 10.10 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 109.770940] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 5f58710e494c48a7bd6f0ab2ff4fd592 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds) worker1 # [ 110.002941] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:25Z level=info event=scheduler_restarting worker2 # [ 109.979036] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60108 worker2 # [ 109.984954] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:25Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 110.037589] nix-grpc-daemon[1228]: ts=2026-09-20T08:07:25Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 110.064323] nix-daemon[889]: reaped child process 1294, status = succeeded worker2 # [ 110.049658] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60116 worker2 # [ 110.065455] nix-daemon[838]: accepted connection from pid 1155, user nix-grpc-daemon (trusted) client # [ 110.067380] nix[1179]: don't know how to build these paths: client # [ 110.068976] nix[1179]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker1 # [ 110.119399] nix-grpc-daemon[1228]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 110.124363] nix-grpc-daemon[1228]: E0000 00:00:1789891645.533169 1271 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker1 # [ 110.251701] nix-grpc-daemon[1228]: E0000 00:00:1789891645.665415 1271 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 110.258842] nix-grpc-daemon[1228]: E0000 00:00:1789891645.665679 1271 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true client # [ 111.371276] nix[1179]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting worker1 # [ 111.440094] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 111.441980] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 111.443355] systemd[1]: nix-grpc-daemon.service: Consumed 1.959s CPU time over 25.871s wall clock time, 34.2M memory peak, 45.1K incoming IP traffic, 82.7K outgoing IP traffic. worker1 # [ 111.457224] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 111.661214] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 111.664128] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 111.673991] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 111.675903] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 111.695786] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.664723] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:27Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 111.899274] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:27Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 111.907355] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:27Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 111.948397] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60116 worker2 # [ 111.969223] nix-grpc-daemon[1155]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 1/5) worker2 # [ 111.990341] nix-grpc-daemon[1155]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 196 ms (attempt 2/5) worker2 # [ 112.195089] nix-grpc-daemon[1155]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 3/5) worker2 # [ 112.215418] nix-grpc-daemon[1155]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 302 ms (attempt 4/5) worker2 # [ 112.526119] nix-grpc-daemon[1155]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 112.551121] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60116 client # [ 112.553593] nix[1179]: copying 1 paths to 'lb:50051'... worker2 # [ 112.571916] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60116 client # [ 112.559562] nix[1179]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker2 # [ 112.587617] nix-daemon[838]: accepted connection from pid 1155, user nix-grpc-daemon (trusted) worker2 # [ 112.625712] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:28Z level=info event=niks3_push_started pid=1276 worker2 # [ 113.045395] nix-daemon[838]: accepted connection from pid 1289, user nix-grpc-daemon (trusted) worker2 # [ 113.065865] nix-daemon[838]: reaped child process 1292, status = succeeded worker2 # [ 113.263496] nix-daemon[838]: accepted connection from pid 1294, user nix-grpc-daemon (trusted) worker2 # [ 113.282800] nix-daemon[838]: reaped child process 1297, status = succeeded lb # [ 113.317861] niks3-server[988]: 2026/09/20 08:07:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 113.312160] nix-grpc-daemon[1276]: time=2026-09-20T08:07:28.725Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 113.313735] nix-grpc-daemon[1276]: time=2026-09-20T08:07:28.725Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 113.363118] niks3-server[988]: 2026/09/20 08:07:28 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst lb # [ 113.378982] niks3-server[988]: 2026/09/20 08:07:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign worker2 # [ 113.366544] nix-grpc-daemon[1276]: time=2026-09-20T08:07:28.780Z level=INFO msg="Uploading 1 narinfos" lb # [ 113.390950] niks3-server[988]: 2026/09/20 08:07:28 INFO Signed narinfos id=33 count=1 lb # [ 113.398138] niks3-server[988]: 2026/09/20 08:07:28 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 113.410655] niks3-server[988]: 2026/09/20 08:07:28 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 113.421176] niks3-server[988]: 2026/09/20 08:07:28 INFO Completed upload id=33 worker2 # [ 113.402364] nix-grpc-daemon[1276]: time=2026-09-20T08:07:28.817Z level=INFO msg="Upload complete. (544ms)" lb # [ 113.427772] niks3-server[988]: 2026/09/20 08:07:28 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo worker2 # [ 113.415904] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60116 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 113.432603] nix-grpc-daemon[1155]: ts=2026-09-20T08:07:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60116 worker2 # [ 113.439787] nix-daemon[838]: accepted connection from pid 1155, user nix-grpc-daemon (trusted) worker2 # [ 113.445914] nix-daemon[838]: reaped child process 1274, status = succeeded client # [ 113.444816] nix[1179]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker2 # [ 113.463517] nix-daemon[838]: accepted connection from pid 1155, user nix-grpc-daemon (trusted) lb # [ 114.028631] envoy[938]: conn peer=[2001:db8:1::1]:59628 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2923 tx=1331 ms=8592 lb # [ 114.029148] envoy[938]: conn peer=[2001:db8:1::3]:51148 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2825 tx=1044 ms=24242 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 115.091720] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1155 (nix-grpc-daemon) on client request. worker2 # [ 115.093660] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 115.121442] niks3-server[988]: 2026/09/20 08:07:30 INFO lead: released remote=192.168.1.4:36434 client # [ 115.095599] nix[1179]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 115.145872] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:30Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 115.101020] nix[1179]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.09 seconds) client: must succeed: sleep 5.0 worker2 # [ 115.130551] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 115.137104] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 115.138445] systemd[1]: nix-grpc-daemon.service: Consumed 611ms CPU time over 16.154s wall clock time, 31.5M memory peak, 12.9K incoming IP traffic, 17.5K outgoing IP traffic. worker2 # [ 115.157225] nix-daemon[838]: reaped child process 1259, status = succeeded worker2 # [ 115.158373] nix-daemon[838]: reaped child process 1299, status = succeeded worker2 # [ 115.165291] nix-daemon[1301]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 115.174079] nix-daemon[838]: reaped child process 1301, status = failed with exit code 1 worker1 # [ 115.346206] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.315670] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker2 # [ 115.332813] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 115.560354] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 115.563925] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 115.572108] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 115.587733] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 115.609629] niks3-server[988]: 2026/09/20 08:07:31 INFO lead: acquired remote=192.168.1.4:52524 worker2 # [ 115.595713] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:31Z level=info event=scheduler_take_over worker2 # [ 115.617062] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 115.648929] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 115.619117] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:31Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 115.626923] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:31Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 115.629414] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:31Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 115.678105] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38004 worker2 # [ 115.688245] nix-daemon[838]: accepted connection from pid 1337, user nix-grpc-daemon (trusted) worker2 # [ 115.704206] nix-daemon[838]: accepted connection from pid 1337, user nix-grpc-daemon (trusted) worker2 # [ 115.715808] nix-daemon[838]: accepted connection from pid 1337, user nix-grpc-daemon (trusted) client # [ 115.700724] nix[1179]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker1 # [ 115.851486] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.817437] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:31Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 client: (finished: must succeed: sleep 5.0, in 5.07 seconds) client: waiting for success: ! systemctl is-active mid worker2 # [ 120.753466] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:36Z level=info event=niks3_push_started pid=1416 worker2 # [ 120.797511] nix-daemon[838]: reaped child process 1392, status = succeeded worker2 # [ 121.183329] nix-daemon[838]: accepted connection from pid 1429, user nix-grpc-daemon (trusted) worker2 # [ 121.207095] nix-daemon[838]: reaped child process 1432, status = succeeded lb # [ 121.242136] niks3-server[988]: 2026/09/20 08:07:36 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 121.240151] nix-grpc-daemon[1416]: time=2026-09-20T08:07:36.652Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 121.241720] nix-grpc-daemon[1416]: time=2026-09-20T08:07:36.652Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 121.309553] niks3-server[988]: 2026/09/20 08:07:36 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 121.325332] niks3-server[988]: 2026/09/20 08:07:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign worker2 # [ 121.308304] nix-grpc-daemon[1416]: time=2026-09-20T08:07:36.721Z level=INFO msg="Uploading 1 narinfos" lb # [ 121.339909] niks3-server[988]: 2026/09/20 08:07:36 INFO Signed narinfos id=34 count=1 lb # [ 121.348583] niks3-server[988]: 2026/09/20 08:07:36 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 121.365922] niks3-server[988]: 2026/09/20 08:07:36 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 121.376472] niks3-server[988]: 2026/09/20 08:07:36 INFO Completed upload id=34 worker2 # [ 121.356702] nix-grpc-daemon[1416]: time=2026-09-20T08:07:36.771Z level=INFO msg="Upload complete. (361ms)" worker2 # [ 121.377273] nix-grpc-daemon[1416]: time=2026-09-20T08:07:36.778Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls error="server returned 404: object is not pending upload\n" worker2 # [ 121.400530] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38004 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker2 # [ 121.407926] nix-grpc-daemon[1416]: time=2026-09-20T08:07:36.782Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 121.414470] nix-daemon[838]: reaped child process 1390, status = succeeded client # [ 121.414767] systemd[1]: mid.service: Deactivated successfully. client # [ 121.419787] systemd[1]: mid.service: Consumed 205ms CPU time over 11.648s wall clock time, 38.9M memory peak, 10.1K incoming IP traffic, 11.3K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.17 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 12.06 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 121.800866] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 9c0b6f70acff4486bd31057c67a3a042 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds) worker1 # [ 122.129751] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 122.148877] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) client # [ 122.121620] nix[1214]: don't know how to build these paths: client # [ 122.124965] nix[1214]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker2 # [ 122.158703] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:37Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker2 # [ 122.165341] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:37Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 122.245018] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 122.269249] nix-grpc-daemon[1503]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 1/5) worker1 # [ 122.368459] nix-grpc-daemon[1503]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 196 ms (attempt 2/5) worker1 # [ 122.572801] nix-grpc-daemon[1503]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 3/5) worker1 # [ 122.611775] nix-grpc-daemon[1503]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 306 ms (attempt 4/5) worker1 # [ 122.927017] nix-grpc-daemon[1503]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 122.949168] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48612 client # [ 122.913431] nix[1214]: copying 1 paths to 'lb:50051'... worker1 # [ 122.967855] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 client # [ 122.921955] nix[1214]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker1 # [ 122.985182] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 123.019228] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:38Z level=info event=niks3_push_started pid=1587 worker1 # [ 123.468565] nix-daemon[889]: accepted connection from pid 1604, user nix-grpc-daemon (trusted) worker1 # [ 123.493927] nix-daemon[889]: reaped child process 1607, status = succeeded worker1 # [ 123.685062] nix-daemon[889]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker1 # [ 123.705847] nix-daemon[889]: reaped child process 1612, status = succeeded lb # [ 123.702922] niks3-server[988]: 2026/09/20 08:07:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 123.739533] nix-grpc-daemon[1587]: time=2026-09-20T08:07:39.151Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 123.741538] nix-grpc-daemon[1587]: time=2026-09-20T08:07:39.151Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 123.773859] niks3-server[988]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst lb # [ 123.782243] niks3-server[988]: 2026/09/20 08:07:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign worker1 # [ 123.804994] nix-grpc-daemon[1587]: time=2026-09-20T08:07:39.218Z level=INFO msg="Uploading 1 narinfos" lb # [ 123.791482] niks3-server[988]: 2026/09/20 08:07:39 INFO Signed narinfos id=35 count=1 lb # [ 123.799294] niks3-server[988]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 123.810770] niks3-server[988]: 2026/09/20 08:07:39 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 123.823907] niks3-server[988]: 2026/09/20 08:07:39 INFO Completed upload id=35 worker1 # [ 123.840647] nix-grpc-daemon[1587]: time=2026-09-20T08:07:39.254Z level=INFO msg="Upload complete. (568ms)" worker1 # [ 123.849618] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=0 paths=1 nar_bytes_in=424 lb # [ 123.834379] niks3-server[988]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo worker1 # [ 123.862041] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 123.867603] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 123.872210] nix-daemon[889]: reaped child process 1585, status = succeeded worker1 # [ 123.883013] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) client # [ 123.833464] nix[1214]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... lb # [ 124.026037] envoy[938]: conn peer=[2001:db8:1::4]:59486 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=786 tx=389 ms=15900 lb # [ 124.031937] envoy[938]: conn peer=[2001:db8:1::1]:57654 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4071 tx=1825 ms=11347 client: must succeed: systemctl kill -s INT intr client # [ 125.584916] systemd[1]: intr.service: Sent signal SIGINT to main process 1214 (nix) on client request. client # [ 125.595360] nix[1214]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 125.600206] nix[1214]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds) client # [ 125.643017] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 125.645661] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 125.649401] systemd[1]: intr.service: Consumed 171ms CPU time over 3.847s wall clock time, 39.2M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic. worker1 # [ 125.731349] nix-daemon[889]: reaped child process 1614, status = succeeded worker1 # [ 125.735482] nix-daemon[1616]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 125.746659] nix-daemon[889]: reaped child process 1616, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 4.02 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 125.860660] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: f06f689a164b4d8cb0e76de2bcdfaa9a client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.11 seconds) client # [ 126.128811] nix[1233]: don't know how to build these paths: client # [ 126.130626] nix[1233]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker1 # [ 126.178682] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48612 worker2 # [ 126.162036] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:41Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker2 # [ 126.168889] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:41Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 126.216575] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38004 worker2 # [ 126.237342] nix-grpc-daemon[1337]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 34 ms (attempt 1/5) worker2 # [ 126.279587] nix-grpc-daemon[1337]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 2/5) worker2 # [ 126.338812] nix-grpc-daemon[1337]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 24 ms (attempt 3/5) worker2 # [ 126.370841] nix-grpc-daemon[1337]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 174 ms (attempt 4/5) worker2 # [ 126.546105] nix-grpc-daemon[1337]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 126.571307] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38004 client # [ 126.569635] nix[1233]: copying 1 paths to 'lb:50051'... worker2 # [ 126.589947] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38004 client # [ 126.577110] nix[1233]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker2 # [ 126.601313] nix-daemon[838]: accepted connection from pid 1337, user nix-grpc-daemon (trusted) worker2 # [ 126.802645] nix-daemon[838]: accepted connection from pid 1467, user nix-grpc-daemon (trusted) worker2 # [ 126.824187] nix-daemon[838]: reaped child process 1470, status = succeeded worker2 # [ 127.013117] nix-daemon[838]: accepted connection from pid 1472, user nix-grpc-daemon (trusted) worker2 # [ 127.032779] nix-daemon[838]: reaped child process 1475, status = succeeded lb # [ 127.065908] niks3-server[988]: 2026/09/20 08:07:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 127.071031] nix-grpc-daemon[1416]: time=2026-09-20T08:07:42.484Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 127.072974] nix-grpc-daemon[1416]: time=2026-09-20T08:07:42.485Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 127.120065] niks3-server[988]: 2026/09/20 08:07:42 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst lb # [ 127.136490] niks3-server[988]: 2026/09/20 08:07:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign worker2 # [ 127.124830] nix-grpc-daemon[1416]: time=2026-09-20T08:07:42.539Z level=INFO msg="Uploading 1 narinfos" lb # [ 127.148621] niks3-server[988]: 2026/09/20 08:07:42 INFO Signed narinfos id=36 count=1 lb # [ 127.156221] niks3-server[988]: 2026/09/20 08:07:42 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 127.171814] niks3-server[988]: 2026/09/20 08:07:42 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 127.184148] niks3-server[988]: 2026/09/20 08:07:42 INFO Completed upload id=36 worker2 # [ 127.165086] nix-grpc-daemon[1416]: time=2026-09-20T08:07:42.579Z level=INFO msg="Upload complete. (551ms)" lb # [ 127.188334] niks3-server[988]: 2026/09/20 08:07:42 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker2 # [ 127.177076] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38004 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 127.202570] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38004 worker2 # [ 127.223230] nix-daemon[838]: accepted connection from pid 1337, user nix-grpc-daemon (trusted) worker2 # [ 127.237296] nix-daemon[838]: reaped child process 1465, status = succeeded client # [ 127.242127] nix[1233]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker2 # [ 127.260462] nix-daemon[838]: accepted connection from pid 1337, user nix-grpc-daemon (trusted) worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2 worker2 # Checking switch inhibitors... done worker2 # [ 129.530591] nixos[1510]: switching to system configuration /nix/store/q7709i2x0pwr1zmdprjl9s48xrm2sd55-nixos-system-worker2-test worker2 # [ 129.533480] systemd[1]: Stopped target Remote File Systems. worker2 # [ 129.536893] systemd[1]: Stopped target Local File Systems. worker2 # activating the configuration... worker2 # setting up /etc... worker2 # [ 130.407144] systemd[1]: Reload requested from client PID 1510 ('.switch-to-conf') (unit backdoor.service)... worker2 # [ 130.409978] systemd[1]: Reloading... worker2 # [ 131.382876] systemd[1]: Reloading finished in 971 ms. worker2 # restarting sysinit-reactivation.target worker2 # [ 131.477955] systemd[1]: Starting Re-setup tmpfiles on a system that is already running.... worker2 # [ 131.645358] systemd[1]: Finished Re-setup tmpfiles on a system that is already running.. worker2 # [ 131.646606] systemd[1]: Reached target Reactivate sysinit units. worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service worker2 # [ 131.652662] systemd[1]: Reloading D-Bus System Message Bus... worker2 # [ 131.658183] dbus-broker-launch[492]: Caught SIGHUP, trigger reload. worker2 # [ 131.665135] systemd[1]: Reloading Nix worker-protocol over gRPC... worker2 # [ 131.688153] dbus-broker-launch[492]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 131.692321] dbus-broker-launch[492]: NSS returned no entry for 'systemd-timesync' worker2 # [ 131.693779] dbus-broker-launch[492]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 131.720493] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker2 # [ 131.744642] systemd[1]: Reloaded D-Bus System Message Bus. worker2 # [ 131.753152] systemd[1]: Reached target Remote File Systems. worker2 # [ 131.759514] systemd[1]: Reached target Local File Systems. worker2 # [ 131.762550] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 131.766953] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 131.773410] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 131.781548] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 131.783733] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 131.792386] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 131.796381] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 131.798998] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 131.802504] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 132.312266] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 132.313373] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 132.318130] systemd[1]: Starting linger-users.service... worker2 # [ 132.383896] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 132.388185] systemd[1]: Finished linger-users.service. worker2 # [ 132.583580] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:47Z level=info event=draining worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service worker2 # [ 132.637706] nixos[1510]: finished switching to system configuration /nix/store/q7709i2x0pwr1zmdprjl9s48xrm2sd55-nixos-system-worker2-test worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 4.00 seconds) worker2: must succeed: pgrep -f 'read -t [9]0 x' worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&2 worker1 # [ 133.038603] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48612 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 133.024528] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:48Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker2 # [ 133.027129] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:48Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 133.109738] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 133.129832] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48612 client # copying 1 paths to 'lb:50051'... worker1 # [ 133.148775] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker1 # [ 133.176777] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 133.418194] nix-daemon[889]: accepted connection from pid 1662, user nix-grpc-daemon (trusted) worker1 # [ 133.439920] nix-daemon[889]: reaped child process 1665, status = succeeded worker1 # [ 133.635405] nix-daemon[889]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker1 # [ 133.657927] nix-daemon[889]: reaped child process 1670, status = succeeded lb # [ 133.655741] niks3-server[988]: 2026/09/20 08:07:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 133.686727] nix-grpc-daemon[1587]: time=2026-09-20T08:07:49.099Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 133.688764] nix-grpc-daemon[1587]: time=2026-09-20T08:07:49.099Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 133.699812] niks3-server[988]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst worker1 # [ 133.732287] nix-grpc-daemon[1587]: time=2026-09-20T08:07:49.146Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.715798] niks3-server[988]: 2026/09/20 08:07:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 133.726768] niks3-server[988]: 2026/09/20 08:07:49 INFO Signed narinfos id=37 count=1 lb # [ 133.733877] niks3-server[988]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 133.744412] niks3-server[988]: 2026/09/20 08:07:49 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 133.752798] niks3-server[988]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo lb # [ 133.758866] niks3-server[988]: 2026/09/20 08:07:49 INFO Completed upload id=37 worker1 # [ 133.775602] nix-grpc-daemon[1587]: time=2026-09-20T08:07:49.189Z level=INFO msg="Upload complete. (578ms)" worker1 # [ 133.786815] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=0 paths=1 nar_bytes_in=528 worker1 # [ 133.808646] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 133.817089] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 133.825255] nix-daemon[889]: reaped child process 1660, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker1 # [ 133.842949] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) lb # [ 134.027632] envoy[938]: conn peer=[2001:db8:1::1]:53972 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2931 tx=754 ms=3566 client # farm-a> LOG-farm-a-during-drain worker1 # [ 135.278277] nix-daemon[889]: reaped child process 1674, status = succeeded worker1 # [ 135.445721] nix-daemon[889]: accepted connection from pid 1689, user nix-grpc-daemon (trusted) worker1 # [ 135.465648] nix-daemon[889]: reaped child process 1692, status = succeeded lb # [ 135.462662] niks3-server[988]: 2026/09/20 08:07:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 135.492429] nix-grpc-daemon[1587]: time=2026-09-20T08:07:50.905Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 135.497857] nix-grpc-daemon[1587]: time=2026-09-20T08:07:50.905Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 135.509482] niks3-server[988]: 2026/09/20 08:07:50 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 135.524248] niks3-server[988]: 2026/09/20 08:07:50 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 135.538366] niks3-server[988]: 2026/09/20 08:07:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign worker1 # [ 135.563045] nix-grpc-daemon[1587]: time=2026-09-20T08:07:50.975Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.546185] niks3-server[988]: 2026/09/20 08:07:50 INFO Signed narinfos id=38 count=1 lb # [ 135.550078] niks3-server[988]: 2026/09/20 08:07:50 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 135.568112] niks3-server[988]: 2026/09/20 08:07:50 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 135.576975] niks3-server[988]: 2026/09/20 08:07:50 INFO Completed upload id=38 worker1 # [ 135.593699] nix-grpc-daemon[1587]: time=2026-09-20T08:07:51.007Z level=INFO msg="Upload complete. (335ms)" lb # [ 135.580232] niks3-server[988]: 2026/09/20 08:07:50 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker2 # [ 135.572198] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:50Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker2 # [ 135.574131] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:50Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 135.605198] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker1 # [ 135.626248] nix-daemon[889]: reaped child process 1672, status = succeeded worker1 # [ 135.653157] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 135.669494] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 135.685077] nix-grpc-daemon[1587]: time=2026-09-20T08:07:51.099Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 135.701248] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker1 # [ 135.724246] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 135.939954] nix-daemon[889]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 135.958749] nix-daemon[889]: reaped child process 1699, status = succeeded worker1 # [ 136.134419] nix-daemon[889]: accepted connection from pid 1701, user nix-grpc-daemon (trusted) worker1 # [ 136.152519] nix-daemon[889]: reaped child process 1704, status = succeeded lb # [ 136.148075] niks3-server[988]: 2026/09/20 08:07:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 136.173644] nix-grpc-daemon[1587]: time=2026-09-20T08:07:51.587Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 136.175151] nix-grpc-daemon[1587]: time=2026-09-20T08:07:51.587Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 136.177182] niks3-server[988]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst worker1 # [ 136.205065] nix-grpc-daemon[1587]: time=2026-09-20T08:07:51.618Z level=INFO msg="Uploading 1 narinfos" lb # [ 136.193496] niks3-server[988]: 2026/09/20 08:07:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 136.203274] niks3-server[988]: 2026/09/20 08:07:51 INFO Signed narinfos id=39 count=1 lb # [ 136.211611] niks3-server[988]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls lb # [ 136.216834] niks3-server[988]: 2026/09/20 08:07:51 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 136.220472] niks3-server[988]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo lb # [ 136.224629] niks3-server[988]: 2026/09/20 08:07:51 INFO Completed upload id=39 worker1 # [ 136.240951] nix-grpc-daemon[1587]: time=2026-09-20T08:07:51.654Z level=INFO msg="Upload complete. (497ms)" worker1 # [ 136.248724] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 136.263384] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 136.269939] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 136.274666] nix-daemon[889]: reaped child process 1694, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... worker1 # [ 136.287484] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv client # farm-b> LOG-farm-b-during-drain worker1 # [ 137.937188] nix-daemon[889]: reaped child process 1708, status = succeeded worker1 # [ 138.143598] nix-daemon[889]: accepted connection from pid 1723, user nix-grpc-daemon (trusted) worker1 # [ 138.164986] nix-daemon[889]: reaped child process 1726, status = succeeded lb # [ 138.164881] niks3-server[988]: 2026/09/20 08:07:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 138.195202] nix-grpc-daemon[1587]: time=2026-09-20T08:07:53.607Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 138.196981] nix-grpc-daemon[1587]: time=2026-09-20T08:07:53.608Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 138.204552] niks3-server[988]: 2026/09/20 08:07:53 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 138.225478] niks3-server[988]: 2026/09/20 08:07:53 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst worker1 # [ 138.250596] nix-grpc-daemon[1587]: time=2026-09-20T08:07:53.664Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.236886] niks3-server[988]: 2026/09/20 08:07:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 138.243898] niks3-server[988]: 2026/09/20 08:07:53 INFO Signed narinfos id=40 count=1 lb # [ 138.252689] niks3-server[988]: 2026/09/20 08:07:53 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 138.292875] niks3-server[988]: 2026/09/20 08:07:53 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 138.302047] niks3-server[988]: 2026/09/20 08:07:53 INFO Completed upload id=40 worker1 # [ 138.318796] nix-grpc-daemon[1587]: time=2026-09-20T08:07:53.732Z level=INFO msg="Upload complete. (416ms)" lb # [ 138.307382] niks3-server[988]: 2026/09/20 08:07:53 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker2 # [ 138.302656] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:53Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker1 # [ 138.333307] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=2 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker2 # [ 138.304706] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:53Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 138.353516] nix-daemon[889]: reaped child process 1706, status = succeeded worker1 # [ 138.389522] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 138.407259] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 138.422790] nix-grpc-daemon[1587]: time=2026-09-20T08:07:53.836Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker1 # [ 138.434254] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 138.448351] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 138.661224] nix-daemon[889]: accepted connection from pid 1730, user nix-grpc-daemon (trusted) worker1 # [ 138.681034] nix-daemon[889]: reaped child process 1733, status = succeeded worker1 # [ 138.858498] nix-daemon[889]: accepted connection from pid 1735, user nix-grpc-daemon (trusted) worker1 # [ 138.879117] nix-daemon[889]: reaped child process 1738, status = succeeded lb # [ 138.876179] niks3-server[988]: 2026/09/20 08:07:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 138.906262] nix-grpc-daemon[1587]: time=2026-09-20T08:07:54.319Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 138.907857] nix-grpc-daemon[1587]: time=2026-09-20T08:07:54.319Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 138.904768] niks3-server[988]: 2026/09/20 08:07:54 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst lb # [ 138.915516] niks3-server[988]: 2026/09/20 08:07:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign worker1 # [ 138.936792] nix-grpc-daemon[1587]: time=2026-09-20T08:07:54.350Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.920126] niks3-server[988]: 2026/09/20 08:07:54 INFO Signed narinfos id=41 count=1 lb # [ 138.924520] niks3-server[988]: 2026/09/20 08:07:54 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 138.932052] niks3-server[988]: 2026/09/20 08:07:54 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete worker1 # [ 138.953555] nix-grpc-daemon[1587]: time=2026-09-20T08:07:54.367Z level=INFO msg="Upload complete. (487ms)" lb # [ 138.937528] niks3-server[988]: 2026/09/20 08:07:54 INFO Completed upload id=41 lb # [ 138.940411] niks3-server[988]: 2026/09/20 08:07:54 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker1 # [ 138.960176] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 138.969206] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 138.974278] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 138.978185] nix-daemon[889]: reaped child process 1728, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... worker1 # [ 138.989342] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv client # farm-top> LOG-farm-top-during-drain worker1 # [ 140.431030] nix-daemon[889]: reaped child process 1742, status = succeeded worker1 # [ 140.616567] nix-daemon[889]: accepted connection from pid 1757, user nix-grpc-daemon (trusted) worker1 # [ 140.635262] nix-daemon[889]: reaped child process 1760, status = succeeded lb # [ 140.632603] niks3-server[988]: 2026/09/20 08:07:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 140.660520] nix-grpc-daemon[1587]: time=2026-09-20T08:07:56.072Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 140.662475] nix-grpc-daemon[1587]: time=2026-09-20T08:07:56.072Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 140.670705] niks3-server[988]: 2026/09/20 08:07:56 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 140.683614] niks3-server[988]: 2026/09/20 08:07:56 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 140.691748] niks3-server[988]: 2026/09/20 08:07:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker1 # [ 140.714825] nix-grpc-daemon[1587]: time=2026-09-20T08:07:56.128Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.697814] niks3-server[988]: 2026/09/20 08:07:56 INFO Signed narinfos id=42 count=1 lb # [ 140.702365] niks3-server[988]: 2026/09/20 08:07:56 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 140.716391] niks3-server[988]: 2026/09/20 08:07:56 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 140.723870] niks3-server[988]: 2026/09/20 08:07:56 INFO Completed upload id=42 worker1 # [ 140.740581] nix-grpc-daemon[1587]: time=2026-09-20T08:07:56.154Z level=INFO msg="Upload complete. (341ms)" lb # [ 140.727211] niks3-server[988]: 2026/09/20 08:07:56 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker1 # [ 140.753150] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker1 # [ 140.771218] nix-daemon[889]: reaped child process 1740, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&2, in 8.05 seconds) client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath, in 0.24 seconds) worker2: must succeed: pkill -f 'read -t [9]0 x' worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker2 # [ 141.102825] nix-daemon[838]: reaped child process 1483, status = succeeded worker2 # [ 141.269795] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker2 # [ 141.290412] nix-daemon[838]: reaped child process 1659, status = succeeded lb # [ 141.323443] niks3-server[988]: 2026/09/20 08:07:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 141.314297] nix-grpc-daemon[1416]: time=2026-09-20T08:07:56.728Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 141.315836] nix-grpc-daemon[1416]: time=2026-09-20T08:07:56.728Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 141.356694] niks3-server[988]: 2026/09/20 08:07:56 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 141.372792] niks3-server[988]: 2026/09/20 08:07:56 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv lb # [ 141.380673] niks3-server[988]: 2026/09/20 08:07:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 141.386186] niks3-server[988]: 2026/09/20 08:07:56 INFO Signed narinfos id=43 count=1 worker2 # [ 141.368037] nix-grpc-daemon[1416]: time=2026-09-20T08:07:56.781Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.389954] niks3-server[988]: 2026/09/20 08:07:56 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 141.399898] niks3-server[988]: 2026/09/20 08:07:56 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 141.407110] niks3-server[988]: 2026/09/20 08:07:56 INFO Completed upload id=43 worker2 # [ 141.388010] nix-grpc-daemon[1416]: time=2026-09-20T08:07:56.802Z level=INFO msg="Upload complete. (297ms)" lb # [ 141.409915] niks3-server[988]: 2026/09/20 08:07:56 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker2 # [ 141.398525] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38004 duration_s=14 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 worker2 # [ 141.415380] nix-daemon[838]: reaped child process 1480, status = succeeded client # [ 141.428579] systemd[1]: sw.service: Deactivated successfully. client # [ 141.433242] systemd[1]: sw.service: Consumed 187ms CPU time over 15.571s wall clock time, 36.9M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic. worker2 # [ 141.585526] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:57Z level=info event=signal_exit worker2 # [ 141.817978] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:57Z level=info event=scheduler_yield worker2 # [ 141.826633] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:57Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 141.863554] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:57Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 141.838363] niks3-server[988]: 2026/09/20 08:07:57 INFO lead: released remote=192.168.1.4:52524 worker2 # [ 141.832990] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:57Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37968 worker2 # [ 141.838882] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:57Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 141.843263] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:57Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37968 worker2 # [ 141.847791] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:57Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 142.027895] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 142.063569] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 142.074772] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 142.056852] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } worker1 # [ 142.275918] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 142.281320] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds) worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 142.258292] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 142.264404] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 142.482079] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 142.487430] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 142.466390] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 142.471580] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 142.688746] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 142.695574] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 142.672183] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 142.677496] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 142.823343] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:58Z level=info event=scheduler_restarting worker2 # [ 142.855277] nix-daemon[838]: reaped child process 1388, status = succeeded worker1 # [ 142.897417] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 142.862083] nix-grpc-daemon[1337]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 142.866828] nix-grpc-daemon[1337]: E0000 00:00:1789891678.276807 1380 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker2 # [ 142.895119] nix-grpc-daemon[1337]: ts=2026-09-20T08:07:58Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 143.642511] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:59Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure" worker2 # [ 143.628435] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 143.633241] systemd[1]: nix-grpc-daemon.service: Consumed 977ms CPU time over 28.503s wall clock time, 31.9M memory peak, 24.2K incoming IP traffic, 32.3K outgoing IP traffic. worker2 # [ 143.659019] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 143.843452] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 143.850816] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 143.863756] nix-grpc-daemon[1673]: ts=2026-09-20T08:07:59Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 143.866496] nix-grpc-daemon[1673]: ts=2026-09-20T08:07:59Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 143.874770] nix-grpc-daemon[1673]: ts=2026-09-20T08:07:59Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 143.894712] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 143.896898] nix-grpc-daemon[1673]: ts=2026-09-20T08:07:59Z level=info event=scheduler_take_over lb # [ 143.916647] niks3-server[988]: 2026/09/20 08:07:59 INFO lead: acquired remote=192.168.1.4:33318 worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.65 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 143.913071] nix-grpc-daemon[1673]: ts=2026-09-20T08:07:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 143.918248] nix-grpc-daemon[1673]: ts=2026-09-20T08:07:59Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb # [ 144.029045] envoy[938]: conn peer=[2001:db8:1::1]:54330 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9512 tx=3846 ms=7731 lb # [ 144.031749] envoy[938]: conn peer=[2001:db8:1::1]:53984 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2939 tx=1353 ms=15273 lb # [ 144.037453] envoy[938]: conn peer=[2001:db8:1::4]:40706 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1401 tx=529 ms=27277 worker1 # [ 144.053242] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 144.059759] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 144.260777] nix-grpc-daemon[1503]: ts=2026-09-20T08:07:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 144.227510] nix-grpc-daemon[1673]: ts=2026-09-20T08:07:59Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 19.44 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 145.482208] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:33524 worker2 # [ 145.495520] nix-daemon[838]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) worker2 # [ 145.526724] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:00Z level=debug event=want client=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker2 # [ 145.534041] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:00Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 145.540315] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:00Z level=debug event=want client=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker2 # [ 145.545498] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:00Z level=debug event=want client=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 145.619631] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 145.637190] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 145.653403] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 145.670097] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 145.884038] nix-daemon[889]: accepted connection from pid 1764, user nix-grpc-daemon (trusted) worker1 # [ 145.904526] nix-daemon[889]: reaped child process 1767, status = succeeded worker1 # [ 146.080322] nix-daemon[889]: accepted connection from pid 1769, user nix-grpc-daemon (trusted) worker1 # [ 146.100187] nix-daemon[889]: reaped child process 1772, status = succeeded lb # [ 146.097516] niks3-server[988]: 2026/09/20 08:08:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 146.124512] nix-grpc-daemon[1587]: time=2026-09-20T08:08:01.537Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 146.126034] nix-grpc-daemon[1587]: time=2026-09-20T08:08:01.537Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 146.127424] niks3-server[988]: 2026/09/20 08:08:01 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst worker1 # [ 146.166542] nix-grpc-daemon[1587]: time=2026-09-20T08:08:01.580Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.143797] niks3-server[988]: 2026/09/20 08:08:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 146.155694] niks3-server[988]: 2026/09/20 08:08:01 INFO Signed narinfos id=44 count=1 lb # [ 146.161768] niks3-server[988]: 2026/09/20 08:08:01 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 146.169942] niks3-server[988]: 2026/09/20 08:08:01 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 146.174635] niks3-server[988]: 2026/09/20 08:08:01 INFO Completed upload id=44 worker1 # [ 146.190593] nix-grpc-daemon[1587]: time=2026-09-20T08:08:01.604Z level=INFO msg="Upload complete. (502ms)" lb # [ 146.177493] niks3-server[988]: 2026/09/20 08:08:01 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 146.200313] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 146.212324] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 146.219330] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 146.224076] nix-daemon[889]: reaped child process 1762, status = succeeded worker1 # [ 146.237221] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 147.265036] nix-daemon[889]: reaped child process 1776, status = succeeded worker1 # [ 147.428512] nix-daemon[889]: accepted connection from pid 1791, user nix-grpc-daemon (trusted) worker1 # [ 147.446296] nix-daemon[889]: reaped child process 1794, status = succeeded lb # [ 147.443228] niks3-server[988]: 2026/09/20 08:08:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 147.471195] nix-grpc-daemon[1587]: time=2026-09-20T08:08:02.882Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 147.472816] nix-grpc-daemon[1587]: time=2026-09-20T08:08:02.882Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 147.482405] niks3-server[988]: 2026/09/20 08:08:02 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst worker1 # [ 147.510771] nix-grpc-daemon[1587]: time=2026-09-20T08:08:02.924Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.497668] niks3-server[988]: 2026/09/20 08:08:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 147.508739] niks3-server[988]: 2026/09/20 08:08:02 INFO Signed narinfos id=45 count=1 lb # [ 147.511040] niks3-server[988]: 2026/09/20 08:08:02 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 147.516627] niks3-server[988]: 2026/09/20 08:08:02 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 147.527110] niks3-server[988]: 2026/09/20 08:08:02 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete worker1 # [ 147.543722] nix-grpc-daemon[1587]: time=2026-09-20T08:08:02.957Z level=INFO msg="Upload complete. (297ms)" lb # [ 147.530890] niks3-server[988]: 2026/09/20 08:08:02 INFO Completed upload id=45 lb # [ 147.535047] niks3-server[988]: 2026/09/20 08:08:02 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker1 # [ 147.557105] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=1 outputs=1 worker2 # [ 147.521453] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:02Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 147.569525] nix-daemon[889]: reaped child process 1774, status = succeeded worker2 # [ 147.533802] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:02Z level=debug event=want client=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 147.600436] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 147.616400] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 147.631134] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 147.645036] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 147.843046] nix-daemon[889]: accepted connection from pid 1798, user nix-grpc-daemon (trusted) worker1 # [ 147.862189] nix-daemon[889]: reaped child process 1801, status = succeeded worker1 # [ 148.038102] nix-daemon[889]: accepted connection from pid 1803, user nix-grpc-daemon (trusted) worker1 # [ 148.056418] nix-daemon[889]: reaped child process 1806, status = succeeded lb # [ 148.050575] niks3-server[988]: 2026/09/20 08:08:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.075777] nix-grpc-daemon[1587]: time=2026-09-20T08:08:03.489Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 148.077461] nix-grpc-daemon[1587]: time=2026-09-20T08:08:03.489Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 148.076563] niks3-server[988]: 2026/09/20 08:08:03 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst worker1 # [ 148.106561] nix-grpc-daemon[1587]: time=2026-09-20T08:08:03.520Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.091619] niks3-server[988]: 2026/09/20 08:08:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 148.102779] niks3-server[988]: 2026/09/20 08:08:03 INFO Signed narinfos id=46 count=1 lb # [ 148.109057] niks3-server[988]: 2026/09/20 08:08:03 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 148.115967] niks3-server[988]: 2026/09/20 08:08:03 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 148.122397] niks3-server[988]: 2026/09/20 08:08:03 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo lb # [ 148.127923] niks3-server[988]: 2026/09/20 08:08:03 INFO Completed upload id=46 worker1 # [ 148.145610] nix-grpc-daemon[1587]: time=2026-09-20T08:08:03.559Z level=INFO msg="Upload complete. (486ms)" worker1 # [ 148.153790] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 148.167732] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 148.173697] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 148.178757] nix-daemon[889]: reaped child process 1796, status = succeeded worker1 # [ 148.190088] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 149.832855] nix-daemon[889]: reaped child process 1810, status = succeeded worker1 # [ 150.005148] nix-daemon[889]: accepted connection from pid 1825, user nix-grpc-daemon (trusted) worker1 # [ 150.023264] nix-daemon[889]: reaped child process 1828, status = succeeded lb # [ 150.019360] niks3-server[988]: 2026/09/20 08:08:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.048410] nix-grpc-daemon[1587]: time=2026-09-20T08:08:05.459Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 150.049882] nix-grpc-daemon[1587]: time=2026-09-20T08:08:05.459Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 150.061854] niks3-server[988]: 2026/09/20 08:08:05 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 150.074764] niks3-server[988]: 2026/09/20 08:08:05 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 150.084335] niks3-server[988]: 2026/09/20 08:08:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign worker1 # [ 150.107205] nix-grpc-daemon[1587]: time=2026-09-20T08:08:05.520Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.090274] niks3-server[988]: 2026/09/20 08:08:05 INFO Signed narinfos id=47 count=1 lb # [ 150.095116] niks3-server[988]: 2026/09/20 08:08:05 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 150.104323] niks3-server[988]: 2026/09/20 08:08:05 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 150.111877] niks3-server[988]: 2026/09/20 08:08:05 INFO Completed upload id=47 lb # [ 150.114830] niks3-server[988]: 2026/09/20 08:08:05 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker1 # [ 150.128210] nix-grpc-daemon[1587]: time=2026-09-20T08:08:05.542Z level=INFO msg="Upload complete. (323ms)" worker2 # [ 150.103838] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:05Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 150.141790] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=2 outputs=1 worker2 # [ 150.115510] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:05Z level=debug event=want client=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 150.156423] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 150.167688] nix-daemon[889]: reaped child process 1808, status = succeeded worker1 # [ 150.172808] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 150.182552] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 150.194653] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 150.390381] nix-daemon[889]: accepted connection from pid 1832, user nix-grpc-daemon (trusted) worker1 # [ 150.409603] nix-daemon[889]: reaped child process 1835, status = succeeded worker1 # [ 150.585325] nix-daemon[889]: accepted connection from pid 1837, user nix-grpc-daemon (trusted) worker1 # [ 150.604865] nix-daemon[889]: reaped child process 1840, status = succeeded lb # [ 150.602168] niks3-server[988]: 2026/09/20 08:08:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.627770] nix-grpc-daemon[1587]: time=2026-09-20T08:08:06.041Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 150.629443] nix-grpc-daemon[1587]: time=2026-09-20T08:08:06.041Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 150.630552] niks3-server[988]: 2026/09/20 08:08:06 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst worker1 # [ 150.660111] nix-grpc-daemon[1587]: time=2026-09-20T08:08:06.073Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.645544] niks3-server[988]: 2026/09/20 08:08:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 150.657203] niks3-server[988]: 2026/09/20 08:08:06 INFO Signed narinfos id=48 count=1 lb # [ 150.663449] niks3-server[988]: 2026/09/20 08:08:06 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls worker1 # [ 150.688837] nix-grpc-daemon[1587]: time=2026-09-20T08:08:06.102Z level=INFO msg="Upload complete. (481ms)" lb # [ 150.673116] niks3-server[988]: 2026/09/20 08:08:06 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 150.678888] niks3-server[988]: 2026/09/20 08:08:06 INFO Completed upload id=48 worker1 # [ 150.695222] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 150.682586] niks3-server[988]: 2026/09/20 08:08:06 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 150.704467] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 150.714496] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 150.718841] nix-daemon[889]: reaped child process 1830, status = succeeded worker1 # [ 150.731027] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 152.163940] nix-daemon[889]: reaped child process 1844, status = succeeded worker1 # [ 152.329832] nix-daemon[889]: accepted connection from pid 1859, user nix-grpc-daemon (trusted) worker1 # [ 152.349532] nix-daemon[889]: reaped child process 1862, status = succeeded lb # [ 152.347692] niks3-server[988]: 2026/09/20 08:08:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.374522] nix-grpc-daemon[1587]: time=2026-09-20T08:08:07.787Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 152.376004] nix-grpc-daemon[1587]: time=2026-09-20T08:08:07.787Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 152.380571] niks3-server[988]: 2026/09/20 08:08:07 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 152.396805] niks3-server[988]: 2026/09/20 08:08:07 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 152.408803] niks3-server[988]: 2026/09/20 08:08:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker1 # [ 152.430503] nix-grpc-daemon[1587]: time=2026-09-20T08:08:07.844Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.417533] niks3-server[988]: 2026/09/20 08:08:07 INFO Signed narinfos id=49 count=1 lb # [ 152.422804] niks3-server[988]: 2026/09/20 08:08:07 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 152.431757] niks3-server[988]: 2026/09/20 08:08:07 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 152.440375] niks3-server[988]: 2026/09/20 08:08:07 INFO Completed upload id=49 worker1 # [ 152.456960] nix-grpc-daemon[1587]: time=2026-09-20T08:08:07.870Z level=INFO msg="Upload complete. (315ms)" lb # [ 152.443500] niks3-server[988]: 2026/09/20 08:08:07 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker2 # [ 152.431163] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:07Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 152.469376] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=3 outputs=1 worker2 # [ 152.444432] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:07Z level=debug event=want client=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 152.488448] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 152.495960] nix-daemon[889]: reaped child process 1842, status = succeeded worker1 # [ 152.516953] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 152.532044] nix-grpc-daemon[1587]: time=2026-09-20T08:08:07.946Z level=INFO msg="All 1 paths already cached" worker1 # [ 152.541700] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 152.557740] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 152.756546] nix-daemon[889]: accepted connection from pid 1866, user nix-grpc-daemon (trusted) worker1 # [ 152.776816] nix-daemon[889]: reaped child process 1869, status = succeeded worker1 # [ 152.957541] nix-daemon[889]: accepted connection from pid 1871, user nix-grpc-daemon (trusted) worker1 # [ 152.976216] nix-daemon[889]: reaped child process 1874, status = succeeded lb # [ 152.974460] niks3-server[988]: 2026/09/20 08:08:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.999864] nix-grpc-daemon[1587]: time=2026-09-20T08:08:08.413Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 153.001647] nix-grpc-daemon[1587]: time=2026-09-20T08:08:08.413Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 153.001850] niks3-server[988]: 2026/09/20 08:08:08 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst worker1 # [ 153.032109] nix-grpc-daemon[1587]: time=2026-09-20T08:08:08.445Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.017122] niks3-server[988]: 2026/09/20 08:08:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 153.026602] niks3-server[988]: 2026/09/20 08:08:08 INFO Signed narinfos id=50 count=1 lb # [ 153.034660] niks3-server[988]: 2026/09/20 08:08:08 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 153.041213] niks3-server[988]: 2026/09/20 08:08:08 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 153.047269] niks3-server[988]: 2026/09/20 08:08:08 INFO Completed upload id=50 worker1 # [ 153.063853] nix-grpc-daemon[1587]: time=2026-09-20T08:08:08.477Z level=INFO msg="Upload complete. (489ms)" lb # [ 153.050138] niks3-server[988]: 2026/09/20 08:08:08 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 153.072275] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 153.085900] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 153.092683] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 153.098127] nix-daemon[889]: reaped child process 1864, status = succeeded worker1 # [ 153.111698] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 154.342994] nix-daemon[889]: reaped child process 1878, status = succeeded worker1 # [ 154.511969] nix-daemon[889]: accepted connection from pid 1893, user nix-grpc-daemon (trusted) worker1 # [ 154.535290] nix-daemon[889]: reaped child process 1896, status = succeeded lb # [ 154.531330] niks3-server[988]: 2026/09/20 08:08:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.560523] nix-grpc-daemon[1587]: time=2026-09-20T08:08:09.971Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 154.562057] nix-grpc-daemon[1587]: time=2026-09-20T08:08:09.971Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 154.575153] niks3-server[988]: 2026/09/20 08:08:09 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 154.587272] niks3-server[988]: 2026/09/20 08:08:10 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst lb # [ 154.597121] niks3-server[988]: 2026/09/20 08:08:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker1 # [ 154.619322] nix-grpc-daemon[1587]: time=2026-09-20T08:08:10.033Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.606580] niks3-server[988]: 2026/09/20 08:08:10 INFO Signed narinfos id=51 count=1 lb # [ 154.611992] niks3-server[988]: 2026/09/20 08:08:10 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 154.621355] niks3-server[988]: 2026/09/20 08:08:10 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 154.629024] niks3-server[988]: 2026/09/20 08:08:10 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo lb # [ 154.633513] niks3-server[988]: 2026/09/20 08:08:10 INFO Completed upload id=51 worker1 # [ 154.650232] nix-grpc-daemon[1587]: time=2026-09-20T08:08:10.064Z level=INFO msg="Upload complete. (325ms)" worker2 # [ 154.622780] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:10Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 154.661263] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=4 outputs=1 worker2 # [ 154.636196] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:10Z level=debug event=want client=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 154.683662] nix-daemon[889]: reaped child process 1876, status = succeeded worker1 # [ 154.712839] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 154.729491] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 154.744989] nix-grpc-daemon[1587]: time=2026-09-20T08:08:10.158Z level=INFO msg="All 1 paths already cached" worker1 # [ 154.754238] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 154.768599] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 154.974620] nix-daemon[889]: accepted connection from pid 1900, user nix-grpc-daemon (trusted) worker1 # [ 154.995274] nix-daemon[889]: reaped child process 1903, status = succeeded worker1 # [ 155.172589] nix-daemon[889]: accepted connection from pid 1905, user nix-grpc-daemon (trusted) worker1 # [ 155.192552] nix-daemon[889]: reaped child process 1908, status = succeeded lb # [ 155.186716] niks3-server[988]: 2026/09/20 08:08:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.212730] nix-grpc-daemon[1587]: time=2026-09-20T08:08:10.626Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 155.214282] nix-grpc-daemon[1587]: time=2026-09-20T08:08:10.626Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 155.214317] niks3-server[988]: 2026/09/20 08:08:10 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst lb # [ 155.227988] niks3-server[988]: 2026/09/20 08:08:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign worker1 # [ 155.251733] nix-grpc-daemon[1587]: time=2026-09-20T08:08:10.665Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.236709] niks3-server[988]: 2026/09/20 08:08:10 INFO Signed narinfos id=52 count=1 lb # [ 155.245173] niks3-server[988]: 2026/09/20 08:08:10 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls worker1 # [ 155.275349] nix-grpc-daemon[1587]: time=2026-09-20T08:08:10.689Z level=INFO msg="Upload complete. (489ms)" lb # [ 155.259085] niks3-server[988]: 2026/09/20 08:08:10 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 155.265629] niks3-server[988]: 2026/09/20 08:08:10 INFO Completed upload id=52 lb # [ 155.269600] niks3-server[988]: 2026/09/20 08:08:10 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 155.284326] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 155.296463] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 155.303746] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 155.308620] nix-daemon[889]: reaped child process 1898, status = succeeded worker1 # [ 155.322955] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 156.987678] nix-daemon[889]: reaped child process 1912, status = succeeded worker1 # [ 157.159042] nix-daemon[889]: accepted connection from pid 1927, user nix-grpc-daemon (trusted) worker1 # [ 157.178176] nix-daemon[889]: reaped child process 1930, status = succeeded lb # [ 157.177942] niks3-server[988]: 2026/09/20 08:08:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.204774] nix-grpc-daemon[1587]: time=2026-09-20T08:08:12.617Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 157.207177] nix-grpc-daemon[1587]: time=2026-09-20T08:08:12.617Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 157.221889] niks3-server[988]: 2026/09/20 08:08:12 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 157.234107] niks3-server[988]: 2026/09/20 08:08:12 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 157.242699] niks3-server[988]: 2026/09/20 08:08:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign worker1 # [ 157.264927] nix-grpc-daemon[1587]: time=2026-09-20T08:08:12.678Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.250135] niks3-server[988]: 2026/09/20 08:08:12 INFO Signed narinfos id=53 count=1 lb # [ 157.260150] niks3-server[988]: 2026/09/20 08:08:12 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 157.470007] niks3-server[988]: 2026/09/20 08:08:12 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 157.484001] niks3-server[988]: 2026/09/20 08:08:12 INFO Completed upload id=53 worker1 # [ 157.500759] nix-grpc-daemon[1587]: time=2026-09-20T08:08:12.914Z level=INFO msg="Upload complete. (566ms)" worker2 # [ 157.472414] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:12Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 157.515394] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=2 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=5 outputs=1 worker2 # [ 157.485518] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:12Z level=debug event=want client=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 lb # [ 157.510993] niks3-server[988]: 2026/09/20 08:08:12 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker1 # [ 157.536475] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 157.547695] nix-daemon[889]: reaped child process 1910, status = succeeded worker1 # [ 157.558032] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 157.580901] nix-grpc-daemon[1587]: time=2026-09-20T08:08:12.994Z level=INFO msg="All 1 paths already cached" worker1 # [ 157.590118] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 157.605050] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 157.808531] nix-daemon[889]: accepted connection from pid 1934, user nix-grpc-daemon (trusted) worker1 # [ 157.828831] nix-daemon[889]: reaped child process 1937, status = succeeded worker1 # [ 158.003834] nix-daemon[889]: accepted connection from pid 1939, user nix-grpc-daemon (trusted) worker1 # [ 158.022591] nix-daemon[889]: reaped child process 1942, status = succeeded lb # [ 158.022190] niks3-server[988]: 2026/09/20 08:08:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.052069] nix-grpc-daemon[1587]: time=2026-09-20T08:08:13.466Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 158.053558] nix-grpc-daemon[1587]: time=2026-09-20T08:08:13.466Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 158.065260] niks3-server[988]: 2026/09/20 08:08:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign worker1 # [ 158.091489] nix-grpc-daemon[1587]: time=2026-09-20T08:08:13.505Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.077640] niks3-server[988]: 2026/09/20 08:08:13 INFO Signed narinfos id=54 count=1 lb # [ 158.084582] niks3-server[988]: 2026/09/20 08:08:13 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst lb # [ 158.091564] niks3-server[988]: 2026/09/20 08:08:13 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 158.098165] niks3-server[988]: 2026/09/20 08:08:13 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete worker1 # [ 158.118823] nix-grpc-daemon[1587]: time=2026-09-20T08:08:13.532Z level=INFO msg="Upload complete. (494ms)" lb # [ 158.103585] niks3-server[988]: 2026/09/20 08:08:13 INFO Completed upload id=54 lb # [ 158.106242] niks3-server[988]: 2026/09/20 08:08:13 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 158.128320] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 158.137120] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 158.148870] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 158.153941] nix-daemon[889]: reaped child process 1932, status = succeeded worker1 # [ 158.168195] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 159.610246] nix-daemon[889]: reaped child process 1946, status = succeeded worker1 # [ 159.794895] nix-daemon[889]: accepted connection from pid 1961, user nix-grpc-daemon (trusted) worker1 # [ 159.813291] nix-daemon[889]: reaped child process 1964, status = succeeded lb # [ 159.809519] niks3-server[988]: 2026/09/20 08:08:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.836414] nix-grpc-daemon[1587]: time=2026-09-20T08:08:15.249Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 159.837948] nix-grpc-daemon[1587]: time=2026-09-20T08:08:15.249Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 159.851641] niks3-server[988]: 2026/09/20 08:08:15 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 159.864386] niks3-server[988]: 2026/09/20 08:08:15 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 159.874544] niks3-server[988]: 2026/09/20 08:08:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker1 # [ 159.895764] nix-grpc-daemon[1587]: time=2026-09-20T08:08:15.309Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.884059] niks3-server[988]: 2026/09/20 08:08:15 INFO Signed narinfos id=55 count=1 lb # [ 159.886550] niks3-server[988]: 2026/09/20 08:08:15 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 159.897888] niks3-server[988]: 2026/09/20 08:08:15 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 159.903077] niks3-server[988]: 2026/09/20 08:08:15 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo lb # [ 159.907587] niks3-server[988]: 2026/09/20 08:08:15 INFO Completed upload id=55 worker1 # [ 159.923915] nix-grpc-daemon[1587]: time=2026-09-20T08:08:15.337Z level=INFO msg="Upload complete. (345ms)" worker2 # [ 159.896659] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:15Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.937058] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=6 outputs=1 worker2 # [ 159.910756] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:15Z level=debug event=want client=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 159.955843] nix-daemon[889]: reaped child process 1944, status = succeeded worker1 # [ 159.985823] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 160.001968] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 160.153805] nix-grpc-daemon[1587]: time=2026-09-20T08:08:15.567Z level=INFO msg="All 2 paths already cached" worker1 # [ 160.163471] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 160.178018] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 160.388125] nix-daemon[889]: accepted connection from pid 1968, user nix-grpc-daemon (trusted) worker1 # [ 160.406109] nix-daemon[889]: reaped child process 1971, status = succeeded worker1 # [ 160.576631] nix-daemon[889]: accepted connection from pid 1973, user nix-grpc-daemon (trusted) worker1 # [ 160.595114] nix-daemon[889]: reaped child process 1976, status = succeeded lb # [ 160.591184] niks3-server[988]: 2026/09/20 08:08:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.619537] nix-grpc-daemon[1587]: time=2026-09-20T08:08:16.033Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 160.621272] nix-grpc-daemon[1587]: time=2026-09-20T08:08:16.033Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 160.624843] niks3-server[988]: 2026/09/20 08:08:16 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst worker1 # [ 160.653138] nix-grpc-daemon[1587]: time=2026-09-20T08:08:16.067Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.644153] niks3-server[988]: 2026/09/20 08:08:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 160.655668] niks3-server[988]: 2026/09/20 08:08:16 INFO Signed narinfos id=56 count=1 lb # [ 160.659707] niks3-server[988]: 2026/09/20 08:08:16 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 160.665751] niks3-server[988]: 2026/09/20 08:08:16 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 160.673920] niks3-server[988]: 2026/09/20 08:08:16 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo lb # [ 160.677971] niks3-server[988]: 2026/09/20 08:08:16 INFO Completed upload id=56 worker1 # [ 160.694715] nix-grpc-daemon[1587]: time=2026-09-20T08:08:16.108Z level=INFO msg="Upload complete. (498ms)" worker1 # [ 160.703240] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 160.720312] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 160.727150] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 160.732214] nix-daemon[889]: reaped child process 1966, status = succeeded worker1 # [ 160.743374] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 162.170507] nix-daemon[889]: reaped child process 1980, status = succeeded worker1 # [ 162.338209] nix-daemon[889]: accepted connection from pid 1995, user nix-grpc-daemon (trusted) worker1 # [ 162.357752] nix-daemon[889]: reaped child process 1998, status = succeeded lb # [ 162.354189] niks3-server[988]: 2026/09/20 08:08:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.383013] nix-grpc-daemon[1587]: time=2026-09-20T08:08:17.795Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 162.384655] nix-grpc-daemon[1587]: time=2026-09-20T08:08:17.795Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 162.391970] niks3-server[988]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 162.408904] niks3-server[988]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst worker1 # [ 162.436425] nix-grpc-daemon[1587]: time=2026-09-20T08:08:17.850Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.422874] niks3-server[988]: 2026/09/20 08:08:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 162.429799] niks3-server[988]: 2026/09/20 08:08:17 INFO Signed narinfos id=57 count=1 lb # [ 162.431746] niks3-server[988]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 162.437739] niks3-server[988]: 2026/09/20 08:08:17 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 162.444203] niks3-server[988]: 2026/09/20 08:08:17 INFO Completed upload id=57 worker1 # [ 162.460900] nix-grpc-daemon[1587]: time=2026-09-20T08:08:17.874Z level=INFO msg="Upload complete. (305ms)" lb # [ 162.446479] niks3-server[988]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker2 # [ 162.432685] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:17Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 162.473014] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=7 outputs=1 worker1 # [ 162.488843] nix-daemon[889]: reaped child process 1978, status = succeeded worker1 # [ 162.520361] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 162.536955] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 162.553571] nix-grpc-daemon[1587]: time=2026-09-20T08:08:17.967Z level=INFO msg="All 2 paths already cached" worker1 # [ 162.562706] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 162.576553] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 162.787812] nix-daemon[889]: accepted connection from pid 2002, user nix-grpc-daemon (trusted) worker1 # [ 162.807132] nix-daemon[889]: reaped child process 2005, status = succeeded worker1 # [ 162.982084] nix-daemon[889]: accepted connection from pid 2007, user nix-grpc-daemon (trusted) worker1 # [ 162.999342] nix-daemon[889]: reaped child process 2010, status = succeeded lb # [ 162.994015] niks3-server[988]: 2026/09/20 08:08:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.023105] nix-grpc-daemon[1587]: time=2026-09-20T08:08:18.436Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.024829] nix-grpc-daemon[1587]: time=2026-09-20T08:08:18.436Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 163.023324] niks3-server[988]: 2026/09/20 08:08:18 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst worker1 # [ 163.053451] nix-grpc-daemon[1587]: time=2026-09-20T08:08:18.467Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.038479] niks3-server[988]: 2026/09/20 08:08:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 163.050787] niks3-server[988]: 2026/09/20 08:08:18 INFO Signed narinfos id=58 count=1 lb # [ 163.058062] niks3-server[988]: 2026/09/20 08:08:18 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 163.066736] niks3-server[988]: 2026/09/20 08:08:18 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 163.073891] niks3-server[988]: 2026/09/20 08:08:18 INFO Completed upload id=58 worker1 # [ 163.090543] nix-grpc-daemon[1587]: time=2026-09-20T08:08:18.504Z level=INFO msg="Upload complete. (495ms)" lb # [ 163.077984] niks3-server[988]: 2026/09/20 08:08:18 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 163.100228] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 163.110432] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 163.119408] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 163.121925] nix-daemon[889]: reaped child process 2000, status = succeeded worker1 # [ 163.135633] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 164.786042] nix-daemon[889]: reaped child process 2014, status = succeeded worker1 # [ 164.969773] nix-daemon[889]: accepted connection from pid 2029, user nix-grpc-daemon (trusted) worker1 # [ 164.991857] nix-daemon[889]: reaped child process 2032, status = succeeded lb # [ 164.988679] niks3-server[988]: 2026/09/20 08:08:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.015214] nix-grpc-daemon[1587]: time=2026-09-20T08:08:20.428Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 165.022954] nix-grpc-daemon[1587]: time=2026-09-20T08:08:20.431Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 165.033539] niks3-server[988]: 2026/09/20 08:08:20 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst worker1 # [ 165.063776] nix-grpc-daemon[1587]: time=2026-09-20T08:08:20.477Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.048403] niks3-server[988]: 2026/09/20 08:08:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 165.059409] niks3-server[988]: 2026/09/20 08:08:20 INFO Signed narinfos id=59 count=1 lb # [ 165.065053] niks3-server[988]: 2026/09/20 08:08:20 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv lb # [ 165.069510] niks3-server[988]: 2026/09/20 08:08:20 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 165.076563] niks3-server[988]: 2026/09/20 08:08:20 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 165.080556] niks3-server[988]: 2026/09/20 08:08:20 INFO Completed upload id=59 lb # [ 165.083126] niks3-server[988]: 2026/09/20 08:08:20 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker1 # [ 165.096852] nix-grpc-daemon[1587]: time=2026-09-20T08:08:20.510Z level=INFO msg="Upload complete. (349ms)" worker2 # [ 165.069806] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:20Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 165.109429] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=8 outputs=1 worker1 # [ 165.127148] nix-daemon[889]: reaped child process 2012, status = succeeded worker1 # [ 165.154144] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 165.170089] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 165.193911] nix-grpc-daemon[1587]: time=2026-09-20T08:08:20.607Z level=INFO msg="All 2 paths already cached" worker1 # [ 165.203354] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 165.217448] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 165.430684] nix-daemon[889]: accepted connection from pid 2036, user nix-grpc-daemon (trusted) worker1 # [ 165.451546] nix-daemon[889]: reaped child process 2039, status = succeeded worker1 # [ 165.629625] nix-daemon[889]: accepted connection from pid 2041, user nix-grpc-daemon (trusted) worker1 # [ 165.648141] nix-daemon[889]: reaped child process 2044, status = succeeded lb # [ 165.646314] niks3-server[988]: 2026/09/20 08:08:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.674196] nix-grpc-daemon[1587]: time=2026-09-20T08:08:21.087Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 165.675669] nix-grpc-daemon[1587]: time=2026-09-20T08:08:21.088Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 165.677954] niks3-server[988]: 2026/09/20 08:08:21 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 165.708589] nix-grpc-daemon[1587]: time=2026-09-20T08:08:21.122Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.695041] niks3-server[988]: 2026/09/20 08:08:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 165.705044] niks3-server[988]: 2026/09/20 08:08:21 INFO Signed narinfos id=60 count=1 lb # [ 165.706440] niks3-server[988]: 2026/09/20 08:08:21 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 165.710526] niks3-server[988]: 2026/09/20 08:08:21 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 165.716577] niks3-server[988]: 2026/09/20 08:08:21 INFO Completed upload id=60 worker1 # [ 165.732213] nix-grpc-daemon[1587]: time=2026-09-20T08:08:21.146Z level=INFO msg="Upload complete. (496ms)" lb # [ 165.718591] niks3-server[988]: 2026/09/20 08:08:21 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 165.740820] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 165.748584] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 worker1 # [ 165.760178] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 165.763242] nix-daemon[889]: reaped child process 2034, status = succeeded worker1 # [ 165.774324] nix-daemon[889]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 166.392827] nix-daemon[889]: reaped child process 2048, status = succeeded worker1 # [ 166.552294] nix-daemon[889]: accepted connection from pid 2063, user nix-grpc-daemon (trusted) worker1 # [ 166.569993] nix-daemon[889]: reaped child process 2066, status = succeeded lb # [ 166.567849] niks3-server[988]: 2026/09/20 08:08:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.599871] nix-grpc-daemon[1587]: time=2026-09-20T08:08:22.012Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 166.601514] nix-grpc-daemon[1587]: time=2026-09-20T08:08:22.012Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 166.606072] niks3-server[988]: 2026/09/20 08:08:22 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 166.622615] niks3-server[988]: 2026/09/20 08:08:22 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst worker1 # [ 166.659075] nix-grpc-daemon[1587]: time=2026-09-20T08:08:22.072Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.637089] niks3-server[988]: 2026/09/20 08:08:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 166.646818] niks3-server[988]: 2026/09/20 08:08:22 INFO Signed narinfos id=61 count=1 lb # [ 166.652304] niks3-server[988]: 2026/09/20 08:08:22 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 166.665156] niks3-server[988]: 2026/09/20 08:08:22 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 166.673404] niks3-server[988]: 2026/09/20 08:08:22 INFO Completed upload id=61 worker1 # [ 166.687859] nix-grpc-daemon[1587]: time=2026-09-20T08:08:22.101Z level=INFO msg="Upload complete. (306ms)" lb # [ 166.675586] niks3-server[988]: 2026/09/20 08:08:22 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 166.701302] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48612 duration_s=0 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=9 outputs=1 worker1 # [ 166.719627] nix-daemon[889]: reaped child process 2046, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 21.51 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1' worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.08 seconds) client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1 worker1 # [ 167.102338] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48612 worker2 # [ 167.078844] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:22Z level=debug event=want client=2 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.29 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 21.88 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.10 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 168.722326] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:24Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.14 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&2 worker1 # [ 169.629792] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48612 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 169.615818] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:25Z level=debug event=want client=3 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker2 # [ 169.621355] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:25Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 169.661321] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33524 worker2 # [ 169.671304] nix-grpc-daemon[1673]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 15 ms (attempt 1/5) worker2 # [ 169.690153] nix-grpc-daemon[1673]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 2/5) worker2 # [ 169.733527] nix-grpc-daemon[1673]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 3/5) worker2 # [ 169.750909] nix-grpc-daemon[1673]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 370 ms (attempt 4/5) worker2 # [ 170.129397] nix-grpc-daemon[1673]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 170.155687] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33524 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 170.177223] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33524 worker2 # [ 170.195498] nix-daemon[838]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) worker2 # [ 170.226546] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:25Z level=info event=niks3_push_started pid=1752 worker2 # [ 170.658949] nix-daemon[838]: accepted connection from pid 1765, user nix-grpc-daemon (trusted) worker2 # [ 170.678085] nix-daemon[838]: reaped child process 1768, status = succeeded worker2 # [ 170.870971] nix-daemon[838]: accepted connection from pid 1770, user nix-grpc-daemon (trusted) worker2 # [ 170.895524] nix-daemon[838]: reaped child process 1773, status = succeeded lb # [ 170.927653] niks3-server[988]: 2026/09/20 08:08:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 170.920519] nix-grpc-daemon[1752]: time=2026-09-20T08:08:26.334Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 170.922061] nix-grpc-daemon[1752]: time=2026-09-20T08:08:26.334Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 170.973501] niks3-server[988]: 2026/09/20 08:08:26 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst lb # [ 170.992600] niks3-server[988]: 2026/09/20 08:08:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign worker2 # [ 170.979954] nix-grpc-daemon[1752]: time=2026-09-20T08:08:26.394Z level=INFO msg="Uploading 1 narinfos" lb # [ 171.004587] niks3-server[988]: 2026/09/20 08:08:26 INFO Signed narinfos id=62 count=1 lb # [ 171.015894] niks3-server[988]: 2026/09/20 08:08:26 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 171.029349] niks3-server[988]: 2026/09/20 08:08:26 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 171.035418] niks3-server[988]: 2026/09/20 08:08:26 INFO Completed upload id=62 worker2 # [ 171.016205] nix-grpc-daemon[1752]: time=2026-09-20T08:08:26.430Z level=WARN msg="Failed to register uploaded object" key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 171.036705] nix-grpc-daemon[1752]: time=2026-09-20T08:08:26.431Z level=INFO msg="Upload complete. (549ms)" worker2 # [ 171.047389] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33524 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 171.051992] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33524 worker2 # [ 171.060875] nix-daemon[838]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) worker2 # [ 171.063718] nix-daemon[838]: reaped child process 1750, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... worker2 # [ 171.076275] nix-daemon[838]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv client # farm-a> LOG-farm-a-drain worker2 # [ 172.540663] nix-daemon[838]: reaped child process 1777, status = succeeded worker2 # [ 172.744388] nix-daemon[838]: accepted connection from pid 1792, user nix-grpc-daemon (trusted) worker2 # [ 172.764561] nix-daemon[838]: reaped child process 1795, status = succeeded lb # [ 172.802178] niks3-server[988]: 2026/09/20 08:08:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 172.793646] nix-grpc-daemon[1752]: time=2026-09-20T08:08:28.207Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 172.795227] nix-grpc-daemon[1752]: time=2026-09-20T08:08:28.207Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 172.857565] niks3-server[988]: 2026/09/20 08:08:28 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 172.871037] niks3-server[988]: 2026/09/20 08:08:28 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 172.888424] niks3-server[988]: 2026/09/20 08:08:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 172.897438] niks3-server[988]: 2026/09/20 08:08:28 INFO Signed narinfos id=63 count=1 worker2 # [ 172.878279] nix-grpc-daemon[1752]: time=2026-09-20T08:08:28.291Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.904412] niks3-server[988]: 2026/09/20 08:08:28 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 172.916089] niks3-server[988]: 2026/09/20 08:08:28 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 172.929974] niks3-server[988]: 2026/09/20 08:08:28 INFO Completed upload id=63 worker2 # [ 172.910865] nix-grpc-daemon[1752]: time=2026-09-20T08:08:28.325Z level=INFO msg="Upload complete. (418ms)" lb # [ 172.933267] niks3-server[988]: 2026/09/20 08:08:28 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 172.929298] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33524 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=10 outputs=1 worker2 # [ 172.954382] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:28Z level=debug event=want client=3 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker2 # [ 172.961015] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:28Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 172.966647] nix-daemon[838]: reaped child process 1775, status = succeeded worker2 # [ 172.978394] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33524 worker2 # [ 172.996667] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33524 worker2 # [ 173.014632] nix-grpc-daemon[1752]: time=2026-09-20T08:08:28.429Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 173.027136] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33524 worker2 # [ 173.043275] nix-daemon[838]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) worker2 # [ 173.270685] nix-daemon[838]: accepted connection from pid 1801, user nix-grpc-daemon (trusted) worker2 # [ 173.292856] nix-daemon[838]: reaped child process 1804, status = succeeded worker2 # [ 173.484591] nix-daemon[838]: accepted connection from pid 1806, user nix-grpc-daemon (trusted) worker2 # [ 173.505728] nix-daemon[838]: reaped child process 1809, status = succeeded lb # [ 173.536528] niks3-server[988]: 2026/09/20 08:08:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 173.530169] nix-grpc-daemon[1752]: time=2026-09-20T08:08:28.944Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 173.531698] nix-grpc-daemon[1752]: time=2026-09-20T08:08:28.944Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 173.573526] niks3-server[988]: 2026/09/20 08:08:28 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 173.579289] nix-grpc-daemon[1752]: time=2026-09-20T08:08:28.993Z level=INFO msg="Uploading 1 narinfos" lb # [ 173.592898] niks3-server[988]: 2026/09/20 08:08:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 173.607356] niks3-server[988]: 2026/09/20 08:08:29 INFO Signed narinfos id=64 count=1 lb # [ 173.611312] niks3-server[988]: 2026/09/20 08:08:29 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 173.625612] niks3-server[988]: 2026/09/20 08:08:29 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 173.630586] niks3-server[988]: 2026/09/20 08:08:29 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo lb # [ 173.636642] niks3-server[988]: 2026/09/20 08:08:29 INFO Completed upload id=64 worker2 # [ 173.617888] nix-grpc-daemon[1752]: time=2026-09-20T08:08:29.032Z level=INFO msg="Upload complete. (555ms)" worker2 # [ 173.628466] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33524 duration_s=0 paths=1 nar_bytes_in=632 worker2 # [ 173.643157] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33524 worker2 # [ 173.657262] nix-daemon[838]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) worker2 # [ 173.663887] nix-daemon[838]: reaped child process 1799, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker2 # [ 173.680724] nix-daemon[838]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) lb # [ 174.030312] envoy[938]: conn peer=[2001:db8:1::1]:40040 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26966 tx=10719 ms=21209 lb # [ 174.035724] envoy[938]: conn peer=[2001:db8:1::1]:45534 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=710 tx=439 ms=32 client # farm-b> LOG-farm-b-drain worker2 # [ 175.136460] nix-daemon[838]: reaped child process 1813, status = succeeded worker2 # [ 175.344882] nix-daemon[838]: accepted connection from pid 1828, user nix-grpc-daemon (trusted) worker2 # [ 175.367137] nix-daemon[838]: reaped child process 1831, status = succeeded lb # [ 175.401163] niks3-server[988]: 2026/09/20 08:08:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 175.396710] nix-grpc-daemon[1752]: time=2026-09-20T08:08:30.810Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 175.398430] nix-grpc-daemon[1752]: time=2026-09-20T08:08:30.810Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 175.454535] niks3-server[988]: 2026/09/20 08:08:30 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 175.465999] niks3-server[988]: 2026/09/20 08:08:30 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 175.477298] niks3-server[988]: 2026/09/20 08:08:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker2 # [ 175.462227] nix-grpc-daemon[1752]: time=2026-09-20T08:08:30.876Z level=INFO msg="Uploading 1 narinfos" lb # [ 175.484292] niks3-server[988]: 2026/09/20 08:08:30 INFO Signed narinfos id=65 count=1 lb # [ 175.491392] niks3-server[988]: 2026/09/20 08:08:30 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 175.500168] niks3-server[988]: 2026/09/20 08:08:30 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 175.508234] niks3-server[988]: 2026/09/20 08:08:30 INFO Completed upload id=65 worker2 # [ 175.489066] nix-grpc-daemon[1752]: time=2026-09-20T08:08:30.903Z level=INFO msg="Upload complete. (394ms)" lb # [ 175.510496] niks3-server[988]: 2026/09/20 08:08:30 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 175.513025] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33524 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=11 outputs=1 worker2 # [ 175.528221] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:30Z level=debug event=want client=3 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker2 # [ 175.532290] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:30Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 175.536757] nix-daemon[838]: reaped child process 1811, status = succeeded worker2 # [ 175.555091] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33524 worker2 # [ 175.574456] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33524 worker2 # [ 175.591738] nix-grpc-daemon[1752]: time=2026-09-20T08:08:31.006Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 175.603361] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33524 worker2 # [ 175.620164] nix-daemon[838]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) worker2 # [ 175.857668] nix-daemon[838]: accepted connection from pid 1837, user nix-grpc-daemon (trusted) worker2 # [ 175.876655] nix-daemon[838]: reaped child process 1840, status = succeeded worker2 # [ 176.053508] nix-daemon[838]: accepted connection from pid 1842, user nix-grpc-daemon (trusted) worker2 # [ 176.070890] nix-daemon[838]: reaped child process 1845, status = succeeded lb # [ 176.102774] niks3-server[988]: 2026/09/20 08:08:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 176.093386] nix-grpc-daemon[1752]: time=2026-09-20T08:08:31.508Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 176.094869] nix-grpc-daemon[1752]: time=2026-09-20T08:08:31.508Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 176.132257] niks3-server[988]: 2026/09/20 08:08:31 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst lb # [ 176.146014] niks3-server[988]: 2026/09/20 08:08:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign worker2 # [ 176.133779] nix-grpc-daemon[1752]: time=2026-09-20T08:08:31.548Z level=INFO msg="Uploading 1 narinfos" lb # [ 176.158840] niks3-server[988]: 2026/09/20 08:08:31 INFO Signed narinfos id=66 count=1 lb # [ 176.163774] niks3-server[988]: 2026/09/20 08:08:31 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls worker2 # [ 176.151569] nix-grpc-daemon[1752]: time=2026-09-20T08:08:31.566Z level=INFO msg="Upload complete. (512ms)" lb # [ 176.172252] niks3-server[988]: 2026/09/20 08:08:31 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 176.177234] niks3-server[988]: 2026/09/20 08:08:31 INFO Completed upload id=66 worker2 # [ 176.157972] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33524 duration_s=0 paths=1 nar_bytes_in=760 lb # [ 176.180234] niks3-server[988]: 2026/09/20 08:08:31 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo worker2 # [ 176.170129] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33524 worker2 # [ 176.177236] nix-daemon[838]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) worker2 # [ 176.181776] nix-daemon[838]: reaped child process 1835, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... worker2 # [ 176.194803] nix-daemon[838]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 177.817659] nix-daemon[838]: reaped child process 1849, status = succeeded client # farm-top> LOG-farm-top-drain worker2 # [ 177.981943] nix-daemon[838]: accepted connection from pid 1864, user nix-grpc-daemon (trusted) worker2 # [ 178.001166] nix-daemon[838]: reaped child process 1867, status = succeeded lb # [ 178.035146] niks3-server[988]: 2026/09/20 08:08:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 178.026814] nix-grpc-daemon[1752]: time=2026-09-20T08:08:33.440Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 178.028396] nix-grpc-daemon[1752]: time=2026-09-20T08:08:33.440Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 178.071691] niks3-server[988]: 2026/09/20 08:08:33 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst lb # [ 178.084396] niks3-server[988]: 2026/09/20 08:08:33 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 178.093857] niks3-server[988]: 2026/09/20 08:08:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker2 # [ 178.081024] nix-grpc-daemon[1752]: time=2026-09-20T08:08:33.495Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.100234] niks3-server[988]: 2026/09/20 08:08:33 INFO Signed narinfos id=67 count=1 lb # [ 178.105939] niks3-server[988]: 2026/09/20 08:08:33 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls lb # [ 178.118350] niks3-server[988]: 2026/09/20 08:08:33 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 178.124811] niks3-server[988]: 2026/09/20 08:08:33 INFO Completed upload id=67 worker2 # [ 178.105692] nix-grpc-daemon[1752]: time=2026-09-20T08:08:33.520Z level=INFO msg="Upload complete. (301ms)" lb # [ 178.127519] niks3-server[988]: 2026/09/20 08:08:33 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 178.115958] nix-grpc-daemon[1673]: ts=2026-09-20T08:08:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33524 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=12 outputs=1 worker2 # [ 178.132275] nix-daemon[838]: reaped child process 1847, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&2, in 8.82 seconds) client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath, in 0.24 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 178.734926] nix-grpc-daemon[1503]: ts=2026-09-20T08:08:34Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 0.05 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 11.61 seconds) (finished: run the VM test script, in 179.72 seconds) test script finished in 180.05s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.21 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh